文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > Learning a highly structured motion model for 3D human tracking
侵权投诉

Learning a highly structured motion model for 3D human tracking

This paper presents our work on learning high level structure from human motion sequences, and its applications in human figure tracking. We use a structured representation (“primitives ” and their transitions) of complex motion and propose a two-step un

ACCV2002:The5thAsianConferenceonComputerVision,23–25January2002,Melbourne,Australia.

LearningAHighlyStructuredMotionModelfor3DHumanTrackingTaoZhao

UniversityofSouthernCalifornia

LosAngeles,CA90089

TianshuWang

Arti cialIntelligenceandRoboticsLab

Xi’anJiaotongUniversity

Heung-YeungShum

MicrosoftResearch,ChinaBeijing10080,China

taozhao@iris.usc.edu

Abstract

tswang@asia.comhshum@microsoft.com

Thispaperpresentsourworkonlearninghighlevelstruc-turefromhumanmotionsequences,anditsapplicationsinhuman guretracking.Weuseastructuredrepresentation(“primitives”andtheirtransitions)ofcomplexmotionandproposeatwo-stepunsupervisedlearningapproachtore-coverthenatural“primitives”fromunsegmented3D-motioncapturedsequencesofcomplexhumanmotion.Thestruc-turerecoveryisdoneundertheMDL(minimumdescriptionlength)paradigm.ThenthelearntdynamicmodelofhumanmotionisusedintheCONDENSATIONframeworktosuc-cessfullytrackhumanmotioninavideosequence.Experi-mentalresultsofballetdancingsequencesdemonstratethatourapproachworkswell.Thelearntstructureisalsousedtosynthesizenewvideosequences.

1Introduction

Humanmotiontrackingandunderstandinghavebeenac-tiveresearchtopicsincomputervisionforalongtimebe-causeoftheirwideapplicationsinrecognition,animationandhuman-computerinteraction.Goodsurveyonvisualanaly-sisofhumanmotionandvision-basedmotion-capturecanbefoundin[7],[13].However,3Dhumantrackingfroma2Dvideosequenceremainslargelyunsolved.

In3Dhumantracking,akinematicsmodelisgenerallyusedandtheproblemistorecoverthejointanglesfromtheimagesequence.Manyfactorscontributetothedif cultyof3Dhuman guretracking:

kinematicshassingularposes;

cameraprojectionlosesdepth,andintroducesanobser-vationsingularityandre ectivesymmetry;largenumberofDOFs(20+forfullbody);complexhumandynamics;

variousimagenoisesincludingcomplexbackground,non-rigidmotionofbodyandclothing,changeofillu-mination,etc.

Thisworkwasdonewhilethe rsttwoauthorswerevisitingMicrosoftResearch,China.

Someofthedif cultiescanbealleviatedbyintroducinganappropriatedynamicmodel(i.e.,howtheobjectmoves)whichservesasaprior.Forcomplexhumanmotion,suchasdancing,gymnasticsandKungFu,whicharemadeupofanumberofbasicmovesor“buildingblocks”,asingledynamicmodelisingeneralinsuf cient,instead,astructureddynamicmodelispreferred.

Muchpreviousworkhasbeendoneinmodelingcomplexhumanmotionmodelandtheycanbelargelycategoriedintotwoclasses.The rstclassisbysupervisedlearning.Mixturemotionmodelisusedfortrackingin[9].Buttheprimitivesarepre-de nedandsegmentedmanuallyfortraining.

Thesecondclassofapproach,unsupervisedorsemi-unsupervisedhumanmotionmodeling,avoidssuchtediousanderrorproneprocessofmanualsegmentation.In[3],HMM(hiddenMarkovmodel)islearntforhumanlocomotion(walking,running).ButthetopologyoftheHMMisgivenanditisdif culttoextendittomorecomplexmotion.In[1],eachprimitivefollowsadifferentdynamiclaw(acceler-ation)whichcanbeusedtodifferentiateeachother.VariablelengthMarkovmodels(VLMM)[6]werelearnttomodelhu-manbehavior.However,simpleheuristicssuchaslowveloc-itypointsattheboundaryoftwoprimitiveswasemployedforsegmentation.SLDS(switchinglineardynamicsystems)arelearntin[14]forclassifyinghumanmotion.[2]alsolearnedHMMsforcomplexmotionsuchasdancing.ItemployedaverycomplicatedoptimizationprocessandthehighlevelstructureisstillhiddenintheHMM.

Inthispaper,weadopttheunsupervisedapproachandaimtorecovertheoriginalprimitivesinasystemeticway.Mini-mumdescriptionlength(MDL)criterionisusedforstructurerecoveryandanexplicittwo-stepcoarseto nemethodispro-posed.Inbothsteps,MDLguaranteestheconcisenessoftherecovery,thusleadingtooriginalornearlyoriginalprimitives.Oncelearnt,thestructuredrepresentationcanthenbeusedintrackingandsynthesis.AnoverviewofoursystemisshowninFig.1.

Itisworthmentioningtheballetdancingdataweuseinourexperiments.Tolearnthemotionmodel,weuse10sequencesofcaptured3Dmotionofaballettutorial,4428frames(about3min)intotal.Wetrytomodelthearmmovements(4DOFs

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email