文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > 高等教育 > 工学 > Accurate Person Tracking Through Changing Poses for Multi-view Action Recognition
侵权投诉

Accurate Person Tracking Through Changing Poses for Multi-view Action Recognition

AccuratePersonTrackingThroughChangingPosesfor

Multi-viewActionRecognition

PradeepNatarajan

RaytheonBBNTechnologies

10MoultonSt

CambridgeMA02138,USA

pradeepn@bbn.com

UniversityofSouthern

California

LosAngelesCA90089,USA

PrithvirajBanerjee

pbanerje@usc.edu

UniversityofSouthern

California

LosAngelesCA90089,USA

RamNevatia

nevatia@usc.edu

ABSTRACT

Actionsbyhumansinreal-worldsettingsinvolvelargechangesintheperson’sposeandtherelativeorientationwithrespecttothecamera.Persontrackingalgorithmsoftenfailundersuchconditions,sincetheyworkbydetectingandtrackingpeopleinafewknownposes(typicallystanding).Further,duetoocclusionsandsimilarityofclothingwithbackground,foregroundsilhouettesaretypicallyverynoisy.Wepresentanapproachwhichaddresstheseproblemsby rstaccu-ratelytrackingapersonthroughchangingposeandbrokenforegroundblobs.Duringthetrackingprocesswealsoes-timatetherelativeorientationandscaleoftheperson.Werepresenttheposeofthepersonineachtrackwindowus-ingagrid-of-centroidsmodel,andrecognizetheactionbymatchingwithasetofkeyposes,ineachframe.Wetestedourapproachinadatasetcollectedinarealgrocerystore,andreportbetterthan≈82.5%accuracyforframe-by-framerecognitionofactions.

1.INTRODUCTION

Systemsforautomaticanalysisandrecognitionofactionsfromvideoshaveseveralcompellingapplicationsincludinghuman-computerinteraction,visualsurveillance,searchandretrievalamongothers.Whilethegeneralproblemofactionrecognitioninunconstrainedvideosisextremelydi cult,simplemethodsthatworkinwell-constrainedenvironmentscanhaveasigni cantpracticalimpact.Withthisinmind,wefocusontheproblemoftrackingandrecognizingsinglepersonactions,inlargelystaticbackground,indoorenviron-ments.Suchconditionsarecommoninlibrariesandsmallgrocerystoreswheremostaislesaresparselypopulated.Extensiveresearchhasbeenconductedinactionrecog-nition,duetotherangeofpotentialapplications.How-ever,theapplicabilityofcurrentmethodsremainlimited,sincelow-leveltrackingandposeestimationremainsex-tremelyhard.Whilesigni cantprogresshasbeenmadeCorrespondingauthor

Permissiontomakedigitalorhardcopiesofallorpartofthisworkforpersonalorclassroomuseisgrantedwithoutfeeprovidedthatcopiesarenotmadeordistributedforpro torcommercialadvantageandthatcopiesbearthisnoticeandthefullcitationonthe rstpage.Tocopyotherwise,torepublish,topostonserversortoredistributetolists,requirespriorspeci cpermissionand/orafee.

ICVGIP’10,December12-15,2010,Chennai,India

Copyright2010ACM978-1-4503-0060-5/10/12...$10.00.

155

inpedestriandetection[5][28]andtracking[15],suchdetect-and-associatemethodscanhandleonlyafewknownposes(typicallyupright).Thisisbecausethedetectorsneedalargesetoftrainingimagesforeachposeofinterest,andhencearenotscalableforactionsinvolvingextensiveposearticulation.Thismakesitnecessarytodevelopsuitabletechniquestopredictandinterpolatebetweentwodetec-tionsofknownposes,whichmustalsoberobusttofalsealarmsandmisseddetections.

Further,manyactionrecognitionapproachesrelyonex-tracting2Dfeatureslikespatio-temporalinterestpoints[13]andlearningsuitableclassi ers.Thelearnedmodelsaretypicallynotgeneralizableacrossdatasets,viewpointsandscale.Thiswouldeitherrequirecollectingaprohibitivelylargetrainingset,orretrainingthemodelsforeachnewdataset.Toaddressviewpointvariations,[17][11][20]use3DMotionCapture(Mocap)dataofactionsrenderedfrommultipleviewpoints,whicharethenmatchedto2Dfeatures.However,suchMocapdataistimeconsumingtocollectandrequiresexpensiveequipment.Alsorenderingthe3Dmod-elsfrommultipleviewpointstakesalongtime(3-4days),andrequiresproprietarysoftwarelikePoser.

Weaddresstheselimitationsby rstpresentinganalgo-rithmtotrackasinglepersonthroughlargechangesinori-entation,scaleandposearticulation.Duringtrackingwealsoestimatetheapproximateorientationandheightofthepersonwithrespecttothecamera.Werepresenttheposeineachtrackwindowofeachframe,usingagrid-of-centroidsfeaturevectorthatisrobusttolargeerrorsinbackgroundsubtraction.Wenextrecognizeactionsbymatchingthefea-turevectorwiththeactionmodels,whichisrepresentedus-ingasequenceofkeyposesandmotionmodels.Thekeyposesarerepresentedusingstick gures,whosearticulationscanbespeci edmanually.Further,welearnourmotionmod-elsformulti-viewactionrecognitionfromafewvideosam-ples,withoutrequiringcameracalibration.Ourapproachpresentsane ectiveandeasy-to-useframeworkforframe-by-frameactionrecognitionincommonindoorsettings.Wedemonstrateourmethodonadatasetcollectedinarealgro-cerystorewith8di erentactorsand3actions,undervary-ingclothing,lightingandviewpoints.Oursystemachieves≈82.5%accuracyandrunsat5fpsonastandarddesktopcomputer.

Intherestofthepaper,wewilldiscussrelatedworkinsection2,overviewofourapproachinsection3,trackingalgorithminsection4,methodsforlearningkeyposesandmotionmodelsinsection5,matchingandrecognitioninsec-tion6andresultsinsection7.

第1页

你可能喜欢

热门文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email