文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > 高等教育 > 工学 > Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forest
侵权投诉

Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forest

Real-timeArticulatedHandPoseEstimationusingSemi-supervised

TransductiveRegressionForests

DanhangTang

ImperialCollegeLondon

London,UK

d.tang11@imperial.ac.uk

Tsz-HoYu

UniversityofCambridge

Cambridge,UK

thy23@cam.ac.uk

Tae-KyunKim

ImperialCollegeLondon

London,UK

tk.kim@imperial.ac.uk

Abstract

Thispaperpresentsthe rstsemi-supervisedtransduc-tivealgorithmforreal-timearticulatedhandposeestima-tion.Noisydataandocclusionsarethemajorchallengesofarticulatedhandposeestimation.Inaddition,thedis-crepanciesamongrealisticandsyntheticposedataunder-minetheperformancesofexistingapproachesthatusesyn-theticdataextensivelyintraining.WethereforeproposetheSemi-supervisedTransductiveRegression(STR)forestwhichlearnstherelationshipbetweenasmall,sparselyla-belledrealisticdatasetandalargesyntheticdataset.Wealsodesignanoveldata-driven,pseudo-kinematictech-niquetore nenoisyoroccludedjoints.Ourcontributionsinclude:(i)capturingthebene tsofbothrealisticandsyn-theticdataviatransductivelearning;(ii)showingaccura-ciescanbeimprovedbyconsideringunlabelleddata;and(iii)introducingapseudo-kinematictechniquetore near-ticulationsef ciently.Experimentalresultsshownotonlythepromisingperformanceofourmethodwithrespecttonoiseandocclusions,butalsoitssuperiorityoverstate-of-the-artsinaccuracy,robustnessandspeed.

(a)

Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forest

RGB(b)

Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forest

Labels(c)

Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forest

Synthetic(d)Realistic

Figure1:Thering ngerismissingduetoocclusionsin(d),andthelittle ngeriswiderthanthesyntheticimagein(c).

1.Introduction

Articulatedhandposeestimationsharesalotofsimilar-itieswiththepopular3-Dbodyposeestimation.Bothtasksaimtorecognisethecon gurationofanarticulatedsubjectwithahighdegreeoffreedom.Whilelatestdepthsensortechnologyhasenabledbodyposeestimationinreal-time[2,24,12,26],handposeestimationstillrequiresimprove-ment.Despitetheirsimilarities,provenapproachesinbodyposeestimationcannotberepurposeddirectlytohandartic-ulations,duetotheuniquechallengesofthetask:

(1)Occlusionsandviewpointchanges.Selfocclusionsareprevalentinhandarticulations.Comparedwithlimbsinbodypose, ngersperformmoresophisticatedarticulations.Differentfrombodyposeswhichareusuallyupright

Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forest

and

1

frontal[9],differentviewpointscanrenderdifferentdepthimagesdespitethesamehandarticulation.

(2)Noisyhandposedata.Bodyposesusuallyoccupylargerandrelativelystaticregionsinthedepthimages.Hands,however,areoftencapturedinalowerresolution.AsshowninFig.1,missingpartsandquantisationerroriscommoninhandposedata,especiallyatsmall,partiallyoccludedpartssuchas ngertips.Unlikesensornoiseanddeptherrorsin[12]and[2],theseartefactscannotbere-pairedorsmoothedeasily.Consequently,alargediscrep-ancyisobservedbetweensyntheticandrealisticdata.

Moreover,manuallylabelledrealisticdataareextremelycostlytoobtain.Existingstate-of-the-artsresorttosyntheticdata[16],ormodel-basedoptimisation[8,15].Nonethe-less,suchsolutionsdonotconsidertherealistic-syntheticdiscrepancies,theirperformancesarehenceaffected.Be-sides,thenoisyrealisticdatamakejointdetectiondif cult,whereasinsyntheticdatajointboundariesarealwayscleanandaccurate.

Addressingtheabovechallenges,wepresentanovelSemi-supervisedTransductiveRegression(STR)forest.Thisprocessisknownastransductivetransferlearning[21]:Atransductivemodellearnsfromasourcedomain,e.g.syntheticdata;ontheotherhand,itappliesknowledgetransformtoadifferentbutrelatedtargetdomain,e.g.real-isticdata,inthetestingstage.Asaresult,itbene tsfrom

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email