sieves, to extract eye gesture parameters from the gray-level data directly. The proposed method resembles the work Automatic recovery of eye gestures from image se- done by Matthews et al. [11] for lip reading, but differs in quences is one of the importa
EyeActivityDetectionandRecognitionusingMorphologicalScale-spaceDecomposition
I.Ravyse,H.Sahli,M.J.T.Reinders,J.Cornelis
VrijeUniversiteitBrussel,Dept.ofElectronicsandInformationprocessing-ETRO
Pleinlaan2,B-1050Brussels,Belgiumicravyse,hsahli,jpcornel@etro.vub.ac.be
DelftUniversityofTechnology,Dept.ofElectricalEngineering
P.O.Box5031,2600GADelft,TheNetherlands
M.J.T.Reinders@its.tudelft.nl
Publishedby15thInternationalConferenceonPatternRecognition,ICPR2000,
Vol.1,pp.1080-1083,September3-8,2000,Barcelona,Spain
Abstract
Automaticrecoveryofeyegesturesfromimagese-quencesisoneoftheimportanttopicsforfacerecognitionandmodel-basedcodingofvideophonesequences.Usu-allycomplicatedmodelsoftheeyeanditsmotionareused.Inthiscontributionaneyegestureparameterestimationisdescribed.Apreviouslypublishedautomaticeyede-tection/trackingalgorithm,basedontemplatematching,isusedfortheeyeposedetection.Theeyegestureanalysisisrealisedwithamathematicalmorphologyscale-spaceap-proach,formingspatio-temporalcurvesoutofscalemea-surementstatistics.Theresultingcurvesprovideadirectmeasureoftheeyegesture,whichcanthenbeusedasaneyeanimationparameter.Experimentalresultsdemonstratetheef ciencyandrobustness.
sieves,toextracteyegestureparametersfromthegray-leveldatadirectly.TheproposedmethodresemblestheworkdonebyMatthewsetal.[11]forlipreading,butdiffersintheimplementationandtheanalysisofthespatio-temporalcurvesforeyegestureparameterestimation.Inthispaper,theeyegestureisde nedastheclosingoftheeyelids.Thedirectionofgazeisnotconsideredyet.Theestimatedlow-levelanimationparameterisrepresentedbyanActionUnit(AU)[12].AnAUstandsforasmallvisiblechangeinthefacialexpression.Moreprecisely,AU43parameterizestheamountofeyeclosure.
Thepaperisorganizedasfollows.Section2summa-rizestheapproachforthetrackingofeyeregions.Section3describesthesievedecomposition.Insection4spatio-temporalcurvesofgranulesareintroduced,fromwhichges-tureparametersareestimated.Section5discussestheex-perimentalresultsobtainedwithtestsequencesSuzieandMissAmerica.Finalconclusionsaredrawninsection6.
1.Introduction
Vision-basedfacialgestureanalysisextracts,fromanimagesequence,spatio-temporalinformationaboutthefa-cialfeaturesposeandexpressions.Themodelingandtrackingoffacesandexpressionsisatopicofincreas-inginterest.Anoverviewcanbefoundin[6].Numer-oustechniqueshavebeenproposedforfacialfeaturedetec-tionandfacialexpression(gesture)analysissuchastem-platematching[5],principalcomponentanalysis[1],inter-polatedviews[7],deformabletemplates[15],activecon-tours[9],optical ow[4],physical-modelcoupledwithop-tical ow[8],etc
Here,weproposeatrackingalgorithmbasedontemplatematchingtolocatethepositionsoftheeyeregionsinsubse-quentframes,coupledtoascalespaceapproach,namelythe
2.Trackingeyeregions
Apreviouslypublishedeyetrackingscheme[14][13],isusedforthetrackingofthelocationoftheleftandrighteyeregionsinimagesequences.Theproposedschemeisbasedontemplatematching,butiskeptinvariantfororien-tation,scaleandshapebyexploitingtemporalinformation.Tocopewithappearancechangesoftheeyefeature,acode-bookoficonicviewsisautomaticallyconstructedduringtheeyeregiontracking.Foreachframethepositionandorien-tationoftheleftandrighteyeregionareprovidedaswellasthenormalizedeyeregionsforthetemplatematching.Figure1showsthedetectedlefteyeregionforthe rst9framesoftheClairesequence.Theseimageswillbeusedtoillustrateouralgorithmforeyestate(gesture)estimation.
Eye Activity Detection a... 4页 免费 Morphological scale-spac... 221页... 3-D Object Recognition Using Morphological Scale-Space Fingerprints We ...
Eye Activity Detection a... 4页 免费 3-D Object Recognition U... ... Diatom Contour Analysis using Morphological Curvature Scale Spaces Michael H....
Informatica 33 (2009) 205–212 205 Fall Detection and Activity Recognition...Real-Time Recognition of Physical Activities and Their Intensities Using ...
Eye Activity Detection a... 4页 免费 Invariant... Morphological scale-spac... 暂无评价 12页 免费...using an invertible scaling, then apply an image...
morphological operations to segment out the required...using EN Our first proposed activity classifier is...Detection and Recognition of Events in Video, pp...
Eye Activity Detection a... 4页 免费 3-D Object Recognition U... ...Morphological shape recognition in AM/FM applications. In Image Algebra and ...
Soft Morphological Struc... 暂无评价 13页 免费 Eye Activity Detection a....The method is achieved within a general morphological analyser system using ...
Morphological influences... 暂无评价 55页 免费 Eye Activity Detection a... 4页 免费 3-D Object Recognition U... 暂无评价 5页 免费 EXPERIMENTS IN ...
热门文档