多通道分割
Multi-channelSegmentalHiddenMarkovModelsfor
SportsVideoMining
SchoolofElectricalandComputerEngineeringOklahomaStateUniversity,Stillwater,OK74078
YiDingandGuoliangFan
{yi.ding,guoliang.fan}@okstate.edu
ABSTRACT
Wepresentanewmulti-channelsegmentalhiddenMarkovmodel(MCSHMM)forsportsvideominingthatisauniqueprobabilisticgraphicalmodelwithtwoadvantages.Oneistheintegrationofbothhierarchicalandparallelstructuresthato ermore exibilityandcapacityofcapturingthein-teractionbetweenmultipleMarkovchains.TheotheristheincorporationofthesegmentalHMMthatrepresentsavariable-lengthsequenceofobservations.Especially,wede-velopamaximumaposteriori(MAP)estimatortooptimizemodelstructuresandmodelparameterssimultaneously.TheproposedMCSHMMisusedforAmericanfootballvideoanalysis,wheretwosemanticsstructures,playtypesandcameraviews,areinvolved.TheexperimentshowsthattheMCSHMMoutperformspreviousHMM-basedapproaches.
(whathappened?)andcameraviews(whereithappened?).Speci cally,weareinterestedindevelopingpowerfulgenera-tivemodelsthatareabletocapturetheinteractionbetweenmultiplesemanticstructuresandimprovetheoverallper-formance.Hereweproposeanewmulti-channelsegmentalhiddenMarkovmodel(MCSHMM)thatisinspiredbyrecentprogressongraphicalmodeltheory.Asacasestudy,wetestthenewMCSHMMforAmericanfootballvideoanalysis.
1.2Relatedworks
Therearetwomajormethodsinvideominingresearch[8].Oneisthediscriminativeapproaches,e.g.,[9],andtheotheristhegenerativeapproaches,e.g.,[11].Agenerativeap-proachisusuallypreferredwhenvideominingisperformedonalargedatasetduetoitsbettergenerality.TheDynamicBayesNetwork(DBN)[10]providesauni edprobabilisticframeworktorepresentvariousgenerativemodelswithdif-ferentgraphicalstructures.Recently,severalspeci cDBNs,i.e.,theFactorialHMM[7],theCoupledHMM(CHMM)[1],andthein uencemodel[14],wereproposedtoexplorecom-plexsemanticstructuresunderlyingmultipledataorfeaturestreams.Additionally,itisimperativetohavesimultaneousstructurelearningandparameterlearningforcomplexDBNstoensuretheire ectivenessande ciencyinpractice.In[2],theconceptsofentropicpriorandparameterextinctionwereproposedtosimplifyandoptimizethemodelstructurebyastatetrimmingprocess.In[13],thehierarchicalHMMs(HHMMs)wereusedforunsupervisedsportsvideomining,wherethereverse-jumpMarkovChainMonteCarlo(RJM-CMC)methodisembeddedinthelearningofHHMMstosupportmodelselectionandfeatureselection.
CategoriesandSubjectDescriptors
I.4.8[ImageProcessingandComputerVision]:SceneAnalysis
GeneralTerms
Algorithms
Keywords
sportsvideomining,entropicprior,hiddenMarkovmodels
1.INTRODUCTION
1.1Motivation
Videominingistodiscoverknowledge,patternsandevents,orcalledsemanticstructures,inthevideodata,anditsben-e tsrangefrome cientsummarizingofvideocontentofinteresttofacilitatingvideoaccessandretrievalinlargedatabases.Inthiswork,westudysportsvideominingwhererelativelyde nitesemanticstructuresexistandthathastremendouscommercialvalue.However,multipleseman-ticstructurescouldconcurinasportsvideo,e.g.,playtypes
1.3Ourworkandcontribution
Thisworkisbuiltonourpreviousresearch[3,5,4],wheretwosemanticstructureswereconsideredindependently,i.e.,playtypesandcameraviews.WeimprovedexistingHMMsbydevelopingmoree ectiveobservationmodelstocapturerichstatisticsofavariable-lengthsequenceofobservations.Thisworkisaimedathowtoexploretheinteractionbe-tweentwoMarkovchains(i.e.,semanticstructures).Therearetwocontributions.Oneistheintegrationofbothhier-archicalandparallelstructuresandtheincorporationofasegmentalobservationmodel.Theotheristheapplicationofentropicpriorandparameterextinctioninthemodeltrain-ingtooptimizethemodelstructureandmodelparameterssimultaneously.TheMCSHMMo ersmore exibility,func-tionality,andcapacitycomparedwithexistingHMMs,andholdsgreatpotentialforothervideominingapplications.
Permissiontomakedigitalorhardcopiesofallorpartofthisworkforpersonalorclassroomuseisgrantedwithoutfeeprovidedthatcopiesarenotmadeordistributedforpro torcommercialadvantageandthatcopiesbearthisnoticeandthefullcitationonthe rstpage.Tocopyotherwise,torepublish,topostonserversortoredistributetolists,requirespriorspeci cpermissionand/orafee.
MM’08,October26–31,2008,Vancouver,BritishColumbia,Canada.Copyright2008ACM978-1-60558-303-7/08/10...$5.00.
The theory of segmental ... 暂无评价 33页 免费 Multi-channel Segmental ... 6页 免费 Hidden Markov models for... 暂无评价 7页 1财富值喜欢此文档的...
Hidden Markov models for... 暂无评价 23页 免费 Segmental Hidden Markov ... 暂无评价 8页 免费 Multimedia Communication... 暂无评价 24页 免费 ...
In this Article, a novel monitoring method that combines dynamic multiway principal component analysis (DMPCA) and hidden segmental semi-Markov models (HSMM...
Hidden Markov Models A Hidden Markov Model consists of 1. A sequence of ...The Segmental K-means Algorithm 2. The Baum-Welch (E-M) Algorithm In ...
Hidden Markov Models for Information Extraction Probabilistic Logic Learning Seminar - WS03/04 Supervisor : Prof. Dr. Luc De Raedt Dipl. Inf. Kristian ...
Motivates hidden Markov models (HMM): hidden ...Initial state distribution: Gilbert-Elliott Channel ...Multi-user communication networks Hierarchical ...
Hidden Markov Models I... 1人阅读 13页 2.00 Subspace Distribution ... 3人阅读 4页 2.00 Data-Driven Temporal F... 1人阅读 6页 2...
Motif-based Hidden Markov Models for Multiple Sequence Alignment William N. Grundy ? Charles P. Elkan Dept. of Computer Science & Engineering University ...
龙星计划机器学习 Lecture13 Structured Models Hidden Markov Models versus ...NLP example: In a sentence segmentation task, each segmental state may ...
An Introduction to Hidden Markov Models L. R. Rabiner B. H. juang The basic theory of Markov chains has been known to mathematicians and engineers ...
热门文档