多通道分割
2.PREVIOUSRESEARCH3.THEPROPOSEDMCSHMM
Thisresearchfocusesonexploringtheinteractionbetweenmultiplesemanticstructureswiththeaimtoimprovetheoverallminingperformance.Speci cally,itwasobservedthatcameraviewsandplaytypesarequiterelatedtoeachotherduringagame.Forexample,afterashotofthecentralviewaccompaniedbyashortplay,thecameraviewinthenextshotislikelytoremaininthesameview.ItistemptingtoinvoketheCoupledHMM(CHMM)proposedin[1]forourproblem.However,theCHMMusuallyassumesstronginteractionbetweentwoMarkovchainsthatmayoverweightorevencorrupttheMarkovianpropertywithineachchainiftheassumptionisnottrue,asobservedinourpractice.Therefore,weadvanceamulti-channelSHMMmodel(MC-SHMM)thatinvolvestwoparallelSHMMsandatwo-layerhierarchicalMarkovianstructure,asshowninFig.3.

Sportvideosnormallyhavetwofundamentalsemanticstructuresregarding“what”and“where”.OrinthecaseofAmericanfootballvideos,theyarecalled“playtypes”and“cameraviews”[4,5],whichcouldbeusedasbuildingblockstodeliverhigherlevelsemantics.Eachsematicstructurein-volvesmultiplesemanticeventsthatareassumedtofollowa rst-orderMarkovchainovertime,asshowninFig.1.


Thetwosemanticfootballvideos,cameraviews(left)andplaytypes(right).
2.1ProblemFormulation
GivenavideosequencehasbeenpartitionedintoTshots
ofvariable-length,eachofwhichcorrespondstoaspeci cplayandacameraview,thevideominingtaskherecanbeformulatedastheinferenceproblemofagenerativemodelwherethelatentstateindicatesthesemanticeventofashot,andtheobservationmodelcharacterizesvisualfeaturesex-tractedfromallframesinashotwithrespecttodi erentse-manticevents.Thefeaturesusedforviewanalysisincludesthecolordistributionandtheangleofyardlines[4],andthatofplayanalysisinvolvesmotionvectorsextractedbyane -cientoptical owtechnique[12].How

tocapturerichstatis-ticsofframe-wiseobservationstosupportshot-wisestatesisakeyissueforourpreviousresearch.Atwo-layergen-erativemodelwasproposedin[5]thatde nesstatesonaGaussianmixturemodel(GMM)(notontheobservation),andinvolvesanembeddedHMM-GMMstructure.
Figure3:IntheMCSHMM,the rstlayerincludestwo
SHMMs,andthesecondlayercapturestheinteraction
(j,i)
oftwochannelsatthe rstlayer.Oji={O1:τi}representsallframe-wiseobservationsofshotiinchannelj∈{1,2}.
3.1ModelParameters
TheuniquefeatureoftheMCSHMMistheintegrationofbothparallelandhierarchicalstructuresonlatentstatesandtheincorporationofasegmentalobservationmodel,whichallowtheMCSHMMhavemore exibility,capacity,andfunctionalitythantheCHMM,SHMMandHHMM.Intheviewofgenerativemodels,boththedynamicmodel(amonghiddenstates)andtheobservationmodelintheMCSHMMhaveatwo-layeredstructurethatgreatlyen-hanceitscapabilityoflearningandinference.Speci cally,
j
atthe rst-layer,S={Si|i=1,...,T;j=1,2}denotes
j
thestatesequenceoftwochannelswhereSidenotesthe
(j,i)j
stateofshotiinchannelj,andOi={O1:τi|j∈(1,2)}indicatesobservationsofshotiwithτiframesinchannel
12
j.F={Fi=(Si,Si)|i=1,...,T}representsthestatese-quenceatthesecondlayerwhereeachstateconsistsoftwostatesatthelowerlayer.Therefore,theMCSHMM’sparam-etersetΘincludesfollowingcomponentsΘ={Π,A, }: Initialprobabilities:
1212
Π={P(S1),P(S1),P(F1|S1,S1)};
aretheobservationsofshotiwithτiframes.
iFigure2:ThesegmentalHMM(SHMM)whereOj=1:τi
2.2SegmentalHiddenMarkovModels
TheSHMMwasoriginallyproposedforspeechsignalpro-cessing[6]thatinvolvesasegmentalmodeltorepresenta
variable-lengthsequenceofobservations,asshowninFig.2.IntheSHMM,eachstateemitsasequenceofobservationsthatiscalledasegment.Ineachsegment,allobservationareconditionallyindependentgiventhemeanofthesegment,leadingtoaclosed-formlikelihoodfunctionfortheobserva-tionmodel.In[4],theSHMMwasshowne ectiveonview-basedvideomingcomparedwiththetraditionalHMMsandtheembeddedHMM-GMMin[5].HencetheSHMMwillserveasthebuildingblockforourproposedmodel.
(1)
Transitionprobabilities:
A={Aw,w=1,2,3},
where
A1A2A3
11
={P(Si=m|Si 1=n,Fi 1=l)},22={P(Si=m|Si 1=n,Fi 1=l)},12={P(Fi=l|Si=m,Si=n)};
(2)
The theory of segmental ... 暂无评价 33页 免费 Multi-channel Segmental ... 6页 免费 Hidden Markov models for... 暂无评价 7页 1财富值喜欢此文档的...
Hidden Markov models for... 暂无评价 23页 免费 Segmental Hidden Markov ... 暂无评价 8页 免费 Multimedia Communication... 暂无评价 24页 免费 ...
In this Article, a novel monitoring method that combines dynamic multiway principal component analysis (DMPCA) and hidden segmental semi-Markov models (HSMM...
Hidden Markov Models A Hidden Markov Model consists of 1. A sequence of ...The Segmental K-means Algorithm 2. The Baum-Welch (E-M) Algorithm In ...
Hidden Markov Models for Information Extraction Probabilistic Logic Learning Seminar - WS03/04 Supervisor : Prof. Dr. Luc De Raedt Dipl. Inf. Kristian ...
Motivates hidden Markov models (HMM): hidden ...Initial state distribution: Gilbert-Elliott Channel ...Multi-user communication networks Hierarchical ...
Hidden Markov Models I... 1人阅读 13页 2.00 Subspace Distribution ... 3人阅读 4页 2.00 Data-Driven Temporal F... 1人阅读 6页 2...
Motif-based Hidden Markov Models for Multiple Sequence Alignment William N. Grundy ? Charles P. Elkan Dept. of Computer Science & Engineering University ...
龙星计划机器学习 Lecture13 Structured Models Hidden Markov Models versus ...NLP example: In a sentence segmentation task, each segmental state may ...
An Introduction to Hidden Markov Models L. R. Rabiner B. H. juang The basic theory of Markov chains has been known to mathematicians and engineers ...
热门文档