This paper focuses on the use of Hidden Markov Models (HMMs) for structure analysis of sport videos. The video structure parsing relies on the analysis of the temporal interleaving of video shots, with respect to a priori information about video content an
AUTOMATICVIDEOSTRUCTURINGBASEDONHMMSANDAUDIOVISUAL
INTEGRATION
P.Gros(1),E.Kijak(2)andG.Gravier(1)
(1)
(2)
IRISA–CNRSIRISA–Universit´edeRennes1
CampusUniversitairedeBeaulieu35042RennesCedex,France
{Patrick.Gros,Ewa.Kijak,Guillaume.Gravier}@irisa.fr
ABSTRACT
ThispaperfocusesontheuseofHiddenMarkovModels(HMMs)forstructureanalysisofsportvideos.Thevideostructureparsingreliesontheanalysisofthetemporalinter-leavingofvideoshots,withrespecttoaprioriinformationaboutvideocontentandeditingrules.Thebasictemporalunitisthevideoshotandbothaudioandvisualfeaturesareusedtocharacterizeitstypeofview.Ourapproachisvali-datedintheparticulardomainoftennisvideos.Asaresult,typicaltennisscenesareidenti ed.Inaddition,eachshotisassignedtoalevelinthehierarchydescribedintermsofpoint,gameandset.
1.INTRODUCTION
Videocontentanalysisisanactiveresearchdomainthataimsatautomaticallyextractinghigh-levelsemanticeventsfromvideo.Thissemanticinformationcanbeusedtopro-duceindexesortables-of-contentsthatenableef cientsearchandbrowsingofvideocontent.Low-levelvisualfeatures,largelyusedforindexinggenericvideocontents,arenotsuf cienttoprovideameaningfulinformationtoanend-user.Toachievesuchagoal,algorithmshavetobededi-catedtooneparticulartypeofvideos.
Onedomain-speci capplicationisthedetectionandre-cognitionofhighlightsinsportvideos.Sportvideoanalysisismotivatedbythegrowingamountofarchivedsportvideomaterial,andbythebroadcastersneedsofadetailedannota-tionofvideocontentstoselectrelevantexcerptstobeeditedforsummariesormagazines.Uptonow,thisloggingtaskisperformedmanuallybylibrarians.
Mostoftheexistingworksinthedomainofsportsvideoanalysisarerelatedtospeci ceventsdetection.Acom-monapproachineventdetectionconsistsincombiningtheextractionoflow-levelfeatureswithheuristicrulestoin-ferpredeterminedhighlights[1,2].RecentapproachesuseHiddenMarkovModels(HMMs)fortheeventclassi cationinsoccer[3]andbaseball[4].Nevertheless,theseworks
attempttodetectspeci cevents,butthereconstructionofhigher-leveltemporalstructureisnotaddressed.
Insidethecategoryofsportvideos,adistinctionshouldbemadebetweentime-constrainedsportssuchassoccer,andscore-constrainedsportssuchastennisorbaseball.Time-constrainedsportshavearelativelyloosestructure.Thegamecanbedecomposedintoequalperiods.Duringape-riod,thecontent owisquiteunpredictable.Asaresult,structureanalysisofasoccervideoisrestrictedto”play”/”out-of-play”segmentation[5].
Inscore-constrainedsports,thecontentpresentsastronghierarchicalstructure.Forexample,atennismatchcanbebrokendownintosets,gamesandpoints.Apreviousworkontennisandbaseball[6]studiesthedetectionofbasicunits,suchasserveintennisorpitchinbaseball,however,thewell-de nedstructureofthesesportsisnottakenintoaccounttorecoverthewholehierarchicalstructure.
Inthispaper,weaddresstheproblemofrecoveringsportvideostructure,throughtheexampleoftenniswhichpresentsastrongstructure.Videostructureparsingconsistsinex-tractinglogicalstoryunitsfromtheconsideredvideo.Thestructuretobeestimatedreliesonthenatureofthevideo.Forinstance,anewsvideocanbeconsideredasasequenceofunitswhichstartswithanimageframepresentingananchorpersonfollowedbyavarietyofnewsandcommer-cials[7].
Producingatableofcontentsimpliestoperformatem-poralsegmentationofthevideointoshots.Suchataskhasbeenwidelystudiedandgenerallyreliesonthedetectionofdiscontinuitiesintolow-levelvisualfeaturessuchascolorormotion[8].Thecriticalstepistoautomaticallygroupshotsinto”scenes”,or“storyunits”thatarede nedasacoherentgroupofshotsthatismeaningfulfortheend-user.Recenteffortshavebeenmadeonfusinginformationprovidedbydifferentstreams.Itseemsreasonabletothinkthatintegratingseveralmediaimprovetheperformanceoftheanalysis.Thisiscon rmedbysomeexistingworksre-portedin[9,10].Multimodalapproacheshavebeeninves-
AUTOMATIC VIDEO STRUC... 6页 免费 ROBUST AUDIOVISUAL IN... 暂无评价 4... Audiovisual integration for tennis broadcast structuring This paper focuses on...
Structuring of video using Bayesian Networks alone ...visual and audio event detection in order to ... we point out advantages of the integration of ...
Video Based Motion Synth... 暂无评价 18页 ...It performs late integration and reduces the ... and audio-visual automatic speech recognition (AV...
Multimodal integration for meeting group action ... with the goal of structuring them in semantic ...Automatic modelling of human interactions from low-...
Multimodal integration for meeting group action ... with the goal of structuring them in semantic ...Automatic modelling of human interactions from low-...
热门文档