文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > AUTOMATIC VIDEO STRUCTURING BASED ON HMMS AND AUDIO VISUAL INTEGRATION
侵权投诉

AUTOMATIC VIDEO STRUCTURING BASED ON HMMS AND AUDIO VISUAL INTEGRATION

This paper focuses on the use of Hidden Markov Models (HMMs) for structure analysis of sport videos. The video structure parsing relies on the analysis of the temporal interleaving of video shots, with respect to a priori information about video content an

AUTOMATICVIDEOSTRUCTURINGBASEDONHMMSANDAUDIOVISUAL

INTEGRATION

P.Gros(1),E.Kijak(2)andG.Gravier(1)

(1)

(2)

IRISA–CNRSIRISA–Universit´edeRennes1

CampusUniversitairedeBeaulieu35042RennesCedex,France

{Patrick.Gros,Ewa.Kijak,Guillaume.Gravier}@irisa.fr

ABSTRACT

ThispaperfocusesontheuseofHiddenMarkovModels(HMMs)forstructureanalysisofsportvideos.Thevideostructureparsingreliesontheanalysisofthetemporalinter-leavingofvideoshots,withrespecttoaprioriinformationaboutvideocontentandeditingrules.Thebasictemporalunitisthevideoshotandbothaudioandvisualfeaturesareusedtocharacterizeitstypeofview.Ourapproachisvali-datedintheparticulardomainoftennisvideos.Asaresult,typicaltennisscenesareidenti ed.Inaddition,eachshotisassignedtoalevelinthehierarchydescribedintermsofpoint,gameandset.

1.INTRODUCTION

Videocontentanalysisisanactiveresearchdomainthataimsatautomaticallyextractinghigh-levelsemanticeventsfromvideo.Thissemanticinformationcanbeusedtopro-duceindexesortables-of-contentsthatenableef cientsearchandbrowsingofvideocontent.Low-levelvisualfeatures,largelyusedforindexinggenericvideocontents,arenotsuf cienttoprovideameaningfulinformationtoanend-user.Toachievesuchagoal,algorithmshavetobededi-catedtooneparticulartypeofvideos.

Onedomain-speci capplicationisthedetectionandre-cognitionofhighlightsinsportvideos.Sportvideoanalysisismotivatedbythegrowingamountofarchivedsportvideomaterial,andbythebroadcastersneedsofadetailedannota-tionofvideocontentstoselectrelevantexcerptstobeeditedforsummariesormagazines.Uptonow,thisloggingtaskisperformedmanuallybylibrarians.

Mostoftheexistingworksinthedomainofsportsvideoanalysisarerelatedtospeci ceventsdetection.Acom-monapproachineventdetectionconsistsincombiningtheextractionoflow-levelfeatureswithheuristicrulestoin-ferpredeterminedhighlights[1,2].RecentapproachesuseHiddenMarkovModels(HMMs)fortheeventclassi cationinsoccer[3]andbaseball[4].Nevertheless,theseworks

attempttodetectspeci cevents,butthereconstructionofhigher-leveltemporalstructureisnotaddressed.

Insidethecategoryofsportvideos,adistinctionshouldbemadebetweentime-constrainedsportssuchassoccer,andscore-constrainedsportssuchastennisorbaseball.Time-constrainedsportshavearelativelyloosestructure.Thegamecanbedecomposedintoequalperiods.Duringape-riod,thecontent owisquiteunpredictable.Asaresult,structureanalysisofasoccervideoisrestrictedto”play”/”out-of-play”segmentation[5].

Inscore-constrainedsports,thecontentpresentsastronghierarchicalstructure.Forexample,atennismatchcanbebrokendownintosets,gamesandpoints.Apreviousworkontennisandbaseball[6]studiesthedetectionofbasicunits,suchasserveintennisorpitchinbaseball,however,thewell-de nedstructureofthesesportsisnottakenintoaccounttorecoverthewholehierarchicalstructure.

Inthispaper,weaddresstheproblemofrecoveringsportvideostructure,throughtheexampleoftenniswhichpresentsastrongstructure.Videostructureparsingconsistsinex-tractinglogicalstoryunitsfromtheconsideredvideo.Thestructuretobeestimatedreliesonthenatureofthevideo.Forinstance,anewsvideocanbeconsideredasasequenceofunitswhichstartswithanimageframepresentingananchorpersonfollowedbyavarietyofnewsandcommer-cials[7].

Producingatableofcontentsimpliestoperformatem-poralsegmentationofthevideointoshots.Suchataskhasbeenwidelystudiedandgenerallyreliesonthedetectionofdiscontinuitiesintolow-levelvisualfeaturessuchascolorormotion[8].Thecriticalstepistoautomaticallygroupshotsinto”scenes”,or“storyunits”thatarede nedasacoherentgroupofshotsthatismeaningfulfortheend-user.Recenteffortshavebeenmadeonfusinginformationprovidedbydifferentstreams.Itseemsreasonabletothinkthatintegratingseveralmediaimprovetheperformanceoftheanalysis.Thisiscon rmedbysomeexistingworksre-portedin[9,10].Multimodalapproacheshavebeeninves-

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email