Our shot boundary detection system mainly consists of three components: fade out/in(FOI)detector, cut(CUT)detector and gradual transition(GT)detector. The key technique of FOI detector is the recognition of monochrome frame. In CUT detector, second order d
TsinghuaUniversityatTRECVID2004:
ShotBoundaryDetectionandHigh-levelFeatureExtraction
JinhuiYuan,WujieZheng,LeChen,DayongDing,DongWang,ZijianTong,HuiyiWang,JunWu
JianminLi,FuzongLin,BoZhang
StateKeyLaboratoryofIntelligentTechnologyandSystem
DepartmentofComputerScienceandTechnologyTsinghuaUniversity
Beijing100084,P.R.China
Abstract
Ourshotboundarydetectionsystemmainlyconsistsofthreecomponents:fadeout/in(FOI)detector,cut(CUT)detectorandgradualtransition(GT)detector.ThekeytechniqueofFOIdetectoristherecognitionofmonochromeframe.InCUTdetector,secondorderderivativemethodisappliedtogetcutcandidates,andthen ashlightdetectorandothergradualtransition ltermoduleareincorporatedtoeliminatefalsepositives.InGTdetector,shortGTandlongGTaretreatedseparately,morespeci cally,twincomparisonalgorithmforshortGTand nitestateautomaton(FSA)modelforlongGT.Tenrunsaresubmitted.Andtheevaluationresultshowsthatoursystemisamongthebest.Thecharacteristicsoftherunsaresummarizedasfollows.
thuai02Baselinesystemwithdefaultarchitectureanddefaultparametersettings.thuai05SecondorderderivativeschemeforshortGT.thuai07LooserconditionsforshortGTdetector.thuai08Withoutgradualtransition ltermodule.thuai10Prolongthedurationofpost-cutmodules,including ashlightdetectorandgradualtransitiondetector.thuai14BaselinesystemDerivedfromthuai10withhighercoef cientsformotionbasedself-adaptivethreshold.thuai15Evenhighercoef cientsformotionbasedself-adaptivethreshold.thuai16IncreasethehigherthresholdofFSAmodel.thuai17FurtherheightenthehigherthresholdofFSAmodel.thuai19ReplacethesecondorderderivativeofCUTdetectorwith rstorderderivative.
InFeatureExtractiontask,thevisualmodaldetectorformsourbaselinesystem.Andseveralkindsofotherdetectorsbasedontextandtimingcueareadded.Thesystemisappliedtothreeconcepts1,namely:“Basketscored”,“BillClinton”and“Beach”.For“Basketscored”,thevisualmodaldetectorachieves0.561inAP.Andtheaddedtextandtiminginfor-mationbrings20%increaseinAPandarrivesthebestrunforthatconcept.Thesubmittedrunsof“Basketscored”are:BthuaiBaselinesystem.AP-basedBordafusionofresultsgeneratedbydifferentvisualmodels.BthuaiBaseline+commercial lterBthuaiBaseline+commercial lter+SRIoperation.BthuaiBaseline+commercial lter+SRIoperation+shotclusteroperation.
1.Introduction
Thisyearweparticipateintwotasksofshotboundarydetection(SBD)andfeatureextraction(FE).
Variousautomaticshotboundarydetectionalgorithmshavebeenproposed(see[7],[11],[13]).Mostofthemseemtofailunderroughlythesameconditionssuchas ashlightorobject/cameramovement.Toboosttheperformance,wedesignandintegratespeci cmodulestoeliminatevariousdisturbance.Theevaluationshowsthatoursystemexhibitsexcellentperformance.
ComparedwiththetraditionalContentBasedImageRetrieval(CBIR),ContentBasedVideoRetrieval(CBVR)hasmuchmoreinformationfrommultiplemodalitiesandvariousinformationfusionmethodstodealwiththesemanticgapbetween
detection”and“featureextraction”areusedinterchangeablyinthispaper.Butasthelatterareoftenconfusedwiththefrequentlyused
“low-levelfeatureextraction”,theformerispreferred.
1“Concept
1
Tsinghua university at t... 13页 免费 TRECVID...2007 Shot Boundary Detection and Rushes ... low-level feature extraction and BBC rush ...
Tsinghua university at t... 13页 免费 High-... for High-Level Feature Detection at TRECVID 2007...contextual relationship and inter-shot temporal ...
Tsinghua university at t... 13页 免费 The ... TU DELFT at TRECVID 2005 Shot Boundary Detection...that is, the level of shot transition detection....
Tsinghua university at t... 13页 免费 1 ...2. HIGH-LEVEL FEATURE EXTRACTION In TRECVID 2006...2 SB detection & KF extraction Videos Low-level...
University of Sheffield ... 暂无评价 6页 免费 Tsinghua university at t.... Abstract Dokuz Eylül University Video Shot Boundary Detection at TRECVID ...
University of Central Florida at TRECVID_专业资料...TRECVID 2004: High-Level Feature Extraction and ...? Sports Shot Detection: Shots containing basket ...
cult search and feature detection tasks by ...The shot boundary task is included in TRECVID as...At Tsinghua University researchers reimplemented ...
Tsinghua university at t... 13页 免费 University of Central Fl... 暂无...For high-level feature extraction task, e.g.semantic concept detection which...
Zhejiang University at T... 10页 免费 TRECVID...TRECVID high-level semantic feature extraction task... confident face detection result within the shot....
热门文档