Abstract — In this survey, we present a brief analysis of some of the recent single camera object detection and tracking methods that are developed to function robustly under extreme conditions such as erratic object and camera motion, drastic illuminatio
1
AchievingReal-TimeObjectDetectionandTrackingUnderExtremeConditions
FatihPorikli
Abstract—Inthissurvey,wepresentabriefanalysisofsomeoftherecentsinglecameraobjectdetectionandtrackingmethodsthataredevelopedtofunctionrobustlyunderextremeconditionssuchaserraticobjectandcameramotion,drasticilluminationchanges,andseverenoisecontaminationwhileachievingareal-timeperformance.
I.INTRODUCTION
O
BJECTtrackingisonethemostimportanttasksincomputervision.Invideosurveillance,itisusedtounderstandmovementpatternsofpeopletouncoversuspiciousevents.Itisakeycomponentinreal-timetraf cmanagementtoestimatevehiclemotionstatisticsandcongestionstatus.Advancedvehiclecontrolsystemsdependonthetrackinginformationtokeepthevehicleinlaneandpreventfromcolli-sions.Inmedical eld,trackinghelpsimprovingthequalityoflifeforphysicaltherapypatientsanddisabledpeople.Inretailspaceinstrumentation,itisusedtoadvancearchitecturedesignbyanalyzingtheshoppingbehaviorofcustomers.Inaddition,itprovidescomprehensiblevisualinformationtoattainenvi-ronmentalawarenessinrobotics.Invideosummarization,itisappliedtogenerateobject-basedrepresentationsandautomaticannotationsofthecontent.Trackingisalsoafundamentaltechnologytoextractregionsofinterestandvideoobjectlayersde nedinJPEG-2000andMPEG-4standards.
Asessentialasitisinmanyapplications,robustobjecttrackingunderuncontrolledconditionsstillposesachallenge.Practicalsystemshavetotrackobjectswhenthelightingconditionchangessuddenly,therelativecamera-objectmotionbecomeslarge,thecolorcontrastbecomeslow,andtheimagenoisearisestoanintolerablelevel.Tomakeeverythingworse,thecomputationalcomplexityisrequiredtobekeptataminimumleveltoachievereal-timeperformance.
Intherestofthispaper,webrie ydescribejustafewofthestate-of-artmethodsdesignedtoaddressthesedif culties.
II.OBJECTDETECTION
Backgroundsubtractionisacommonapproachfordiscrim-inatingmovingregionsin xedcamerasetups.Basically,apixel-wisereferencemodelforthestationarypartofthesceneisestimated.Then,theobservedimageiscomparedwiththisreferencetoobtaintheforeground.
Simply,areferenceframecanbecomputedbyaggregatingthepreviousframesinamovingtemporalwindowbyα-blending.Althoughthisapproachhasaminimumcomputa-tionalcost,itinducesghosteffectsandrarelyworksinreal-lifecircumstanceswherethebackgroundisoftennonstationaryduetotheilluminationchanges,shadows,swayingtrees,etc.
Alternatively,predictivetechniquessuchasKalman[1]andWiener[2] ltersareappliedtolearntheunderlyingpixelintensitydistribution.Thesetechniquesstronglydependonthepresetstatetransitionparametersandfailincasethedistributiondoesnot tintoasinglemodelorvariesrandomly.Tohandlesuchmultimodalbackgrounds,mixtureofmodelsthatare exibleenoughtohandlevariationsinlighting,mov-ingsceneclutter,multiplemovingobjectsandotherarbitrarychangestotheobservedscene,areproposed.Inadditiontocolor,therearevariantsthataccommodategradientandoptical owinformation[3].Often,thesemodelsareassignedasGaussianfunctions.Onlineapproximationssuchasexpec-tationmaximization(EM)algorithmareusedtoupdatethemodels[4].However,onlineEMupdatetendstointermingleweakmodesintostrongermodes,thus,distortsthemodelmeansinthelongtermasshowninFig.5.Toadaptthemodelsaccurately,wedevelopedaBayesianupdatemechanism[5]thatcanalsoestimatethenumberofrequiredlayers.Anotherapproachthatmodelsthebackgrounddistributionisthenon-parametrickerneldensityestimation[6].Thismethodkeepsthecolorvaluesofthemultipleframesandestimatesthedensityfunctionusingalltheavailabledatainsteadofonlineapproximation.Proportionaltothenumberofframes,bothmemoryandcomputationalcostsbecomeprohibitivetoadaptthismethodforreal-timeapplications.Althoughthemixtureofmodelsapproachcanconvergetoanyarbitrarydistributionprovidedenoughnumberofcomponents,itscomputationalcomplexityboostsexponentiallyasthenumberofmodelsincreases.
Amajorshortcomingoftheabovemethodsisthattheyallneglectthetemporalcorrelationamongthecolorvalues.Thispreventsthemfromdetectingastructuredorperiodicchange,whichisoftenthecase,sincereal-worldphysicsofteninducesnear-periodicphenomenonintheenvironment:themotionofplantsdrivenbywind,theactionofwavesonabeach,andtheappearanceofrotatingobjects.Todistinguishsuchperiodicmotionfromtheobject’smotion,weproposedafrequencydecompositionbasedrepresentationofthebackground,wave-back[7].Thisalgorithmdetectsnewobjectsbasedsolelyonthedynamicsofthepixelsinasceneratherthantheirap-pearance.Thisisaccomplishedbydirectlyestimatingmodelsofcyclostationaryprocessestoexplaintheobserveddynamicsofthesceneandthencomparingnewobservationsagainstthosemodels.Foragivenframe,wecomputethefrequencycoef cientsandcomparethemtothebackgroundcoef cientstoobtainadistancemapasinFig.4.
Detectionofthetime-varyingphenomenonisalsoattemptedusingcorner-basedbackgroundmodels[8].First,theydetectfeaturepointsusingacornerdetectorandrepresentthem
Achieving Real-Time Obje... 4页 免费 OBJECT TRACKING BASED... 6页 ...ections, and bad environmental conditions. ? 1998 Society of Photo-Optical ...
system with real-time moving object detection, ... and under changing illumination conditions. ...object is a crucial step in achieving this goal...
Automatic Moving Object Detection and Tracking.pdf...Here, two conditions are set to speed up ...proposed a method for real-time tacking of non-...
Eye detection and tracking Robust real-time eye detection and tracking under variable lighting conditions and various face orientations Contents 1 2 3 ...
Real-Time Detection and Tracking of Vehicle Base... rotation and translation of an object in a ... with varying traffic and weather conditions. ...
Achieving Real-Time Obje... 4页 免费 A Real...real-time object recognition and tracking in video...cascades of boosted ensembles for face detection. ...
cally for visual tracking by associating object ...Achieving real-time performance remains beyond the ...Kanade. Detection and Tracking of Point Features....
real time. Key words: FPGA; embedded system; intelligent video surveillance;...Achieving realtime object detection and J〕 tracking under extreme conditions〔...
cally for visual tracking by associating object ...Achieving real-time performance remains beyond the ...Kanade. Detection and Tracking of Point Features....
Moving Object Detection and Tracking in Video Based on Higher Order Statistics and Kalman F_专业资料。In this paper, we present a new moving object ...
热门文档