SaliencyDetection:ASpectralResidualApproach
XiaodiHouandLiqingZhang
DepartmentofComputerScience,ShanghaiJiaoTongUniversity
No.800,DongchuanRoad,Shanghai
doc.guandang.net houxiaodi,zhang-lq@cs.sjtu.edu.cn
Abstract
Theabilityofhumanvisualsystemtodetectvisualsaliencyisextraordinarilyfastandreliable.However,com-putationalmodelingofthisbasicintelligentbehaviorstillremainsachallenge.Thispaperpresentsasimplemethodforthevisualsaliencydetection.
Ourmodelisindependentoffeatures,categories,orotherformsofpriorknowledgeoftheobjects.Byanalyz-ingthelog-spectrumofaninputimage,weextractthespec-tralresidualofanimageinspectraldomain,andproposeafastmethodtoconstructthecorrespondingsaliencymapinspatialdomain.
Wetestthismodelonbothnaturalpicturesandarti cialimagessuchaspsychologicalpatterns.Theresultindicatefastandrobustsaliencydetectionofourmethod.
1.Introduction
The rststeptowardsobjectrecognitionisobjectdetec-tion.Objectdetectionaimsatextractinganobjectfromitsbackgroundbeforerecognition.Butbeforeperform-ingrecognitivefeatureanalysis,howcanamachinevisionsystemextractthesalientregionsfromanunknownback-ground?
Traditionalmodels,byrelatingparticularfeatureswithtargets,actuallyconvertthisproblemtothedetectionofspeci ccategoriesofobjects[3].Sincethesemodelsarebasedontraining,theexpansibilitybecomethebottleneckingeneralizedtasks.Facingunpredictableandinnumerablecategoriesofvisualpatterns,ageneralpurposesaliencyde-tectionsystemisrequired.Inotherwords,thesaliencyde-tectorshouldbeimplementedwiththeleastreferenceonstatisticalknowledgeoftheobjects.
Howisthesaliencydetectionprocessachievedinhu-manvisualsystem?Itisbelievedthattwostagesofvisualprocessingareinvolved: rst,theparallel,fast,butsimplepre-attentiveprocess;andthen,theserial,slow,butcom-plexattentionprocess.Propertiesofpre-attentiveprocess-inghavebeendiscussedinliterature[27,24].Inthisstage,
1-4244-1180-7/07/$25.00 ©2007 IEEE
certainlowlevelfeaturessuchasorientation,edges,orin-tensitiescan“popup”automatically.Fromaviewpointofobjectdetection,whatpopsupinthepre-attentivestageisthecandidateofanobject.Inordertoaddressacandidatethathasbeendetectedbutnotyetidenti edasanobject,Rensinkintroducedthenotionofprotoobjectsinhiscoher-encetheory[15,13,14].
To ndthe“protoobjects”inagivenimage,modelshadbeeninventedinthe eldofmachinevision.BasedonTreisman’sintegrationtheory[24],IttiandKochpro-posedasaliencymodelthatsimulatesthevisualsearchpro-cessofhuman[8,6,7].Morerecently,Waltherextendedthesaliencymodel,andsuccessfullyappliedittoobjectrecognitiontasks[26].However,asapre-processingsys-tem,thesemodelsarecomputationallydemanding.
Mostofthedetectionmodelsfocusonsummarizingthepropertiesoftargetobjects.However,generalpropertiessharedbyvariouscategoriesofobjectsarenotlikelytoex-ist.Inthispaper,weposethisprobleminanalternativeway:toexplorethepropertiesofthebackgrounds.
InSection2,thespectralresidualisintroduced.Startingfromtheprincipleofnaturalimagestatistics,weproposeafront-endmethodtosimulatethebehaviorofpre-attentivevisualsearch.Differentfromtraditionalimagestatisticalmodels,weanalyzethelogspectrumofeachimageandobtainthespectralresidual.Thenwetransformthespec-tralresidualtospatialdomaintoobtainthesaliencymap,whichsuggeststhepositionsofproto-objects.InSection3,wealsodemonstratemultipleobjectdetectionbasedonthespectralresidualapproach.
Toevaluatetheperformanceofourmethod,inSection4.1,wecompareourmethodwith[8]andhuman-labeledresults.Theresultindicatesthatourmethodisafastandreliablecomputationalmodelformearlystagevisualpro-cessing.
2.SpectralResidualModel
Ef cientcodingisageneralframeworkunderwhichmanymechanismsofourvisualprocessingcanbeinter-preted.Barlow[1] rstproposedtheef cientcodinghy-
Spatio-temporal saliency detection using phase spectrum of_工学_高等教育_...Zhang. Saliency Detection: A Spectral Residual Approach. Proc. CVPR, 2007....
Spectral Target-Detect... 11人阅读 7页 2.00 Should we consider a ... Approach based on wave... 2人阅读 5页 2.00 The US Response to ...
Saliency Detection: A Spectral Residual Approach_2007_CVPR_SR 51 清华大学电子工程系 智能图文信息处理研究室 Cerner for Intelligent Image and Document ...
Ice-Induced Fatigue Analysis by Spectral Approach for Offshore Jacket Platforms with Ice-Breaki_专业资料。维普资讯 http://www.cqvip.com CiaOenEgneig,V12,...
( 11) : 1254 - 1259. 〔5 〕 XIAODI HOU,LIQING ZHANG. Saliency detection: a spectral residual approach〔C〕. Proceedings of 2007 IEEE Conference on ...
(Spectralresidual approach, SR) – 将前两种进行...SR模型 ? SR(Spectral Residual)模型是由Hou等人...SDSR(Saliency Detection by SelfResemblance)模型由Seo...
Soft Comput DOI 10.1007/s00500-013-1064-0 METHODOLOGIES AND APPLICATION A study in facial regions saliency: a fuzzy measure approach Pawe? Karczmarek ? ...
2014-CVPR-Saliency(Adaptive Partial Differential Equation Learning for Visual ...Saliency detection: A spectral residual approach. In CVPR, 2007. 6 [15] ...
2011_CVPR_ljduan_Visual Saliency Detection by Spatially Weighted Dissimilarity...Zhang. Saliency detection: A spectral residual approach. CVPR, 2007. [16]...
基于空间信息增量的区域对比度RC 特点 特点 速度快 细节精确 产生高质量显著性图像 计算效率较低 38 Saliency Detection: A Spectral Residual Approach 显著性检测:...
热门文档