文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > IT/计算机 > Extraction of visual features with eye tracking for saliency driven 2D3D registration
侵权投诉

Extraction of visual features with eye tracking for saliency driven 2D3D registration

Extraction of visual features with eye tracking for saliency driven 2D3D registration

ImageandVisionComputing23(2005)999–1008

doc.guandang.net

Extractionofvisualfeatureswitheyetrackingforsaliencydriven

2D/3Dregistration

AdrianJ.Chung*,FaniDeligianni,Xiao-PengHu,Guang-ZhongYang

RoyalSociety/WolfsonFoundationMedicalImageComputingLaboratory,DepartmentofComputing,ImperialCollege,

180Queen’sGate,SW72BZLondon,UK

Received30January2004;receivedinrevisedform19May2005;accepted1July2005

Abstract

Thispaperpresentsanewtechniqueforderivinginformationonvisualsaliencywithexperimentaleye-trackingdata.Thestrengthandpotentialpitfallsofthemethodaredemonstratedwithfeaturecorrespondencefor2Dto3Dimageregistration.Withthisapplication,aneye-trackingsystemisemployedtodeterminewhichfeaturesinendoscopyvideoimagesareconsideredtobesalientfromagroupofhumanobservers.Byusingthisinformation,abiologicallyinspiredsaliencymapisderivedbytransformingeachobservedvideoimageintoafeaturespacerepresentation.Featuresrelatedtovisualattentionaredeterminedbyusingafeaturenormalisationprocessbasedontherelativeabundanceofimagefeatureswithinthebackgroundimageandthosedwelledonvisualsearchscanpaths.Thesefeaturesarethenback-projectedtotheimagedomaintodeterminespatialareaofinterestforeachunseenendoscopyvideoimage.Thederivedsaliencymapisemployedtoprovideanimagesimilaritymeasurethatformstheheartofanew2D/3Dregistrationmethodwithmuchreducedrenderingoverheadbyonlyprocessing-selectiveregionsofinterestasdeterminedbythesaliencymap.Signi cantimprovementsinposeestimationef ciencyareachievedwithoutapparentreductioninregistrationaccuracywhencomparedtothatofusinganintensity-basedsimilaritymeasure.

q2005ElsevierB.V.Allrightsreserved.

Keywords:2D/3Dregistration;Saliency;Imagecorrelation;Eyetracking

1.Introduction

Newtechniquesforminimallyinvasivesurgery[1,2]havebroughtsigni cantbene tstopatientcare,includingreducedtrauma,shortenedhospitalisation,andimproveddiagnosticaccuracyandtherapeuticoutcome.Endoscopyisthemostcommonprocedureinminimalaccesssurgery,butrequiresahighdegreeofmanualdexterityfromtheoperatorowingtothecomplexityoftheinstrumentcontrols,restrictedvisionandlackoftactileperception.Trainingmethodsfortheseskillsinvolvetheuseofcomputersimulation,whichneedstobeasrealisticaspossibleforspecialisttrainingtobeeffective.Oneimportantfactoris

*Correspondingauthor.Tel.:C442075948318;fax:C442075818024.

E-mailaddress:a.chung@imperial.ac.uk(A.J.Chung).

0262-8856/$-seefrontmatterq2005ElsevierB.V.Allrightsreserved.doi:10.1016/j.imavis.2005.07.003

thelevelofvisualrealismpresentedtothetrainee,whichismadepossiblebyrecentadvancesinimage-basedmodellingandrendering[3].Genuinesurfacetextureinformationcanbeextractedfrommatchedrealendoscopicvideoswithgeometryderivedfromtomographicimagesofthesamepatient.Thisprocessreliesontheaccurateregistrationof2Dvideoimagesto3Dtomographicdatasets.Themethodof2D/3Dregistrationisamuchresearchedtopic,andmanyapplicationsarisenarefrommedicalimagingandsurgicalplanningapplications[4–10].

Ingeneral,methodsofmedicalimageregistrationcanbeclassi edintolandmark,segmentation,andvoxel-basedtechniques[11,12].Voxel-basedtechniques[13]haveshowntobeeffectivefortheregistrationofbothunimodalormultimodalimagesdependingonthesimilaritymeasuresandoptimisationstrategyused.Oneofthetypical2D/3Dregistrationproblemsaddressedistheregistrationof uoroscopeimagesagainst3DCTorMRIdatasets,forwhichavoxelsimilaritymeasureistypicallyused.Registering2Dbronchoscopyvideoto3D

Extraction of visual features with eye tracking for saliency driven 2D3D registration

Extraction of visual features with eye tracking for saliency driven 2D3D registration

Extraction of visual features with eye tracking for saliency driven 2D3D registration

tomographic

第1页

你可能喜欢

热门文档

相关文档

  • ...for visual saliency estimation 2013 (2)

    erfromtheeye-trackingdatasettolearndifferentfeatures’parameters forsaliencymapconstruction.Fig.1(d)showsthatitachievesbetterresultsthantheinformation-drivenmethod[14...

  • ...for visual saliency estimation 2013 (2)

    erfromtheeye-trackingdatasettolearndifferentfeatures’parameters forsaliencymapconstruction.Fig.1(d)showsthatitachievesbetterresultsthantheinformation-drivenmethod[14...

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email