2009 SIGIR Best Paper: Sources of evidence for vertical selection
SourcesofEvidenceforVerticalSelection
LanguageTechnologies
Institute
CarnegieMellonUniversity
5000ForbesAve.Pittsburgh,PA,USA
JaimeArguello
Yahoo!LabsMontréal1000RuedelaGauchetière
Suite2400
Montréal,QCH3M4W5
FernandoDíaz
jaime@cs.cmu.edu
díazf@yahoo-inc.com
LanguageTechnologies
Institute
CarnegieMellonUniversity
5000ForbesAve.Pittsburgh,PA,USA
JamieCallan
callan@cs.cmu.edu
jfcrespo@yahoo-inc.com
ABSTRACT
Websearchprovidersoftenincludesearchservicesfordomain-speci csubcollections,calledverticals,suchasnews,images,videos,jobpostings,companysummaries,andartistpro- les.Weaddresstheproblemofverticalselection,predict-ingrelevantverticals(ifany)forqueriesissuedtothesearchengine’smainwebsearchpage.Incontrasttopriorqueryclassi cationandresourceselectiontasks,verticalselectionisassociatedwithuniqueresourcesthatcaninformtheclas-si cationdecision.Wefocusonthreesourcesofevidence:(1)thequerystring,fromwhichfeaturesarederivedinde-pendentofexternalresources,(2)logsofqueriespreviouslyissueddirectlytothevertical,and(3)corporarepresenta-tiveofverticalcontent.Wefocuson18di erentverticals,whichdi erintermsofsemantics,mediatype,size,andlevelofquerytra c.Wecompareourmethodtopriorworkinfederatedsearchandretrievale ectivenessprediction.Anin-deptherroranalysisrevealsuniquechallengesacrossdif-ferentverticalsandprovidesinsightintoverticalselectionforfuturework.
Yahoo!LabsMontréal1000RuedelaGauchetière
Suite2400
Montréal,QCH3M4W5
Jean-FrançoisCrespo
Keywords
verticalselection,distributedinformationretrieval,resourceselection,aggregatedsearch,queryclassi cation
1.INTRODUCTION
CategoriesandSubjectDescriptors
H.3.3[InformationSearchandRetrieval]:Miscella-neous
GeneralTerms
Algorithms
workdonewhileatYahoo!LabsMontr´eal
Permissiontomakedigitalorhardcopiesofallorpartofthisworkforpersonalorclassroomuseisgrantedwithoutfeeprovidedthatcopiesarenotmadeordistributedforpro torcommercialadvantageandthatcopiesbearthisnoticeandthefullcitationonthe rstpage.Tocopyotherwise,torepublish,topostonserversortoredistributetolists,requirespriorspeci cpermissionand/orafee.
SIGIR’09,July19–23,2009,Boston,Massachusetts,USA.Copyright2009ACM978-1-60558-483-6/09/07...$5.00.
Inrecentyears,majorsearchengineshaveextendedtheirservicestoincludesearchonspecializedsubcollectionsorverticalsfocusedonspeci cdomains(e.g.,news,travel,andlocalsearch)ormediatypes(e.g.,imagesandvideo).Therearecurrentlytwowaysthroughwhichausercanaccessverti-calcontent.Iftheusersuspectsthatrelevantcontentexistsinavertical,shemayissuethequerydirectlytoaverticalsearchengine.Ontheotherhand,iftheuserisunawareofarelevantverticalorprefersaportalinterface,shemayissuethequerydirectlytoaportalsearchengine.Toad-dressthis,searchenginescanincludesummariesofrelevantverticalresultsinwebresults,asshowninFigure1.Intheresearchcommunity,thisisreferredtoasaggregatedsearchandhasbeenimplementedbymanymajorsearchengines[12].
Verticalselectionisthetaskofselectingtherelevantverti-cals,ifany,inresponsetoauser’squery.Wefocusonsingleverticalselection,de nedasthetaskofpredictingasinglerelevantvertical,ifany.Figure1exempli esacommonac-tionassociatedwithsingleverticalselection—embeddingashortsummaryoftherelevantvertical’sresultsabovethe rstwebresult.Weareconservativeinpredictingatmostasinglevertical,assomequerieshavemultiplerelevantver-ticals.However,aswewillseelater,mostqueriesinourevaluationsetwereassignedzerooronerelevantverticalbyhumanannotators.
Verticalselectionisrelatedtothetaskofresourceselec-tioninfederatedsearchordistributedinformationretrieval.Resourceselectionisthetaskofdecidingwhichcollectionstosearchgivenauser’squery[4].Similartoresourcese-lection,verticalselectioncanbeinformedbythecontentofeachvertical.However,verticalselectionhasafewdistin-guishingproperties.First,verticalsspecializeonidenti abledomainsandtypesofmedia.Thisenablesuserstopossi-blyexpressinterestinverticalcontentexplicitly,usingkey-
2009 SIGIR Best Paper So... 8页 免费 09. The endowment effect... 9页 2财富值 Evidence of a Change in ... 暂无评价 10页 免费 Chapter 11-...
Vertical data migration ... 暂无评价 10页 免费 2009 SIGIR Best Paper So... Seismic Evidence of Vertical Fluid Migration Through Faults, Applications of ...
Vertical data migration ... 暂无评价 10页 免费 2009 SIGIR Best Paper So... Seismic Evidence of Vertical Fluid Migration Through Faults, Applications of ...
热门文档