文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > 人文社科 > 教育学/心理学 > A study of Poisson query generation model for information retrieval
侵权投诉

A study of Poisson query generation model for information retrieval

AStudyofPoissonQueryGenerationModelfor

InformationRetrieval

QiaozhuMei,HuiFang,ChengxiangZhai

DepartmentofComputerScienceUniversityofIllinoisatUrbana-Champaign

Urbana,IL61801

{qmei2,hfang,czhai}@uiuc.edu

ABSTRACT

Manyvariantsoflanguagemodelshavebeenproposedforinformationretrieval.Mostexistingmodelsarebasedonmultinomialdistributionandwouldscoredocumentsbasedonquerylikelihoodcomputedbasedonaquerygenerationprobabilisticmodel.Inthispaper,weproposeandstudyanewfamilyofquerygenerationmodelsbasedonPoissondis-tribution.Weshowthatwhileintheirsimplestforms,thenewfamilyofmodelsandtheexistingmultinomialmodelsareequivalent,theybehavedi erentlyformanysmoothingmethods.WeshowthatthePoissonmodelhasseveralad-vantagesoverthemultinomialmodel,includingnaturallyac-commodatingper-termsmoothingandallowingformoreac-curatebackgroundmodeling.Wepresentseveralvariantsofthenewmodelcorrespondingtodi erentsmoothingmeth-ods,andevaluatethemonfourrepresentativeTRECtestcollections.Theresultsshowthatwhiletheirbasicmod-elsperformcomparably,thePoissonmodelcanoutperformmultinomialmodelwithper-termsmoothing.Theperfor-mancecanbefurtherimprovedwithtwo-stagesmoothing.CategoriesandSubjectDescriptors:H.3.3[Informa-tionSearchandRetrieval]:RetrievalModelsGeneralTerms:Algorithms

Keywords:Languagemodels,Poissonprocess,querygen-eration,formalmodels,termdependentsmoothing

1.INTRODUCTION

Asanewtypeofprobabilisticretrievalmodels,languagemodelshavebeenshowntobee ectiveformanyretrievaltasks[21,28,14,4].Amongmanyvariantsoflanguagemod-elsproposed,themostpopularandfundamentaloneisthequery-generationlanguagemodel[21,13],whichleadstothequery-likelihoodscoringmethodforrankingdocuments.Insuchamodel,givenaqueryqandadocumentd,wecom-putethelikelihoodof“generating”queryqwithamodelestimatedbasedondocumentd,i.e.,theconditionalprob-

Permissiontomakedigitalorhardcopiesofallorpartofthisworkforpersonalorclassroomuseisgrantedwithoutfeeprovidedthatcopiesarenotmadeordistributedforpro torcommercialadvantageandthatcopiesbearthisnoticeandthefullcitationonthe rstpage.Tocopyotherwise,torepublish,topostonserversortoredistributetolists,requirespriorspeci cpermissionand/orafee.

SIGIR’07,July23–27,2007,Amsterdam,TheNetherlands.Copyright2007ACM978-1-59593-597-7/07/0007...$5.00.

abilityp(q|d).Wecanthenrankdocumentsbasedonthelikelihoodofgeneratingthequery.

Virtuallyalltheexistingquerygenerationlanguagemod-elsarebasedoneithermultinomialdistribution[19,6,28]ormultivariateBernoullidistribution[21,18].Themultino-mialdistributionisespeciallypopularandalsoshowntobequitee ective.Theheavyuseofmultinomialdistributionispartlyduetothefactthatithasbeensuccessfullyusedinspeechrecognition,wheremultinomialdistributionisanat-uralchoiceformodelingtheoccurrenceofaparticularwordinaparticularpositionintext.Comparedwithmultivari-ateBernoulli,multinomialdistributionhastheadvantageofbeingabletomodelthefrequencyoftermsinthequery;incontrast,multivariateBernoullionlymodelsthepresenceandabsenceofqueryterms,thuscannotcapturedi erentfrequenciesofqueryterms.However,multivariateBernoullialsohasonepotentialadvantageovermultinomialfromtheviewpointofretrieval:inamultinomialdistribution,theprobabilitiesofallthetermsmustsumto1,makingithardtoaccommodateper-termsmoothing,whileinamultivari-ateBernoulli,thepresenceprobabilitiesofdi erenttermsarecompletelyindependentofeachother,easilyaccommo-datingper-termsmoothingandweighting.Notethattermabsenceisalsoindirectlycapturedinamultinomialmodelthroughtheconstraintthatallthetermprobabilitiesmustsumto1.

Inthispaper,weproposeandstudyanewfamilyofquerygenerationmodelsbasedonthePoissondistribution.Inthisnewfamilyofmodels,wemodelthefrequencyofeachtermindependentlywithaPoissondistribution.Toscoreadocu-ment,wewould rstestimateamultivariatePoissonmodelbasedonthedocument,andthenscoreitbasedonthelike-lihoodofthequerygivenbytheestimatedPoissonmodel.Insomesense,thePoissonmodelcombinestheadvantageofmultinomialinmodelingtermfrequencyandtheadvantageofthemultivariateBernoulliinaccommodatingper-termsmoothing.Indeed,similartothemultinomialdistribution,thePoissondistributionmodelstermfrequencies,butwith-outtheconstraintthatallthetermprobabilitiesmustsumto1,andsimilartomultivariateBernoulli,itmodelseachtermindependently,thuscaneasilyaccommodateper-termsmoothing.

Asintheexistingworkonmultinomiallanguagemodels,smoothingiscriticalforthisnewfamilyofmodels.Wede-riveseveralsmoothingmethodsforPoissonmodelinparalleltothoseusedformultinomialdistributions,andcomparethecorrespondingretrievalmodelswiththosebasedonmulti-

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email