文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > MEASURING THE EFFECTIVENESS OF PUBLIC SEARCH ENGINES ON THAI QUERIES
侵权投诉

MEASURING THE EFFECTIVENESS OF PUBLIC SEARCH ENGINES ON THAI QUERIES

This paper compares the retrieval performance of seven public search engines on Thai queries by using a blind evaluation. Two of the engines used in this study are Thaifocused search services, while the remaining engines are large, commercial search engine

MEASURINGTHEEFFECTIVENESSOFPUBLICSEARCHENGINESON

THAIQUERIES

ShisanuTongchimandVirachSornlertlamvanichandHitoshiIsahara

ThaiComputationalLinguisticsLaboratory

112PhahonYothinRd.Pathumthani12120,Thailand

email:{shisanu,virach}@tcllab.org,isahara@nict.go.jp

ABSTRACT

ThispapercomparestheretrievalperformanceofsevenpublicsearchenginesonThaiqueriesbyusingablindeval-uation.TwooftheenginesusedinthisstudyareThai-focusedsearchservices,whiletheremainingenginesarelarge,commercialsearchenginesthathavewidercollec-tionsofwebdataandsupportseverallanguages.There-sultsarecomparedbyMeanaverageprecision(MAP)andMeanreciprocalrankofthe rstcorrectanswer(MRR).Theseresultsarecalculatedfrombinaryrelevancejudg-mentsofthe rst20returnedresults,using56topics.Sta-tisticaltestingshowsthattherearesigni cantdifferencesamongengines.

KEYWORDS

Websearchengine,Blindevaluation,Thaiqueries

1Introduction

Anumberofstudiesexaminingtheperformanceofwebsearchenginesregularlyappearinliterature.Mostofthestudiesinsearchengineevaluationhavebeendonebyus-ingEnglishqueries.AstudybasedonlanguagesotherthanEnglish(i.e.Chinese)wasshownin[1].Toourknowledge,however,nosystematicevaluationofpublicsearchenginesonThaiquerieshasbeenreported.Inthispaper,wecom-paretheperformanceofsevensearchenginesbyusingThaiqueries.Theevaluationiscompletelyblind.Thatis,there-sultsfromdifferentenginesarepooledandpresentedtothejudgesinrandomorder.Noinformationaboutthesearchenginesisshown.Besidescomparingtheperformanceofsearchenginesthroughablindevaluation,wealsodiscussaboutsearchenginepopularitybasedonreferrerdatafromThaiwebsites.Theresultsbasedonananalysisofreferrerdatahavebeenprovidedbythelargestwebstatisticscol-lectorinThailand,Truehits1.Theresultsfromreferrerdatawouldsuggestthepopularityandsuccessofsearchenginesinrealusage.Theseresultswillbecomparedwiththe nd-ingsfromtheblindevaluation.Thiswillsuggestwhetherthereareanycorrelationsbetweensearchenginepopularityandtheresultsofourblindevaluationornot.

ByusingThaitestqueries,achallengingissueen-2doc.guandang.net

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email