文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > Syntax versus Semantics Analysis of Enriched Vector Space Models
侵权投诉

Syntax versus Semantics Analysis of Enriched Vector Space Models

Abstract. This paper presents a robust method for the construction of collection-specific document models. These document models are variants of the well-known vector space model, which relies on a process of selecting, modifying, and weighting index terms

SyntaxversusSemantics:

AnalysisofEnrichedVectorSpaceModels

BennoStein1andSvenMeyerzuEissen1andMartinPotthast2

Abstract.Thispaperpresentsarobustmethodfortheconstructionofcollection-speci cdocumentmodels.Thesedocumentmodelsarevariantsofthewell-knownvectorspacemodel,whichreliesonapro-cessofselecting,modifying,andweightingindextermswithrespecttoagivendocumentcollection.Weimprovethestepofindextermselectionbyapplyingstatisticalmethodsforconceptidenti cation.Thisapproachisparticularlysuitedforpost-retrievalcategorizationandretrievaltasksinclosedcollections,whichistypicalforintranetsearch.

Wecompareourapproachto“enriched”vector-space-baseddoc-umentmodelsthatemployknowledgeoftheunderlyinglanguageintheformofexternalsemanticconcepts.Primaryobjectiveistoquan-tifytheimpactofapurelysyntacticanalysisincontrasttoasemanticenrichmentintheindexconstructionstep.Asaby-productwepro-videanef cientandlanguage-independentmeansforvectorspacemodelconstruction,whereastheresultingdocumentmodelsperformbetterthanthestandardvectorspacemodel.

Keywordscepts,textcategorization,vectorspacemodel,evaluationconceptmeasures

identi cation,semanticcon-1INTRODUCTION

Eachtextretrievaltaskthatisautomatedbyacomputerreliesonsomekindofdocumentmodel,whichisanabstractionoftheorigi-naldocumentd.Thedocumentmodelmustbetailoredwellwithre-specttotheretrievaltaskinquestion:Itdeterminesthequalityoftheanalysis,and—diametricallyopposed—itscomputationalcomplex-ity.Thoughitsobvioussimplicitythevectorspacemodelhasshowngreatsuccessinmanytextretrievaltasks[11;12;16;15],and,theanalysisofthispaperusesthismodelasitsstartingpoint.

Thestandardvectorspacemodelabstractsadocumentdtowardavectordofweightedindexterms.Eachtermtthatisincludedindderivesfromatermτ∈dbyaf xremoval,whichisnecessarytomapmorphologicalvariantsofτontothesamestemt.Therespec-tivetermweightsindaccountforthedifferentdiscriminativepoweroftheoriginaltermsindandarecomputedaccordingtosomefre-quencyscheme.Themainapplicationofthevectorspacemodelisdocumentsimilaritycomputation.

Inthispaperwefocusontheindexconstructionstepand,inpar-ticular,onindextermselection.Otherconceptsofthevectorspacemodel,suchasthetermweightingschemeoritsdisregardofwordorderareadopted.

ρ.Perhapsthemostinterestingresult

maybeanticipated:Thepositiveeffectofsemanticindextermen-richment,whichhasbeenreportedbysomeauthorsinthepast,couldhardlybeobservedinourcomprehensiveanalysis.

Theremainderofthepaperisorganizedasfollows.Section2presentsataxonomyofindexconstructionmethodsandoutlinescommonlyusedtechnology,andSection3reportsonsimilarityanal-ysisandunsupervisedclassi cationexperiments.

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email