Abstract. This paper presents a robust method for the construction of collection-specific document models. These document models are variants of the well-known vector space model, which relies on a process of selecting, modifying, and weighting index terms
2
INDEXCONSTRUCTIONFORDOCUMENTMODELS
Thissectionorganizesthecurrentpracticeofindexconstructionforvectorspacemodels.Inparticular,wereviewtheconceptofadoc-umentmodelandproposeaclassi cationschemeforbothpopularandspecializedindexconstructionprinciples.
Adocumentdcanbeviewedunderdifferentaspects:layout,struc-turalorlogicalsetup,andsemantics.Acomputerrepresentationdofdmaycapturedifferentportionsofthesesaspects.Notethatdisdesignedpurposefully,withrespecttothestructureofaformalizedquery,q,andalsowithhavingaparticularretrievalmodelinmind.Aretrievalmodel,R,providesthelinguisticrationaleforthemodelfor-mationprocessbehindthemappingd→d.Thismappinginvolvesaninevitablesimpli cationofdthatshouldbe1.quanti able,
2.usefulwithrespecttotheinformationneed,and3.tailoredtoq,theformalizedquery.
TheretrievalmodelRgivesanswerstothesepoints,beittheo-reticallyorempirically,andprovidesaconcretemeans,ρ(q,d),forquantifyingtherelevancebetweenaformalizedqueryqandadocu-ment’scomputerrepresentationd.Notethatρ(q,d)isoftenspeci- edintheformofasimilaritymeasure .
Together,thecomputerrepresentationdalongwiththeunderlyingretrievalmodelRformthedocumentmodel;Figure2illustratestheconnections.
LetDbeadocumentcollectionandletTbethesetofalltermsthatoccurinD.Thevectorspacemodeldofadocumentdisavec-torof|T|weights,eachofwhichquantifyingthe“importance”ofsomeindexterminTwithrespecttod.3Thisquanti cationmustbeseenagainstthebackgroundthatoneisinterestedinasimilarityfunction thatmapsfromthevectorsd1andd2oftwodocumentsd1,d2intotheinterval[0;1]andthathasthefollowingproperty:If (d1,d2)iscloseto1thenthedocumentsd1andd2aresimilar;likewise,avalueclosetozeroindicatesahighdissimilarity.Notethatdocumentmodelsandsimilarityfunctionsdetermineeachother:Thevectorspacemodelanditsvariantsareamenabletothecosinesimi-larity(=normalizeddotproduct)in rstplace,butcanalsobeusedinconnectionwithEuclideandistance,overlapmeasures,orotherdistanceconcepts.
Underthevectorspaceparadigmthedocumentmodelconstruc-tionprocessisdeterminedintwodimensions:indexconstructionandweightcomputation.Inthefollowingwewillconcentrateonthefor-merdimensionsincethispapercontributesrighthere.Wehaveclas-
These tools have their own formalisms, semantics ...The delivery of enriched information that results ...Many analysis and design techniques use models to...
2.2 Semantically Enriched Object Information Thinking about mobile smart ... a common understanding of the semantics of the information gathered in ...
generating semantically enriched ontologybased user ...semantics of the concepts and is learned as we ...In Formal Ontology in Conceptual Analysis and ...
generating semantically enriched ontologybased user ...semantics of the concepts and is learned as we ...In Formal Ontology in Conceptual Analysis and ...
热门文档