文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > Japanese Dependency Analysis using Cascaded Chunking Taku Kudo and Yuji Matsumoto
侵权投诉

Japanese Dependency Analysis using Cascaded Chunking Taku Kudo and Yuji Matsumoto

In this paper, we propose a new statistical Japanese dependency parser using a cascaded chunking model. Conventional Japanese statistical dependency parsers are mainly based on a probabilistic model, which is not always efficient or scalable. We propose a

JapaneseDependencyAnalysisusingCascadedChunking

TakuKudoandYujiMatsumotoGraduateSchoolofInformationScience,NaraInstituteofScienceandTechnology

taku-ku,matsu@is.aist-nara.ac.jp

Abstract

Inthispaper,weproposeanewstatisticalJapanesedependencyparserusingacascadedchunkingmodel.ConventionalJapanesestatisticaldepen-dencyparsersaremainlybasedonaprobabilisticmodel,whichisnotalwaysef cientorscalable.Weproposeanewmethodthatissimpleandef cient,sinceitparsesasentencedeterministicallyonlyde-cidingwhetherthecurrentsegmentmodi esthesegmentonitsimmediaterighthandside.Experi-mentsusingtheKyotoUniversityCorpusshowthatthemethodoutperformsprevioussystemsaswellasimprovestheparsingandtrainingef ciency.

1Introduction

DependencyanalysishasbeenrecognizedasabasicprocessinJapanesesentenceanalysis,andanum-berofstudieshavebeenproposed.Japanesedepen-dencystructureisusuallyde nedintermsoftherelationshipbetweenphrasalunitscalledbunsetsusegments(hereafter“segments”).

MostofthepreviousstatisticalapproachesforJapanesedependencyanalysis(FujioandMat-sumoto,1998;Harunoetal.,1999;Uchimotoetal.,1999;Kanayamaetal.,2000;Uchimotoetal.,2000;KudoandMatsumoto,2000)arebasedonaprobabilisticmodelconsistingofthefollowingtwosteps.First,theyestimatemodi cationprob-abilities,inotherwords,howprobableonesegmenttendstomodifyanother.Secondtheoptimalcombi-nationofdependenciesissearchedfromtheallcan-didatesdependencies.Suchaprobabilisticmodelisnotalwaysef cientsinceitneedstocalculatetheprobabilitiesforallpossibledependenciesandcre-ates

inasentence)training(whereexamplesisthenumberpersentence.ofsegmentsInaddition,theprobabilisticmodelassumesthateachpairsofdependencystructureisindependent.

Inthispaper,weproposeanewJapanesedepen-dencyparserwhichismoreef cientandsimplerthantheprobabilisticmodel,yetperformsbetterintrainingandtestingontheKyotoUniversityCorpus.Themethodparsesasentencedeterministicallyonlydecidingwhetherthecurrentsegmentmodi esseg-mentonitsimmediaterighthandside.Moreover,itdoesnotassumetheindependenceconstraintbe-tweendependencies

2AProbabilisticModel

Thissectiondescribesthegeneralformulationoftheprobabilisticmodelforparsingwhichhasbeenap-pliedtoJapanesestatisticaldependencyanalysis.Firstofall,wede neasentenceasasequence

ofsegments

ticstructureasasequenceofdependencyanditspatterns

syntac-meansthatthethissegmentdepends,where

on

(modi es)segment.Inframework,weas-sumethatthedependencysequencesatis esthefollowingtwoconstraints.

1.Japaneseisahead- nallanguage.Thus,ex-ceptfortherightmostone,eachsegmentmod-i esexactlyonesegmentamongthesegments

appearingtoitsright.2.Dependenciesdonotcrossoneanother.Statisticaldependencyanalysisisde nedasasearchingproblemforthedependencypatternthatmaximizestheconditionalprobability

oftheinputsequenceundertheabove-mentionedconstraints.Ifweassumethatthedependencyprob-abilitiesaremutuallyindependent,

canberewrittenas:

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email