AHierarchicalPhrase-BasedModelforStatisticalMachineTranslation
DavidChiang
InstituteforAdvancedComputerStudies(UMIACS)UniversityofMaryland,CollegePark,MD20742,USA
dchiang@umiacs.umd.edu
Abstract
Wepresentastatisticalphrase-basedtransla-tionmodelthatuseshierarchicalphrases—phrasesthatcontainsubphrases.Themodelisformallyasynchronouscontext-freegram-marbutislearnedfromabitextwithoutanysyntacticinformation.Thusitcanbeseenasashifttotheformalmachineryofsyntax-basedtranslationsystemswithoutanylin-guisticcommitment.Inourexperimentsus-ingBLEUasametric,thehierarchicalphrase-basedmodelachievesarelativeimprove-mentof7.5%overPharaoh,astate-of-the-artphrase-basedsystem.
Englishsentenceeismodeledas:(1)(2)
argmaxP(e|f)=argmaxP(e,f)
e
e
=argmax(P(e)×P(f|e))
e
ThetranslationmodelP(f|e)“encodes”eintofbythefollowingsteps:
1.segmenteintophrasese¯1···e¯I,typicallywithauniformdistributionoversegmentations;2.reorderthee¯iaccordingtosomedistortionmodel;3.translateeachofthee¯iintoFrenchphrasesac-cordingtoamodelP(f¯|e¯)estimatedfromthetrainingdata.Otherphrase-basedmodelsmodelthejointdistribu-tionP(e,f)(MarcuandWong,2002)ormadeP(e)andP(f|e)intofeaturesofalog-linearmodel(OchandNey,2002).Butthebasicarchitectureofphrasesegmentation(orgeneration),phrasereordering,andphrasetranslationremainsthesame.
Phrase-basedmodelscanrobustlyperformtrans-lationsthatarelocalizedtosubstringsthatarecom-monenoughtohavebeenobservedintraining.ButKoehnetal.(2003) ndthatphraseslongerthanthreewordsimproveperformancelittle,suggestingthatdatasparsenesstakesoverforlongerphrases.Abovethephraselevel,thesemodelstypicallyhaveasimpledistortionmodelthatreordersphrasesin-dependentlyoftheircontent(OchandNey,2004;Koehnetal.,2003),ornotatall(ZensandNey,2004;Kumaretal.,2005).
Butitisoftendesirabletocapturetranslationswhosescopeislargerthanafewconsecutivewords.
1Introduction
Thealignmenttemplatetranslationmodel(OchandNey,2004)andrelatedphrase-basedmodelsad-vancedthepreviousstateoftheartbymovingfromwordstophrasesasthebasicunitoftransla-tion.Phrases,whichcanbeanysubstringandnotnecessarilyphrasesinanysyntactictheory,allowthesemodelstolearnlocalreorderings,translationofshortidioms,orinsertionsanddeletionsthataresensitivetolocalcontext.Theyarethusasimpleandpowerfulmechanismformachinetranslation.
Thebasicphrase-basedmodelisaninstanceofthenoisy-channelapproach(Brownetal.,1993),1inwhichthetranslationofaFrenchsentencefintoan
Throughoutthispaper,wefollowtheconventionofBrownetal.ofdesignatingthesourceandtargetlanguagesas“French”and“English,”respectively.Thevariablesfandestandforsourceandtargetsentences;fijstandsforthesubstringofffrompositionitopositionjinclusive,andsimilarlyforeij.
1
A hierarchical phrase-based model for statistical machine translation We present a statistical phrase-based translation model that uses hierarchical phrases— ...
One natural extension is to utilize syntax-based structure features for SMT....(2007) uses a formal binary synchronous CFG to model hierarchical phrase ...
David Chiang, 2007, Hierarchical Phrase-Based Translation, Computational ...5.7 Factored translation model State-of-the-art: SMT Morphology for MT ?...
A hierarchical phrase-ba... 8页 免费 A phrase-based unigram m... 3... A Phrase-based Statistical Model for SMS Text Normalization A Phrase-based...
A hierarchical phrase-ba... 8页 免费 A Computational Model of... 暂无... A Phrase-based Context-dependent Joint Probability Model for Named Entity ...
A Phrase-based Statist... 暂无评价 8页 免费 A Text Model for the J... 暂无评价 5页 免费 A hierarchical phrase-... 8页 免费 Knowledge Extraction...
A phrase-based unigram model for statistical machine translation_少儿英语_... Statistical Phrase-Bas... 7页 免费 A hierarchical phrase-... 8页 免费...
Left-to-Right Target Generation for Hierarchical Phrase-based Translation ...2005. A hierarchical phrase-based model for statistical machine translation. ...
A: Mainly MT, with syntax, some learning 0.6 MT Source Target SMT ...A Hierarchical Phrase-Based Model for Statistical Machine Translation We ...
A hierarchical phrase-ba... 8页 免费 A ...Free Phrase Translation Model for Statistical ...phrase-based statistical machine translation (SMT) ...
热门文档