This paper presents a robust semantic model for one-stage interpretation of natural speech. Our semantic analysis uses no explicit syntactic and morphologic knowledge, which seems sufficient for narrow application domains. In contrast to previous approache
HierarchicalLanguageModelsforOne-StageSpeechInterpretation
MatthiasThomae,TiborFabian,RobertLieb,GüntherRuske
InstituteforHuman-MachineCommunicationTechnischeUniversitätMünchen,Germany
eurospeech05@thomae-privat.de,{fab,lie,rus}@mmk.ei.tum.de
Abstract
Thispaperpresentsarobustsemanticmodelforone-stageinterpretationofnaturalspeech.Oursemanticanalysisusesnoexplicitsyntacticandmorphologicknowledge,whichseemssuf cientfornarrowapplicationdomains.Incontrasttopre-viousapproaches,oursemanticmodelisembeddedinauni-form,hierarchical,stochasticmodelingframeworktogetherwithacoustic-phoneticandlexicalknowledge,andsemanticrepresentationsarecomputeddirectlyfromacousticobserva-tionsthroughaone-stagedecodingprocess.Thedecoderpro-ducesahierarchical(tree-)structureofwordsandsemanticcat-egorysymbolsbyuseoftheso-calledhierarchicallanguagemodel(HLM).WediscussgenerationofHLMbymixingrule-basedanddata-drivenlanguagemodel(LM)generationtech-niques,namelyweightedregularexpressions,n-gramsandex-actLM.DifferentHLMcon gurationswithvaryingdiscount-ingtechniques,n-gramordersandscalingfactorsareexamined.Experimentswereconductedwithanairportinformationdia-logueapplication.TheevaluationresultsarebasedonHLMperplexityandourpreviouslypublishedsemantictreeaccuracy.
1.Introduction
In[1]weintroducedaOne-stageDecoderforInterpretationofNaturalSpeech(ODINS),whichtightlyintegratesautomaticspeechrecognition(ASR)andnaturallanguageunderstand-ing(NLU)techniquesinaone-stagedecodingprocess.Ex-perimentscon rmedthattheone-stageapproachcanbefavor-ableovertypicallyusedmulti-stagemethodsbyavoidingerrorscausedbydecisionsinearlyprocessingstages.Incontrasttotypicalhybridspeechunderstandingapproaches,ODINSoper-atesonasingle,uniformmodelforacoustic-phonetic,lexicalandsyntactic-semanticknowledge.Uniformityisappealingbe-causeitenablestheintegrationofdifferenttypesofknowledgemodelswithouthavingtomodifythedecoder,aslongastheex-pressivepoweroftheunderlyingframeworkissuf cient.Fur-thermore,decodercomplexityispotentiallylower,asonlyonealgorithmicframeworkneedstobeconsidered,insteadofmany.Onthedownside,ahybridmodelingapproachmaylenditselftomoreef cientdecoding.
Ouruniformmodelingapproachisrealizedasastochas-ticcontext-freegrammarrepresentationthroughweighedtransi-tionnetworkhierarchies(WTNH).WTNHconsistoftransitionnetworkswhosenodeseitherrepresentterminalsymbolsorre-fertoothertransitionnetworks.WTNHaresimilartostochas-ticrecursivetransitionnetworks,buttheyemploytheMooremachinerepresentationinsteadoftheMealyone.Asanotherfundamentaldifference,WTNHarelogicallydividedintohier-
Robust interpretation ... 暂无评价 4页 免费 A One-Stage Decoder fo... ...Hierarchical Language ... 暂无评价 4页 免费 A Computational Approa... 暂无...
? ? ? Construct a hierarchical tree of gaussians...Focus: creating language resources for speech ...simultaneous interpretation in international conference...
Michigan English Language Assessment Battery (MELAB)...(Tatsuoka, 1995), attribute hierarchical model (...stage required to enhance the interpretation of an...
Callan. Hierarchical Language Models for Retrieval ...Two-Stage Language Models for Information Retrieval...IEEE Transaction on Acoustics, Speech and Signal ...
one stage of design to another – HDL language ...and interpretation with an ability for step-wise ...Hierarchical Models synchronous and asynchronous ...
Stage-Wise Outlier Detection in Hierarchical Bayesian Repeated Measures Models insightful comments. They also acknowledge the Hospital for Special Surgery, New ...
We use the User Interface Markup Language (UIML)...models in the UIML specification itself, this ...A leaf task from a hierarchical task description ...
Hierarchical models fo... 暂无评价 14页 2....A detailed performance comparison and interpretation ...The most important are language independent wire ...
Hierarchical models fo... 暂无评价 14页 2....A detailed performance comparison and interpretation ...The most important are language independent wire ...
热门文档