statistical methods and linguistics
StatisticalMethodsandLinguistics
StevenAbney
UniversityofT¨ubingen
Inthespaceofthelasttenyears,statisticalmethodshavegonefrombeingvirtuallyunknownincomputationallinguisticstobeingafundamentalgiven.In1996,noonecanprofesstobeacomputationallinguistwithoutapassingknowl-edgeofstatisticalmethods.HMM’sareasderigeurasLRtables,andanyonewhocannotatleastusetheterminologypersuasivelyrisksbeingmistakenforkitchenhelpattheACLbanquet.
Moreseriously,statisticaltechniqueshavebroughtsigni cantadvancesinbroad-coveragelanguageprocessing.Statisticalmethodshavemaderealprogresspossibleonanumberofissuesthathadpreviouslystymiedattemptstoliberatesystemsfromtoydomains;issuesthatincludedisambiguation,errorcorrection,andtheinductionofthesheervolumeofinformationrequisiteforhandlingunre-strictedtext.Andthesenseofprogresshasgeneratedagreatdealofenthusiasmforstatisticalmethodsincomputationallinguistics.
However,thisenthusiasmhasnotbeencatchinginlinguisticsproper.Itisalwaysdangeroustogeneralizeaboutlinguists,butIthinkitisfairtosaythatmostlinguistsareeitherunaware(andunconcerned)abouttrendsincom-putationallinguistics,orhostiletocurrentdevelopments.Thegulfinbasicassumptionsissimplytoowide,withtheresultthatresearchontheothersidecanonlyseemnaive,ill-conceived,andacompletewasteoftimeandmoney.Inpartthedi erenceisadi erenceofgoals.Alargepartofcomputationallinguisticsfocusesonpracticalapplications,andislittleconcernedwithhumanlanguageprocessing.Nonetheless,atleastsomecomputationallinguistsaimtoadvanceourscienti cunderstandingofthehumanlanguagefacultybybetterunderstandingthecomputationalpropertiesoflanguage.Oneofthemostinter-estingandchallengingquestionsabouthumanlanguagecomputationisjusthowpeopleareabletodealsoe ortlesslywiththeveryissuesthatmakeprocessingunrestrictedtextsodi cult.Statisticalmethodsprovidethemostpromisingcurrentanswers,andasaresulttheexcitementaboutstatisticalmethodsisalsosharedbythoseinthecognitivereachesofcomputationallinguistics.
Inthispaper,Iwouldliketocommunicatesomeofthatexcitementtofellowlinguists,oratleast,perhaps,tomakeitcomprehensible.Thereisnodenyingthatthereisacultureclashbetweentheoreticalandcomputationallinguis-ticsthatservestoreinforcemutualprejudices.Incharicature,computationallinguistsbelievethatbythrowingmorecyclesandmorerawtextintotheirstatisticalblackbox,theycandispensewithlinguistsaltogether,alongwiththeirfancifulRubeGoldbergtheoriesaboutexoticlinguisticphenomena.TheIwouldliketothankTilmanHoehle,GrahamKatz,MarcLight,andWolfgangSternefeldfortheircommentsonanearlierdraftofthispaper.Allerrorsandoutrageousopinionsareofcoursemyown.
1
, A., and O. Rambow, eds. (2000) Tree Adjoining Grammars, CSLI. e Abney, S. (1996) “Statistical Methods and Linguistics,” in J. L. Klavans ...
(1996). Statistical methods and linguistics. In J. L. Klavans & P. Resnik (Eds.), The balancing act: Combining symbolic and statistical approaches to...
1996b. Statistical methods and linguistics. In Judith L. Klavans and Philip Resnik (eds.), The Balancing Act: Combining Symbolic and Statistical Approaches...
Lectuire 1 _ QUANTITATIVE AND STATISTICAL METHODS_经济学_高等教育_教育专区。国外大学的统计学——英文版的QUANTITATIVE AND STATISTICAL METHODS LECTURE 1 : AN...
Yij 2 ) 2ν i=1 j =1 11 July 12, 2006 Statistical Methods Statistical inferences such as hypothesis test, confidence interval, and power calculation...
statistical methods were developed to accommodate outliers and to reduce their impact on the http://www.pharmtech.com/pharmtech/content/printContentPopup....
Analysis might include statistical evaluations, optimization of rule-bases or knowledge discovery methods. 3.3 The scope of Corpus linguistics Corpus ...
质量管理常用统计方法Statistical methods in quality management_数学_自然科学_...He coined the phrases “vital few and useful many”(关键的少数,次要的多 ...
Chapter 10 Language and Computer 10.1 What is Computational Linguistics? ...methods, notably the introduction of statistical methods and of example-based...
Linguistics 第三版) 语言学教程(第三版) Chapter 12 Theories & schools of...Methods and Strategies: Teacher presentation and class discussion 2 黄石理工...
热门文档