文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > Minimal cost complexity pruning of meta-classi
侵权投诉

Minimal cost complexity pruning of meta-classi

Integrating multiple learned classification models (classifiers) computed over large and (physically) distributed data sets has been demonstrated as an e#ective approach to scaling inductive learning techniques, while also boosting the accuracy of individu

MinimalCostComplexityPruningofMeta-Classi ers

AndreasL.ProdromidisandSalvatoreJ.StolfoDepartmentofComputerScienceColumbiaUniversityNewYork,NY10027{andreas,sal}@cs.columbia.edu

Integratingmultiplelearnedclassi cationmodels(classi ers)computedoverlargeand(physically)dis-tributeddatasetshasbeendemonstratedasane ec-tiveapproachtoscalinginductivelearningtechniques,whilealsoboostingtheaccuracyofindividualclassi- ers.Thesegains,however,comeattheexpenseofanincreaseddemandforrun-timesystemresources.The nalensemblemeta-classi ermayconsistofalargecollectionofbaseclassi ersthatrequireincreasedmemoryresourceswhilealsoslowingdownclassi ca-tionthroughput.Toclassifyunlabeledinstances,pre-dictionsneedtobegeneratedfromallbase-classi ersbeforethemeta-classi ercanproduceits nalclassi- cation.Thethroughput(predictionrate)ofameta-classi erisofsigni cantimportanceinreal-timesys-tems,suchasine-commerceorintrusiondetection.

Thisextendedabstractdescribesapruningalgorithmthatisindependentofthecombiningschemeandisusedfordiscardingredundantclassi erswithoutdegradingtheoverallpredictiveperformanceoftheprunedmeta-classi er.Todeterminethemoste ectivebaseclassi- ers,thealgorithmtakesadvantageoftheminimalcost-complexitypruningmethodoftheCARTlearningalgo-

rithm(Breimanetal.1984)whichguaranteesto ndthebest(withrespecttomisclassi cationcost)prunedtreeofaspeci csize(numberofterminalnodes)ofaninitialunpruneddecisiontree.AnalternativepruningmethodusingRissanen’sminimumdescriptionlengthisdescribedin(Quinlan&Rivest1989).

Minimalcostcomplexitypruningassociatesacom-plexityparameterwiththenumberofterminalnodesofadecisiontree.Itprunesdecisiontreesbyminimiz-ingthelinearcombinationofthecomplexity(size)ofthetreeanditsmisclassi cationcostestimate(errorrate).Thedegreeofpruningiscontrolledbyadjustingtheweightofthecomplexityparameter,i.e.anincreaseofthisweightparameterresultsinheavierpruning.

Pruninganarbitrarymeta-classi erconsistsofthreestages.Firstweconstructadecisiontreemodel(e.g.CART)oftheoriginalmeta-classi er,bylearningitsinput/outputbehavior.Thisnewmodel(adecision

第1页

你可能喜欢

热门文档

相关文档

  • Cost complexity-based pruning of ensemble classifie...

    Minimal cost complexity ... 1页 免费 Analysis of a complexity... 17页... Cost Complexity-based Pruning of Ensemble Classi?ers? Andreas L. ...

  • Analysis of a complexity based pruning scheme for c...

    Analysis of a complexity based pruning scheme for classification trees A complexity based pruning procedure for classication trees is described, and bounds ...

  • 决策树剪枝

    Minimal Cost-Complexity Pruning 未剪枝前的树记为 Tmax ,剪枝过程包括两步: ①按照某种规则,得到树 Tmax 的参数族 (候选剪枝树) Tmax ,T1 , T2 ,…,{t...

  • FBP A Frontier-Based Tree-Pruning Algorithm

    The new method has an order of computational complexity comparable to cost-...Key words: decision trees; tree pruning; data mining; classi?cation History...

  • Minimal complexity attack classification intrusion ...

    Minimal complexity attack classification intrusion detection system_法律资料_人文社科_专业资料。最小的复杂攻击分类入侵检测系统 摘要 在一般情况下, 用户和注入...

  • 数据仓库与数据挖掘7(北大)

    主要策略 : l) MCCP (MinimalCost一Complexitypruning) 2) PEP(PessimisticErrorPruning) 3) MEP(MinimumErrorPruning) 4) REP(ReducedErrorPunring) 5) MDL(...

  • 第七章 决策树(2)

    ? 常见的六种修剪技术: 1.MCCP(Minimal cost-complexity Pruning)-用 于CRAT系统。 2.REP(Reduced Error Pruning) 。 3.MEP(Minimal Error Pruning) 。 4....

  • A quantitative analysis of minimal window search_免...

    The search complexity is given in terms of leaf-node evaluations (hence ... since it used additional special-purpose pruning methods, it supports the ...

  • Clementine 第五讲

    最小代价复杂性剪枝法(Minimal Cost Complexity Pruning,MCCP) ? 目标:得到恰当的树,具有一定的预测精度, 且复杂程度恰当 ? 代价(误差)和复杂度之间的权衡是必要...

  • ABSTRACT Management of Intelligent Learning Agents ...

    108 109 111 113 116 116 Chapter 6 A-posteriori Pruning of Meta-Classi?...ers. . . . The six steps of the Cost Complexity-based Post-Training ...

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email