文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > Class-boundary alignment for imbalanced dataset learning
侵权投诉

Class-boundary alignment for imbalanced dataset learning

In this paper, we propose the class-boundaryalignment algorithm to augment SVMs to deal with imbalanced training-data problems posed by many emerging applications (e.g., image retrieval, video surveillance, and gene profiling). Through a simple example, we

Class-BoundaryAlignmentforImbalancedDatasetLearning

GangWuGWU@ENGINEERING.UCSB.EDUEdwardY.ChangECHANG@ECE.UCSB.EDUDepartmentofElectrical&ComputerEngineering,UniversityofCalifornia,SantaBarbara

Abstract

Inthispaper,weproposetheclass-boundary-alignmentalgorithmtoaugmentSVMstodealwithimbalancedtraining-dataproblemsposedbymanyemergingapplications(e.g.,imagere-trieval,videosurveillance,andgenepro ling).Throughasimpleexample,we rstshowthatSVMscanbeineffectiveindeterminingtheclassboundarywhenthetraininginstancesofthetar-getclassareheavilyoutnumberedbythenon-targettraininginstances.Toremedythisprob-lem,weproposetoadjusttheclassboundaryei-therbytransformingthekernelfunctionwhenthetrainingdatacanberepresentedinavectorspace,orbymodifyingthekernelmatrixwhenthedatadonothaveavector-spacerepresentation(e.g.,sequencedata).Throughtheoreticalanaly-sisandempiricalstudy,weshowthattheclass-boundary-alignmentalgorithmworkseffectivelywithimages(datathathaveavector-spacerepre-sentation)andvideosequences(datathatdonothaveavector-spacerepresentation).

Veropoulosetal.,1999;Linetal.,2002;Crammeretal.,2003;Ongetal.,2003).Giventheclasspredictionfunc-tionofSVMs, n

sgn

f(x)=

yiαiK(x,xi)+b

,

i=1

(1)

threeparameterscanaffectthedecisionoutcome:b,αi,andK.OurempiricalstudyshowsthattheonlyeffectivemethodforimprovingSVMs,however,isthroughadap-tivelymodifyingKbasedonthetrainingdatadistribu-tion.Asindicatedby(Amari&Wu,1999),byconfor-mallyspreadingtheareaaroundtheclass-boundaryout-wardontheRiemannianmanifoldSwhereallmappeddataarelocatedinfeaturespaceF,wecanadaptKlocallytodatadistributiontoimproveclass-predictionaccuracy.Inthispaper,weproposetheclass-boundary-alignmentalgo-rithm,whichimprovesuponAmariandWu’smethodfortacklingtheimbalancedtraining-dataprobleminthreere-spects.

1.WeconductthetransformationbasedonthespatialdistributionofthesupportvectorsinfeaturespaceF,in-steadofininputspaceI(Wu&Amari,2002).Usingfeature-spacedistancetoconductconformationtransfor-mationtakesadvantageofthenewinformationlearnedbySVMsineveryiteration,whereasinput-spacedistanceremainsunchanged.

2.Weadaptivelycontrolthetransformationbasedontheskewoftheclass-boundary.Thistransformationgivestheneighborhoodofminoritysupportvectorsahigherspatialresolution,andhenceachievesbetterseparationbetweentheclasses.

3.Weshowthatincaseswheretheinputspacemaynotphysicallyexist(e.g.,sequencedatamaynothaveavec-torspacerepresentation),theclass-boundary-alignmentalgorithmcanbeapplieddirectlytoadjustthepair-wiseobject-distanceinthekernelmatrix1K.

OurexperimentalresultsonbothUCIandreal-worldim-age/videodatasetsshowtheclass-boundary-alignmental-gorithmtobeeffectiveincorrectingtheskewedboundary.

GivenakernelfunctionKandasetofinstancesXtrain={xi,yi}ni=1,thekernelmatrix(Grammatrix)isthematrixofallpossibleinner-productsofpairsfromXtrain,K=(kij)=K(xi,xj).

1

1.Introduction

SupportVectorMachines(SVMs)areacoremachinelearningtechnology.Theyhavestrongtheoreticalfoun-dationsandexcellentempiricalsuccessesinmanypat-ternrecognitionapplicationssuchashandwritingrecogni-tion(Vapnik,1995),imageretrieval(Tong&Chang,2001),andtextclassi cation(Joachims,1998).However,formanyemergingapplications,suchasimageunderstanding,securitysurveillance,andgenepro ling,wherethetraininginstancesofthetargetclassaresigni cantlyoutnumberedbytheothertraininginstances,theclass-boundarylearnedbySVMscanbeseverelyskewedtowardsthetargetclass.Asaresult,thefalse-negativeratecanbeexcessivelyhighinidentifyingimportanttargetobjects(e.g.,asuspiciouseventoragenedisease),andhencecanrendertheclassi erineffective.(WewillpresentanddiscussthedetailsofthisprobleminSection3.)

Severalattemptshavebeenmadetoimproveclass-predictionaccuracyofSVMs(Amari&Wu,1999;

WorkshoponLearningfromImbalancedDatasetsII,ICML,WashingtonDC,2003.

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email