文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > IT/计算机 > Classification and Cluster via Dictionary Learning with Structured Incoherence and Shared Features
侵权投诉

Classification and Cluster via Dictionary Learning with Structured Incoherence and Shared Features

Classification and Clustering via Dictionary Learning with Structured Incoherence and Shared Features

Classi cationandClusteringviaDictionaryLearningwithStructured

IncoherenceandSharedFeatures

IgnacioRamirez,PabloSprechmann,andGuillermoSapiro ElectricalandComputerEngineering,UniversityofMinnesotaAbstract

Aclusteringframeworkwithinthesparsemodelinganddictionarylearningsettingisintroducedinthiswork.In-steadofsearchingforthesetofcentroidthatbest tthedata,asink-meanstypeofapproachesthatmodelthedataasdistributionsarounddiscretepoints,weoptimizeforasetofdictionaries,oneforeachcluster,forwhichthesignalsarebestreconstructedinasparsecodingmanner.Thereby,wearemodelingthedataasaunionoflearnedlowdimen-sionalsubspaces,anddatapointsassociatedtosubspacesspannedbyjustafewatomsofthesamelearneddictionaryareclusteredtogether.Anincoherencepromotingtermen-couragesdictionariesassociatedtodifferentclassestobeasindependentaspossible,whilestillallowingfordiffer-entclassestosharefeatures.Thistermdirectlyactsonthedictionaries,therebybeingapplicablebothinthesu-pervisedandunsupervisedsettings.Usinglearneddictio-nariesforclassi cationandclusteringmakesthismethodrobustandwellsuitedtohandlelargedatasets.Thepro-posedframeworkusesanovelmeasurementforthequal-ityofthesparserepresentation,inspiredbytherobustnessofthe 1regularizationterminsparsecoding.Inthecaseofunsupervisedclassi cationand/orclustering,anewini-tializationbasedoncombiningsparsecodingwithspectralclusteringisproposed.Thisinitializationclustersthedic-tionaryatoms,andthereforeisbasedonsolvingalowdi-mensionaleigen-decompositionproblem,beingapplicabletolargedatasets.We rstillustratetheproposedframeworkwithexamplesonstandardimageandspeechdatasetsinthesupervisedclassi cationsetting,obtainingresultscompa-rabletothestate-of-the-artwiththissimpleapproach.Wethenpresentexperimentsforfullyunsupervisedclusteringonextendedstandarddatasetsandtextureimages,obtain-ingexcellentperformance.

dueinparttothefactthatanimportantvarietyofsignalssuchasaudioandnaturalimagescanbewellapproximatedbyalinearcombinationofafewelements(atoms)ofsome(often)redundantbasis,usuallycalleddictionaries[2].Sparsemodelingaimsatlearningthesenonparametricdictionariesfromthedataitself.Severalalgorithmshavebeendevelopedforthistask,e.g.,theK-SVDandthemethodofoptimaldirections(MOD).Recentpublicationsinawidespectrumofsignalsandapplicationshaveshownthatthisapproachcanbeverysuccessful,leadingtostate-of-theartresults,e.g.,inimagerestorationanddenoising,texturesynthesis,andtextureclassi cation.Inthesupervisedorweaklysupervisedclassi cationsetting,thisclassofalgo-rithmslearndictionariesfromthelabeledtrainingdatasetandusefeaturesofthesparsedecompositionofthetestingsignalforclassi cation(see[14,17,22,34]).

Inthispaperweproposeaframeworkforclusteringdatasetsthatarewellrepresentedinthesparsemodelingframeworkwithasetoflearneddictionaries(see[26]forourearlierworkinthisdirection).GivenKclusters,welearnKdictionariesforrepresentingthedata,andthenas-sociateeachsignaltothedictionaryforwhichthe“best”sparsedecompositionisobtained.Notethatitisnotthateachdatapointbelongstoaunionofsubspacesasforex-amplein[7,10].Comparingwithblock/groupsparsity,hereasingledictionary(block)isselectedperdatapoint,andthepointissparselyrepresented(subspace)withatomsonlyfromthisdictionary.1Alsoincontrastwithmoreclassicalsubspaceclustering,datapointsinthesameclasscanbe-longtomorethanonesubspace,sinceeachdictionaryrep-resentsalargenumberofsubspaces(eachsparsitypatternde nesonesubspace).Themodelisthenveryrichandnon-linear.

The rstbuildingblockoftheproposedclusteringframe-workisbasedonconsidering

min

K i=1xj∈Ci

1.IntroductionandBasicFormulation

Inrecentyears,sparserepresentationshavereceivedalot

ofattentionfromthesignalprocessingcommunity.Thisis

IR

1Sharing

Di,Ci

R(xj,Di),(1)

andPScontributedequally.

atomsbetweentheclasses,andthereforehavingnon-empty

intersectingsubspacesispermittedinourframeworkaswell,seeSec-tion3.1

1

第1页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email