DeepBeliefNetworksforImageDenoisingMohammadAliKeyvanradMohammadPezeshki
Dept.ofComputerEngineeringandIT,Dept.ofComputerEngineeringandIT,AmirkabirUniversityofTechnology,AmirkabirUniversityofTechnology,
Tehran,IranTehran,Iran
keyvanrad@aut.ac.irm.pezeshki@aut.ac.ir
MohammadMehdiHomayounpour
Dept.ofComputerEngineeringandIT,
AmirkabirUniversityofTechnology,
Tehran,Iran
homayoun@aut.ac.ir
Abstract
DeepBeliefNetworkswhicharehierarchicalgenerativemodelsareeffectivetoolsforfeaturerepresentationandextraction.Furthermore,DBNscanbeusedinnu-merousaspectsofMachineLearningsuchasimagedenoising.Inthispaper,weproposeanovelmethodforimagedenoisingwhichreliesontheDBNs’abilityinfeaturerepresentation.Thisworkisbaseduponlearningofthenoisebehavior.Generally,featureswhichareextractedusingDBNsarepresentedasthevaluesofthelastlayernodes.WetrainaDBNawaythatthenetworktotallydistin-guishesbetweennodespresentingnoiseandnodespresentingimagecontentinthelastlaterofDBN,i.e.thenodesinthelastlayeroftrainedDBNaredividedintotwodistinctgroupsofnodes.Afterdetectingthenodeswhicharepresentingthenoise,weareabletomakethenoisenodesinactiveandreconstructanoise-lessimage.Insection4weexploretheresultsofapplyingthismethodontheMNISTdatasetofhandwrittendigitswhichiscorruptedwithadditivewhiteGaus-siannoise(AWGN).Areductionof65.9%inaveragemeansquareerror(MSE)wasachievedwhentheproposedmethodwasusedforthereconstructionofthenoisyimages.
1Introduction
Imagesignalsareoftencorruptedduetonoise.Removingnoisefromimageisanimportantissueincomputervision,becausethisstepcouldbethepreprocessingstepofmanyotherapplications.Uptonowvariousmethodshavebeenproposedtoremovenoise(denoise)fromvisualdata.FocusofmanyofthesemethodsisonFourierAnalysis[1],SpatialFiltering[2],andWaveletTransform
[3].AlsotherearesomeothermethodsbasedonSpareCodingandDictionaryLearning[4].Ontheotherhand,MachineLearningtoolssuchasConvolutionalNeuralNetworks(CNN)orDeepNeuralNetworks(DNN)havebeenusedinseveralpaperstotacklethisissue[5][6].Oneofthebiggestdif cultiesintrainingsuchdeepnetworksisthatthecostfunctionofsuchdeeparchitecturesgetsstuckinpoorlocaloptimaduetorandominitializationofweights.Hintonetal.[7]proposedanewgreedylayer-wisealgorithmtotacklethisissueandintroducedDeepBeliefNetworks(DBNs).DBNsareabletopresentagood”feature”representationofdata.Thesefeatureswhicharede nedasthepropertiesofinputdataarepresentedasnodesofthelastlayerofDBN.Asaresult,inthispaperwetrainaDBNsuchthatitlearnstoextractimagefeatures.ThetrainedDBNdistinguishesbetween”noisefeatures”and”cleanimagefeatures”inthelastlayerandpresentsthemintotwodistinctgroupsofnodes.Furthermore,DBNsarecapableofreconstructingtheinputdatabased
arXiv:1312.6158v2 [cs.LG] 2 Jan 2014
Image Denoising by Sparse Code Shrinkage Aapo Hyv rinen, Patrik Hoyer and Erkki Oja Neural Networks Research Centre Helsinki University of Technology P.O....
? ? ? ? Restricted Boltzmann machines Deep Belief Networks Denoising ...image 72 Convolutional RBM (CRBM) [Lee et al, ICML 2009] For “filter...
Deep Belief Network Ba... 暂无评价 11页 1下载券 喜欢此文档的还喜欢 ... Network Engineering for Complex Belief Networks Suzanne M. Mahoney Information...
Deep Belief Networks,作为 DBN 的 breakthrough 3.Deep Learning Algorithm 的...Denoising Auto-Encoders - easy steps into unsupervised pre-training for deep...
卷积深度信念网络ConvolutionalDeepBeliefNetworks_计算机软件及应用_IT/计算机_...For each column: (top) input image. (middle) reconstruction from the ...
Deep belief nets Stacked denoising auto-encoders ...Matching Using Sparse Coding for Image ...Y. Ng. Convolutional deep belief networks for ...
Deep Belief Networks Denoising Autoencoders K-means Spatial pyramids / ...a fast computer (for learning 25 features from 10000 8x8 image patches)....
widely applied to image fusion[4], segmentation[5] and image denoising[6]...for Boundary and Surface Representation, " Neural Networks, vol.8, pp.1005...
(sparse/denoising) Autoencoder Sparse Coding SHALLOW SP Deep Belief Net ... Visualizing and Understanding Convolutional Networks, arXiv 1311.2901, 2013 6...
Loopy belief propagation and probabilistic image processing,” Neural Networks for Signal P_专业资料。Abstract. The hyperparameter estimation in the ...
热门文档