In one-dimensional density estimation on i.i.d. observations we suggest an adaptive cross-validation technique for the selection of a kernel estimator. This estimator is both asymptotic MISE-efficient with respect to the monotone oracle, and sharp minimax-
monotoneoraclebytheuseofkernelfunctionswithpiecewiseconstantFouriertransform.Themonotoneoracleisapseudo-estimator,whichminimizesthequadraticrisk(MISE)overtheclassofallkernelfunctions,whoseFouriertransformisreal,symmetricanddecreasesmonotonouslyonR+.
Whenconsideringtheconceptofcurvesmoothingfromtheviewpointofsignalrecogni-tion,amonotoneFouriertransformappearstobeanaturalassumptiontoakernel.Giventhattheunknowndensityissquare-integrable,itisequivalentwithrespecttoMISEeithertoestimatethedensityitselfortoreconstructitfromanestimateofitsFouriertransform.Ontheotherhanditisknownthatwithincreasingfrequency,randomin uencesoverbal-ancethetruevalueintheempiricalFouriertransform.Forthisreason,theFourierseriesprojectionestimatoromitsempiricalFouriercoe cientsbeyondacriticalfrequency.InthefamousPinsker- lter,therigidcut-o isweakenedtoamonotoneshrinkageoftheunreliablecoe cientsbythePinsker-wheights.Thefocusonkernelswithmonotonouslydecreasing,butotherwisearbitraryFouriertransformisjustafurthergeneralizationofthethisnotion.
Theobjectiveofthepresentworkistoproposeapurelydatadependentestimatorthatapproximatesthemonotoneoracleinanexactoracleinequality.IncomparisontoRigollet(2004),weabandontheassumptionofthekernel’spiecewiseconstantFouriertransform,ourkernelsonlybeingband-limitedto[ n,n]andhavingamonotoneFouriertransform.AsymptoticexactMISE-e ciencyisshowntoholdoverthesetofallbounded,L2-integrabledensities,whicharenotin nitelydi erenciable.Sharpasymptoticminimax-adaptivityonthewholescaleofSobolevspaceswithsmoothnessindexgreaterthan1/2followsautomatically.
Thereareessentiallytwoquantitiestodeterminethestatementofanoracleinequality:thesetofestimatorsdisposabletotheminimizationofrisk;andthesetoftrueparameters,overwhichtheoracleinequalityissupposedtohold.Evidently,thelargerthesesets,thestrongertheoracleinequality.Inanon-parametricsetting,regularityconditionsarethenaturalwaytospecifythespaceofparameters.Classesofestimatorsconsideredhavebeenquitediverseandcovermanyfamiliarnon-parametricestimationmethods.However,alltheclasses,forwhichoracleinequalitieswereprovensofar,shareanimportantproperty–whether xedorgrowingwiththenumberofobservations,theirdimensionis nite.
Thisisnatural,whendealingwithwaveletorFouriercoe cients.InorderedlinearsmoothersandblockwiseStein’smethod,theassumptions“ordered”and“blockwise”,respec-tively,assurethe nitedimensionality.Forpenalizedleastsquarsestimators,thedimensionisalwaysexplicitlydetermined.
Notethatoracleinequalitiesrelyonspecialconcentrationinequalities,becauseitisnec-essarytoapproximatethemaximumofanempiricalprocessindexedbyaclassoffunctions;functionallimittheoremsareimperative.With nitedimensionwehaveaccesstotheuni-formentropyoftheestimatorclassandchainingargumentsprovideuswithasuitableboundfortheprocess.Yettheseapproximationsunavoidablycontainthefactordimensioninonewayoranother.
EstimatorsindexedbykernelswithmonotoneFouriertransformisaclassthathasobvi-ouslynot nitedimension.Butitisknownthatthesetofmonotonefunctionsalsoallowsforanapproximationofitsuniformcoveringnumber.Unfortunately,theapproximationsdonotcarryoverfromtheFouriertothespacedomain.Andsothechainingapproachisobstructedtous.
Instead,wepursueanalternativewaytoapproximateourempiricalprocess,namelyanadditivedecomposition.Theprocess,indexedbytheclassofkernels,isdecomposedintoalinearcombinationofcountablymanybasisprocesses.Separateargumentsasregardsthebasisprocesses(exponentialinequalities)andthesizeofthenon-randomcoe cientsare
2
Exact oracle inequality ... 暂无评价 20页 免费 Adaptive, multi-paramete.... A Variant of EFICA Algorithm with Adaptive Parametric Density Estimator ...
Exact oracle inequality ... 暂无评价 20页 免费...WAVELET DENSITY ESTIMATOR FOR STOCHASTIC PROCESSES ?...We provide an adaptive version of the algorithm,...
高线 absolute inequality 绝不等式 ambiguous case ...取值至 consistent estimator 相容估计量 correlation ...exact 真确 energy 能; 能量 exact differential ...
Exact oracle inequality ... 暂无评价 20页 免费...WAVELET DENSITY ESTIMATOR FOR STOCHASTIC PROCESSES ?...We provide an adaptive version of the algorithm,...
热门文档