online learning 的工程实现的论文
AdClickPrediction:aViewfromtheTrenches
H.BrendanMcMahan,GaryHolt,D.Sculley,MichaelYoung,
DietmarEbner,JulianGrady,LanNie,ToddPhillips,EugeneDavydov,
DanielGolovin,SharatChikkerur,DanLiu,MartinWattenberg,
ArnarMarHrafnkelsson,TomBoulos,JeremyKubica
Google,Inc.
mcmahan@google.com,gholt@google.com,dsculley@google.com
ABSTRACT
Predictingadclick–throughrates(CTR)isamassive-scalelearningproblemthatiscentraltothemulti-billiondollaronlineadvertisingindustry.WepresentaselectionofcasestudiesandtopicsdrawnfromrecentexperimentsinthesettingofadeployedCTRpredictionsystem.Theseincludeimprovementsinthecontextoftraditionalsupervisedlearn-ingbasedonanFTRL-Proximalonlinelearningalgorithm(whichhasexcellentsparsityandconvergenceproperties)andtheuseofper-coordinatelearningrates.
Wealsoexploresomeofthechallengesthatariseinareal-worldsystemthatmayappearat rsttobeoutsidethedomainoftraditionalmachinelearningresearch.Theseincludeusefultricksformemorysavings,methodsforas-sessingandvisualizingperformance,practicalmethodsforprovidingcon denceestimatesforpredictedprobabilities,calibrationmethods,andmethodsforautomatedmanage-mentoffeatures.Finally,wealsodetailseveraldirectionsthatdidnotturnouttobebene cialforus,despitepromis-ingresultselsewhereintheliterature.Thegoalofthispaperistohighlightthecloserelationshipbetweentheoreticalad-vancesandpracticalengineeringinthisindustrialsetting,andtoshowthedepthofchallengesthatappearwhenap-plyingtraditionalmachinelearningmethodsinacomplexdynamicsystem.
CategoriesandSubjectDescriptors
I.5.4[ComputingMethodologies]:PatternRecognition—Applications
Keywords
onlineadvertising,datamining,large-scalelearning
1.INTRODUCTION
Onlineadvertisingisamulti-billiondollarindustrythathasservedasoneofthegreatsuccessstoriesformachine
Permissiontomakedigitalorhardcopiesofpartorallofthisworkforpersonalorclassroomuseisgrantedwithoutfeeprovidedthatcopiesarenotmadeordistributedforpro torcommercialadvantageandthatcopiesbearthisnoticeandthefullcitationonthe rstpage.Copyrightsforthird-partycomponentsofthisworkmustbehonored.Forallotheruses,contacttheowner/author(s).
KDD’13,August11–14,2013,Chicago,Illinois,USA.Copyright2013ACM978-1-4503-2174-7/13/08...$15.00.
learning.Sponsoredsearchadvertising,contextualadvertis-ing,displayadvertising,andreal-timebiddingauctionshaveallreliedheavilyontheabilityoflearnedmodelstopredictadclick–throughratesaccurately,quickly,andreliably[28,15,33,1,16].Thisproblemsettinghasalsopushedthe eldtoaddressissuesofscalethatevenadecadeagowouldhavebeenalmostinconceivable.Atypicalindustrialmodelmayprovidepredictionsonbillionsofeventsperday,usingacorrespondinglylargefeaturespace,andthenlearnfromtheresultingmassofdata.
Inthispaper,wepresentaseriesofcasestudiesdrawnfromrecentexperimentsinthesettingofthedeployedsys-temusedatGoogletopredictadclick–throughratesforsponsoredsearchadvertising.Becausethisproblemsettingisnowwellstudied,wechoosetofocusonaseriesoftopicsthathavereceivedlessattentionbutareequallyimportantinaworkingsystem.Thus,weexploreissuesofmemorysavings,performanceanalysis,con denceinpredictions,cal-ibration,andfeaturemanagementwiththesamerigorthatistraditionallygiventotheproblemofdesigningane ec-tivelearningalgorithm.Thegoalofthispaperistogivethereaderasenseofthedepthofchallengesthatariseinrealindustrialsettings,aswellastosharetricksandinsightsthatmaybeappliedtootherlarge-scaleproblemareas.
2.BRIEFSYSTEMOVERVIEW
Whenauserdoesasearchq,aninitialsetofcandidateadsismatchedtothequeryqbasedonadvertiser-chosenkeywords.Anauctionmechanismthendetermineswhethertheseadsareshowntotheuser,whatordertheyareshownin,andwhatpricestheadvertiserspayiftheiradisclicked.Inadditiontotheadvertiserbids,animportantinputtotheauctionis,foreachada,anestimateofP(click|q,a),theprobabilitythattheadwillbeclickedifitisshown.
Thefeaturesusedinoursystemaredrawnfromavari-etyofsources,includingthequery,thetextoftheadcre-ative,andvariousad-relatedmetadata.Datatendstobeextremelysparse,withtypicallyonlyatinyfractionofnon-zerofeaturevaluesperexample.
Methodssuchasregularizedlogisticregressionareanat-ural tforthisproblemsetting.Itisnecessarytomakepredictionsmanybillionsoftimesperdayandtoquicklyupdatethemodelasnewclicksandnon-clicksareobserved.Ofcourse,thisdataratemeansthattrainingdatasetsareenormous.DataisprovidedbyastreamingservicebasedonthePhotonsystem–see[2]forafulldiscussion.
Becauselarge-scalelearninghasbeensowellstudiedinrecentyears(see[3],forexample)wedonotdevotesignif-
A Web Page Prediction Model Based on Click-Stream Tree Representation of User Behavior Sule Gunduz ? ¨¨ Computer Engineering Department Istanbul Technical ...
Scrum And Xp From The Trenches_IT/计算机_专业资料。Scrum And Xp From The...Ad Click Prediction a ... 9页 免费 Scientific Discovery A... 暂无评价 ...
A Web Page Prediction Model Based on Click-Stream Tree Representation of User Behavior Sule Gunduz ? ¨¨ Computer Engineering Department Istanbul Technical ...
热门文档