Abstract. Aliasing environments present the tasks of increased difficulty for Learning Classifier Systems. Aliasing squares look identical for an agent with limited perceptive power, but may demand a completely different optimal strategy. Thus, the presenc
2Relatedwork
TheoriginalversionofLCSwasproposedbyJohnHollandin1978[7].Wilson
[23]simpli edtheoriginalframeworkandintroducedZCSwithQ-learninglikedistributionofthereward,andXCS[24],where tnessofaclassi erdependedontheaccuracyoftheclassi er’spredictioninsteadofthepredictionitself.TomlinsonandBull[19,20]developedCorporateClassi erSystems,introducingZCSandXCSwithMichigan-styleclassi ers.RecentlyBull[1]presentedhisnewYCS,aSimpleAccuracy-basedLearningClassi erSystem,thatkeptmuchofWilson’sframework,butwassimpli edtoincreaseunderstandability.
AgentPbelongstotheclassofpredictivemodellingtrendinLCS.In1990Holland[6]presentedageneralframeworkforincorporatingfuturestatepredic-tionsintoLCSusingatagsystem.In1998Stolzmann[17]combinedtheLCSframeworkwiththeanticipatorybehaviourcontrolmechanism[5]andintro-ducedalearningsystemwiththenextstaterepresentationcalledAnticipatoryClassi erSystem.LaterBull[2]incorporatedlookaheadinZCS.
Asanapproachtotheproblemofperceptualaliasing,internalmemorywasaddedtoZCS[4]andXCS[8,10].Anotherapproachintheformofclassi erswithbehaviouralsequenceswasfoundbyStolzmann[16]andinvestigatedbyMetivierandLattaud[13].
ThemaindistinctionsoftheAgentPsystemfromtheotherLCSarediscussedinSection4.
3Associativeperceptionlearningmodel
ReinforcementLearningisapartofthemachinelearningresearchthathasinheritedideasfromthepsychologicaltheoryofanimallearningproposedbyThorndike[18].HislearningtheoryrepresentstheoriginalS-R(stimulus-response)frameworkofthebehavioralpsychology.Accordingtothetheory,learningistheresultoftheconnectionsformedbetweenstimuliandresponses.Suchconnec-tionsbecomestrengthenedorweakenedbythenatureandfrequencyoftheS-Rpairings.TheparadigmforS-Rtheoryistrial-and-errorlearninginwhichcertainresponsescometodominateothersbecauseofrewards.Theproposedlearningmodelofassociativeperceptionisbasedontwofurtherpsychologicalprinciples:lawsoforganizationandimprinting.
LawsofOrganization.EarlyintheXXcenturyMaxWertheimerandotherscreatedtheGestalttheory[22],whichemphasizedhigher-ordercognitiveprocesses.ThefocusoftheGestalttheorywastheideaofgrouping,whenchar-acteristicsofstimulicauseanindividualtostructureorinterpretavisual eldorproblemasaglobalconstruct.Therulesofinterpretationmaytakeseveralforms,suchasgroupingbyproximity,similarity,closure,etc.Thesefactorswerecalledthelawsoforganizationandwereexplainedinthecontextofperceptionandproblem-solving.
Imprinting.Imprintingisanespeciallyrapidandrelativelyirreversiblelearningprocess rstobservedanddescribedbyKonradLorenz[11].Inthe
AUTO-ASSOCIATIVE NEURAL NETWORK SYSTEM FOR ...classifier which the outputs depend on the inputs...Autoencoder networks with self-supervised learning ...
ABSTRACT An Associative ... 暂无评价 6页 免费... The perception of melodi... 18页 免费 The A...We then queried the classifier with the second ...
ABSTRACT An Associative ... 暂无评价 6页 免费... The perception of melodi... 18页 免费 The A...We then queried the classifier with the second ...
热门文档