Coevolutionary learning of neuromodulated controllers for multi-stage and gamified tasks

Chloe M. Barnes*, Aniko Ekart, Kai Olav Ellefsen, Kyrre Glette, Peter R. Lewis, Jim Torresen

*Corresponding author for this work

Research output: Chapter in Book/Published conference outputConference publication

Abstract

Neural networks have been widely used in agent learning architectures; however, learning multiple context dependent tasks simultaneously or sequentially is problematic when using them. Behavioural plasticity enables humans and animals alike to respond to changes in context and environmental stimuli, without degrading learnt knowledge; this can be achieved by regulating behaviour with neuromodulation - a biological process found in the brain. We demonstrate that modulating activity-propagating signals when evolving neural networks enables agents to learn context-dependent and multi-stage tasks more easily. Further, we show that this benefit is preserved when agents occupy an environment shared with other neuromodulated agents. Additionally we show that neuromodulation helps agents that have evolved alone to adapt to changes in environmental stimuli when they continue to evolve in a shared environment.

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems, ACSOS 2020
EditorsEsam El-Araby, Sven Tomforde, Timothy Wood, Pradeep Kumar, Claudia Raibulet, Ioan Petri, Gabriele Valentini, Phyllis Nelson, Barry Porter
PublisherIEEE
Pages129-138
Number of pages10
ISBN (Electronic)9781728172774
DOIs
Publication statusPublished - 15 Sep 2020
Event1st IEEE International Conference on Autonomic Computing and Self-Organizing Systems, ACSOS 2020 - Virtual, Washington, United States
Duration: 17 Aug 202021 Aug 2020

Publication series

NameProceedings - 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems, ACSOS 2020

Conference

Conference1st IEEE International Conference on Autonomic Computing and Self-Organizing Systems, ACSOS 2020
CountryUnited States
CityVirtual, Washington
Period17/08/2021/08/20

Fingerprint

Dive into the research topics of 'Coevolutionary learning of neuromodulated controllers for multi-stage and gamified tasks'. Together they form a unique fingerprint.

Cite this