Evolving Neuromodulated Controllers in Variable Environments

Chloe M Barnes; Anikó Ekárt; Kai Olav Ellefsen; Kyrre Glette; Peter R Lewis; Jim Tørresen

doi:10.1109/ACSOS52086.2021.00037

Evolving Neuromodulated Controllers in Variable Environments

Chloe M Barnes, Anikó Ekárt, Kai Olav Ellefsen, Kyrre Glette, Peter R Lewis, Jim Tørresen

Research output: Chapter in Book/Published conference output › Conference publication

Abstract

Modern technical systems are increasingly composed of heterogeneous components that are situated in variable environments. In nature, organisms can temporarily adapt their behaviour to novel stimuli with behavioural plasticity; this can be achieved with neuromodulation, a biological process that modulates synaptic activity in the brain. We explore how neuromodulation affects goal-achievement in evolved neural controllers for artificial agents in variable environments. As variability can arise from the actions of others, we show that the benefit of plasticity can increase with variability, as agents can temporarily change their phenotype within their lifetime. Further, we show that cooperation can emerge between plastic agents that cannot perceive one another in highly variable environments.

Original language	English
Title of host publication	2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)
Editors	Esam El-Araby, Vana Kalogeraki, Danilo Pianini, Frederic Lassabe, Barry Porter, Sona Ghahremani, Ingrid Nunes, Mohamed Bakhouya, Sven Tomforde
Publisher	IEEE
Pages	164-169
Number of pages	6
ISBN (Electronic)	978-1-6654-1261-2
ISBN (Print)	978-1-6654-2940-5
DOIs	https://doi.org/10.1109/ACSOS52086.2021.00037
Publication status	Published - 5 Jan 2022

Keywords

Evolution (biology)
Animals
Conferences
Biological processes
Rivers
Complexity theory
Plastics
neuromodulation
neuroevolution
evolutionary-algorithms
environmental-variability
behavioural-plasticity

Access to Document

10.1109/ACSOS52086.2021.00037

Cite this

Barnes, C. M., Ekárt, A., Ellefsen, K. O., Glette, K., Lewis, P. R., & Tørresen, J. (2022). Evolving Neuromodulated Controllers in Variable Environments. In E. El-Araby, V. Kalogeraki, D. Pianini, F. Lassabe, B. Porter, S. Ghahremani, I. Nunes, M. Bakhouya, & S. Tomforde (Eds.), 2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS) (pp. 164-169). IEEE. https://doi.org/10.1109/ACSOS52086.2021.00037

Barnes, Chloe M ; Ekárt, Anikó ; Ellefsen, Kai Olav et al. / Evolving Neuromodulated Controllers in Variable Environments. 2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). editor / Esam El-Araby ; Vana Kalogeraki ; Danilo Pianini ; Frederic Lassabe ; Barry Porter ; Sona Ghahremani ; Ingrid Nunes ; Mohamed Bakhouya ; Sven Tomforde. IEEE, 2022. pp. 164-169

@inproceedings{7fd760dab85a47d795bd32c32e88d4f2,

title = "Evolving Neuromodulated Controllers in Variable Environments",

abstract = "Modern technical systems are increasingly composed of heterogeneous components that are situated in variable environments. In nature, organisms can temporarily adapt their behaviour to novel stimuli with behavioural plasticity; this can be achieved with neuromodulation, a biological process that modulates synaptic activity in the brain. We explore how neuromodulation affects goal-achievement in evolved neural controllers for artificial agents in variable environments. As variability can arise from the actions of others, we show that the benefit of plasticity can increase with variability, as agents can temporarily change their phenotype within their lifetime. Further, we show that cooperation can emerge between plastic agents that cannot perceive one another in highly variable environments.",

keywords = "Evolution (biology), Animals, Conferences, Biological processes, Rivers, Complexity theory, Plastics, neuromodulation, neuroevolution, evolutionary-algorithms, environmental-variability, behavioural-plasticity",

author = "Barnes, {Chloe M} and Anik{\'o} Ek{\'a}rt and Ellefsen, {Kai Olav} and Kyrre Glette and Lewis, {Peter R} and Jim T{\o}rresen",

year = "2022",

month = jan,

day = "5",

doi = "10.1109/ACSOS52086.2021.00037",

language = "English",

isbn = "978-1-6654-2940-5",

pages = "164--169",

editor = "Esam El-Araby and Vana Kalogeraki and Danilo Pianini and Frederic Lassabe and Barry Porter and Sona Ghahremani and Ingrid Nunes and Mohamed Bakhouya and Sven Tomforde",

booktitle = "2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)",

publisher = "IEEE",

address = "United States",

}

Barnes, CM , Ekárt, A, Ellefsen, KO, Glette, K, Lewis, PR & Tørresen, J 2022, Evolving Neuromodulated Controllers in Variable Environments. in E El-Araby, V Kalogeraki, D Pianini, F Lassabe, B Porter, S Ghahremani, I Nunes, M Bakhouya & S Tomforde (eds), 2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). IEEE, pp. 164-169. https://doi.org/10.1109/ACSOS52086.2021.00037

Evolving Neuromodulated Controllers in Variable Environments. / Barnes, Chloe M ; Ekárt, Anikó; Ellefsen, Kai Olav et al.
2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). ed. / Esam El-Araby; Vana Kalogeraki; Danilo Pianini; Frederic Lassabe; Barry Porter; Sona Ghahremani; Ingrid Nunes; Mohamed Bakhouya; Sven Tomforde. IEEE, 2022. p. 164-169.

Research output: Chapter in Book/Published conference output › Conference publication

TY - GEN

T1 - Evolving Neuromodulated Controllers in Variable Environments

AU - Barnes, Chloe M

AU - Ekárt, Anikó

AU - Ellefsen, Kai Olav

AU - Glette, Kyrre

AU - Lewis, Peter R

AU - Tørresen, Jim

PY - 2022/1/5

Y1 - 2022/1/5

N2 - Modern technical systems are increasingly composed of heterogeneous components that are situated in variable environments. In nature, organisms can temporarily adapt their behaviour to novel stimuli with behavioural plasticity; this can be achieved with neuromodulation, a biological process that modulates synaptic activity in the brain. We explore how neuromodulation affects goal-achievement in evolved neural controllers for artificial agents in variable environments. As variability can arise from the actions of others, we show that the benefit of plasticity can increase with variability, as agents can temporarily change their phenotype within their lifetime. Further, we show that cooperation can emerge between plastic agents that cannot perceive one another in highly variable environments.

AB - Modern technical systems are increasingly composed of heterogeneous components that are situated in variable environments. In nature, organisms can temporarily adapt their behaviour to novel stimuli with behavioural plasticity; this can be achieved with neuromodulation, a biological process that modulates synaptic activity in the brain. We explore how neuromodulation affects goal-achievement in evolved neural controllers for artificial agents in variable environments. As variability can arise from the actions of others, we show that the benefit of plasticity can increase with variability, as agents can temporarily change their phenotype within their lifetime. Further, we show that cooperation can emerge between plastic agents that cannot perceive one another in highly variable environments.

KW - Evolution (biology)

KW - Animals

KW - Conferences

KW - Biological processes

KW - Rivers

KW - Complexity theory

KW - Plastics

KW - neuromodulation

KW - neuroevolution

KW - evolutionary-algorithms

KW - environmental-variability

KW - behavioural-plasticity

UR - https://ieeexplore.ieee.org/document/9659502

UR - https://conf.researchr.org/home/acsos-2021

U2 - 10.1109/ACSOS52086.2021.00037

DO - 10.1109/ACSOS52086.2021.00037

M3 - Conference publication

SN - 978-1-6654-2940-5

SP - 164

EP - 169

BT - 2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)

A2 - El-Araby, Esam

A2 - Kalogeraki, Vana

A2 - Pianini, Danilo

A2 - Lassabe, Frederic

A2 - Porter, Barry

A2 - Ghahremani, Sona

A2 - Nunes, Ingrid

A2 - Bakhouya, Mohamed

A2 - Tomforde, Sven

PB - IEEE

ER -

Barnes CM , Ekárt A, Ellefsen KO, Glette K, Lewis PR, Tørresen J. Evolving Neuromodulated Controllers in Variable Environments. In El-Araby E, Kalogeraki V, Pianini D, Lassabe F, Porter B, Ghahremani S, Nunes I, Bakhouya M, Tomforde S, editors, 2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). IEEE. 2022. p. 164-169 doi: 10.1109/ACSOS52086.2021.00037

Evolving Neuromodulated Controllers in Variable Environments

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this