Distributed adaptive control

A proposal on the neuronal organization of adaptive goal oriented behavior

Armin Duff, César Rennó-Costa, Encarni Marcos, Andre L. Luvizotto, Andrea Giovannucci, Marti Sanchez-Fibla, Ulysses Bernardet, Paul F.M.J. Verschure

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In behavioral motor coordination and interaction it is a fundamental challenge how an agent can learn to perceive and act in unknown and dynamic environments. At present, it is not clear how an agent can - without any explicitly predefined knowledge - acquire internal representations of the world while interacting with the environment. To meet this challenge, we propose a biologically based cognitive architecture called Distributed Adaptive Control (DAC). DAC is organized in three different, tightly coupled, layers of control: reactive, adaptive and contextual. DAC based systems are self-contained and fully grounded, meaning that they autonomously generate representations of their primary sensory inputs, hence bootstrapping their behavior form simple to advance interactions. Following this approach, we have previously identified a novel environmentally mediated feedback loop in the organization of perception and behavior, i.e. behavioral feedback. Additionally, we could demonstrated that the dynamics of the memory structure of DAC, acquired during a foraging task, are equivalent to a Bayesian description of foraging. In this chapter we present DAC in a concise form and show how it is allowing us to extend the different subsystems to more biophysical detailed models. These further developments of the DAC architecture, not only allow to better understand the biological systems, but moreover advance DACs behavioral capabilities and generality.

Original languageEnglish
Title of host publicationFrom Motor Learning to Interaction Learning in Robots
EditorsOliver Sigaud, Jan Peters, Jan Peters
PublisherSpringer
Pages15-41
Number of pages27
ISBN (Print)9783642051807
DOIs
Publication statusPublished - 19 Jan 2010

Publication series

NameStudies in Computational Intelligence
Volume264
ISSN (Print)1860-949X

Fingerprint

Feedback
Biological systems
Data storage equipment

Cite this

Duff, A., Rennó-Costa, C., Marcos, E., Luvizotto, A. L., Giovannucci, A., Sanchez-Fibla, M., ... Verschure, P. F. M. J. (2010). Distributed adaptive control: A proposal on the neuronal organization of adaptive goal oriented behavior. In O. Sigaud, J. Peters, & J. Peters (Eds.), From Motor Learning to Interaction Learning in Robots (pp. 15-41). (Studies in Computational Intelligence; Vol. 264). Springer. https://doi.org/10.1007/978-3-642-05181-4_2
Duff, Armin ; Rennó-Costa, César ; Marcos, Encarni ; Luvizotto, Andre L. ; Giovannucci, Andrea ; Sanchez-Fibla, Marti ; Bernardet, Ulysses ; Verschure, Paul F.M.J. / Distributed adaptive control : A proposal on the neuronal organization of adaptive goal oriented behavior. From Motor Learning to Interaction Learning in Robots. editor / Oliver Sigaud ; Jan Peters ; Jan Peters. Springer, 2010. pp. 15-41 (Studies in Computational Intelligence).
@inproceedings{81c2bbbaa92042838d7526b90a3504f6,
title = "Distributed adaptive control: A proposal on the neuronal organization of adaptive goal oriented behavior",
abstract = "In behavioral motor coordination and interaction it is a fundamental challenge how an agent can learn to perceive and act in unknown and dynamic environments. At present, it is not clear how an agent can - without any explicitly predefined knowledge - acquire internal representations of the world while interacting with the environment. To meet this challenge, we propose a biologically based cognitive architecture called Distributed Adaptive Control (DAC). DAC is organized in three different, tightly coupled, layers of control: reactive, adaptive and contextual. DAC based systems are self-contained and fully grounded, meaning that they autonomously generate representations of their primary sensory inputs, hence bootstrapping their behavior form simple to advance interactions. Following this approach, we have previously identified a novel environmentally mediated feedback loop in the organization of perception and behavior, i.e. behavioral feedback. Additionally, we could demonstrated that the dynamics of the memory structure of DAC, acquired during a foraging task, are equivalent to a Bayesian description of foraging. In this chapter we present DAC in a concise form and show how it is allowing us to extend the different subsystems to more biophysical detailed models. These further developments of the DAC architecture, not only allow to better understand the biological systems, but moreover advance DACs behavioral capabilities and generality.",
author = "Armin Duff and C{\'e}sar Renn{\'o}-Costa and Encarni Marcos and Luvizotto, {Andre L.} and Andrea Giovannucci and Marti Sanchez-Fibla and Ulysses Bernardet and Verschure, {Paul F.M.J.}",
year = "2010",
month = "1",
day = "19",
doi = "10.1007/978-3-642-05181-4_2",
language = "English",
isbn = "9783642051807",
series = "Studies in Computational Intelligence",
publisher = "Springer",
pages = "15--41",
editor = "Oliver Sigaud and Jan Peters and Jan Peters",
booktitle = "From Motor Learning to Interaction Learning in Robots",
address = "Germany",

}

Duff, A, Rennó-Costa, C, Marcos, E, Luvizotto, AL, Giovannucci, A, Sanchez-Fibla, M, Bernardet, U & Verschure, PFMJ 2010, Distributed adaptive control: A proposal on the neuronal organization of adaptive goal oriented behavior. in O Sigaud, J Peters & J Peters (eds), From Motor Learning to Interaction Learning in Robots. Studies in Computational Intelligence, vol. 264, Springer, pp. 15-41. https://doi.org/10.1007/978-3-642-05181-4_2

Distributed adaptive control : A proposal on the neuronal organization of adaptive goal oriented behavior. / Duff, Armin; Rennó-Costa, César; Marcos, Encarni; Luvizotto, Andre L.; Giovannucci, Andrea; Sanchez-Fibla, Marti; Bernardet, Ulysses; Verschure, Paul F.M.J.

From Motor Learning to Interaction Learning in Robots. ed. / Oliver Sigaud; Jan Peters; Jan Peters. Springer, 2010. p. 15-41 (Studies in Computational Intelligence; Vol. 264).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Distributed adaptive control

T2 - A proposal on the neuronal organization of adaptive goal oriented behavior

AU - Duff, Armin

AU - Rennó-Costa, César

AU - Marcos, Encarni

AU - Luvizotto, Andre L.

AU - Giovannucci, Andrea

AU - Sanchez-Fibla, Marti

AU - Bernardet, Ulysses

AU - Verschure, Paul F.M.J.

PY - 2010/1/19

Y1 - 2010/1/19

N2 - In behavioral motor coordination and interaction it is a fundamental challenge how an agent can learn to perceive and act in unknown and dynamic environments. At present, it is not clear how an agent can - without any explicitly predefined knowledge - acquire internal representations of the world while interacting with the environment. To meet this challenge, we propose a biologically based cognitive architecture called Distributed Adaptive Control (DAC). DAC is organized in three different, tightly coupled, layers of control: reactive, adaptive and contextual. DAC based systems are self-contained and fully grounded, meaning that they autonomously generate representations of their primary sensory inputs, hence bootstrapping their behavior form simple to advance interactions. Following this approach, we have previously identified a novel environmentally mediated feedback loop in the organization of perception and behavior, i.e. behavioral feedback. Additionally, we could demonstrated that the dynamics of the memory structure of DAC, acquired during a foraging task, are equivalent to a Bayesian description of foraging. In this chapter we present DAC in a concise form and show how it is allowing us to extend the different subsystems to more biophysical detailed models. These further developments of the DAC architecture, not only allow to better understand the biological systems, but moreover advance DACs behavioral capabilities and generality.

AB - In behavioral motor coordination and interaction it is a fundamental challenge how an agent can learn to perceive and act in unknown and dynamic environments. At present, it is not clear how an agent can - without any explicitly predefined knowledge - acquire internal representations of the world while interacting with the environment. To meet this challenge, we propose a biologically based cognitive architecture called Distributed Adaptive Control (DAC). DAC is organized in three different, tightly coupled, layers of control: reactive, adaptive and contextual. DAC based systems are self-contained and fully grounded, meaning that they autonomously generate representations of their primary sensory inputs, hence bootstrapping their behavior form simple to advance interactions. Following this approach, we have previously identified a novel environmentally mediated feedback loop in the organization of perception and behavior, i.e. behavioral feedback. Additionally, we could demonstrated that the dynamics of the memory structure of DAC, acquired during a foraging task, are equivalent to a Bayesian description of foraging. In this chapter we present DAC in a concise form and show how it is allowing us to extend the different subsystems to more biophysical detailed models. These further developments of the DAC architecture, not only allow to better understand the biological systems, but moreover advance DACs behavioral capabilities and generality.

UR - http://www.scopus.com/inward/record.url?scp=74049143901&partnerID=8YFLogxK

UR - https://link.springer.com/chapter/10.1007%2F978-3-642-05181-4_2

U2 - 10.1007/978-3-642-05181-4_2

DO - 10.1007/978-3-642-05181-4_2

M3 - Conference contribution

SN - 9783642051807

T3 - Studies in Computational Intelligence

SP - 15

EP - 41

BT - From Motor Learning to Interaction Learning in Robots

A2 - Sigaud, Oliver

A2 - Peters, Jan

A2 - Peters, Jan

PB - Springer

ER -

Duff A, Rennó-Costa C, Marcos E, Luvizotto AL, Giovannucci A, Sanchez-Fibla M et al. Distributed adaptive control: A proposal on the neuronal organization of adaptive goal oriented behavior. In Sigaud O, Peters J, Peters J, editors, From Motor Learning to Interaction Learning in Robots. Springer. 2010. p. 15-41. (Studies in Computational Intelligence). https://doi.org/10.1007/978-3-642-05181-4_2