Domain adaptation for reinforcement learning on the Atari

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deep Reinforcement learning is a powerful machine learning paradigm that has had significant success across a wide range of control problems. This success often requires long training times to achieve. Observing that many problems share similarities, it is likely that much of the training done could be redundant if knowledge could be efficiently and appropriately shared across tasks. In this paper we demonstrate a novel adversarial domain adaptation approach to transfer state knowledge between domains and tasks on the Atari game suite. We show how this approach can successfully transfer across very different visual domains of the Atari platform. We focus on semantically related games that involve returning a ball with the user controlled agent. Our experiments demonstrate that our method reduces the number of samples required to successfully train an agent to play an Atari game.

Original languageEnglish
Title of host publication18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019
PublisherACM
Pages1859-1861
Number of pages3
ISBN (Electronic)9781510892002
ISBN (Print)978-1-4503-6309-9
Publication statusPublished - 8 May 2019
Event18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019 - Montreal, Canada
Duration: 13 May 201917 May 2019

Publication series

NameProceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS
Volume4
ISSN (Print)1548-8403
ISSN (Electronic)1558-2914

Conference

Conference18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019
CountryCanada
CityMontreal
Period13/05/1917/05/19

Fingerprint

Reinforcement learning
Learning systems
Experiments

Bibliographical note

© 2019 International Foundation for Autonomous Agents and
Multiagent Systems (www.ifaamas.org).

Keywords

  • Deep learning
  • Domain adaptation
  • Reinforcement learning

Cite this

Carr, T., Chli, M., & Vogiatzis, G. (2019). Domain adaptation for reinforcement learning on the Atari. In 18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019 (pp. 1859-1861). (Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS; Vol. 4). ACM.
Carr, Thomas ; Chli, Maria ; Vogiatzis, George. / Domain adaptation for reinforcement learning on the Atari. 18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019. ACM, 2019. pp. 1859-1861 (Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS).
@inproceedings{02c3c8197a6a4ce49d1fe85bfc44ad3b,
title = "Domain adaptation for reinforcement learning on the Atari",
abstract = "Deep Reinforcement learning is a powerful machine learning paradigm that has had significant success across a wide range of control problems. This success often requires long training times to achieve. Observing that many problems share similarities, it is likely that much of the training done could be redundant if knowledge could be efficiently and appropriately shared across tasks. In this paper we demonstrate a novel adversarial domain adaptation approach to transfer state knowledge between domains and tasks on the Atari game suite. We show how this approach can successfully transfer across very different visual domains of the Atari platform. We focus on semantically related games that involve returning a ball with the user controlled agent. Our experiments demonstrate that our method reduces the number of samples required to successfully train an agent to play an Atari game.",
keywords = "Deep learning, Domain adaptation, Reinforcement learning",
author = "Thomas Carr and Maria Chli and George Vogiatzis",
note = "{\circledC} 2019 International Foundation for Autonomous Agents and Multiagent Systems (www.ifaamas.org).",
year = "2019",
month = "5",
day = "8",
language = "English",
isbn = "978-1-4503-6309-9",
series = "Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS",
publisher = "ACM",
pages = "1859--1861",
booktitle = "18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019",
address = "United States",

}

Carr, T, Chli, M & Vogiatzis, G 2019, Domain adaptation for reinforcement learning on the Atari. in 18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019. Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS, vol. 4, ACM, pp. 1859-1861, 18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019, Montreal, Canada, 13/05/19.

Domain adaptation for reinforcement learning on the Atari. / Carr, Thomas; Chli, Maria; Vogiatzis, George.

18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019. ACM, 2019. p. 1859-1861 (Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS; Vol. 4).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Domain adaptation for reinforcement learning on the Atari

AU - Carr, Thomas

AU - Chli, Maria

AU - Vogiatzis, George

N1 - © 2019 International Foundation for Autonomous Agents and Multiagent Systems (www.ifaamas.org).

PY - 2019/5/8

Y1 - 2019/5/8

N2 - Deep Reinforcement learning is a powerful machine learning paradigm that has had significant success across a wide range of control problems. This success often requires long training times to achieve. Observing that many problems share similarities, it is likely that much of the training done could be redundant if knowledge could be efficiently and appropriately shared across tasks. In this paper we demonstrate a novel adversarial domain adaptation approach to transfer state knowledge between domains and tasks on the Atari game suite. We show how this approach can successfully transfer across very different visual domains of the Atari platform. We focus on semantically related games that involve returning a ball with the user controlled agent. Our experiments demonstrate that our method reduces the number of samples required to successfully train an agent to play an Atari game.

AB - Deep Reinforcement learning is a powerful machine learning paradigm that has had significant success across a wide range of control problems. This success often requires long training times to achieve. Observing that many problems share similarities, it is likely that much of the training done could be redundant if knowledge could be efficiently and appropriately shared across tasks. In this paper we demonstrate a novel adversarial domain adaptation approach to transfer state knowledge between domains and tasks on the Atari game suite. We show how this approach can successfully transfer across very different visual domains of the Atari platform. We focus on semantically related games that involve returning a ball with the user controlled agent. Our experiments demonstrate that our method reduces the number of samples required to successfully train an agent to play an Atari game.

KW - Deep learning

KW - Domain adaptation

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=85076819077&partnerID=8YFLogxK

UR - https://dl.acm.org/doi/10.5555/3306127.3331943

M3 - Conference contribution

AN - SCOPUS:85076819077

SN - 978-1-4503-6309-9

T3 - Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

SP - 1859

EP - 1861

BT - 18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019

PB - ACM

ER -

Carr T, Chli M, Vogiatzis G. Domain adaptation for reinforcement learning on the Atari. In 18th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019. ACM. 2019. p. 1859-1861. (Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS).