Towards Model-Driven Self-Explanation for Autonomous Decision-Making Systems

Owen Reynolds

Research output: Chapter in Book/Report/Conference proceedingConference publication

Abstract

The ability for systems to make decisions by themselves is increasing with advances in different areas of AI such as machine learning and optimisation techniques for autonomous systems among other. Humans are handing over more decisions to systems that provide no explanations for their judgements unless they are enabled explicitly in their design. Trust based on a program being well written and tested correctly is not appropriate for AI-based autonomous systems. Unlike traditional software, this new software increasingly exhibit emergent behaviours making it unpredictable due to unexpected situations. Self-explanation is sometimes implemented, tracking decisions to give explanations to users. A more consistent, proven approach to self-explanation would be needed for making trustable systems. The paper proposes a research agenda to define an architecture to enable self-explanation for autonomous decision-making systems. The approach will be model-driven to facilitate reuse, the rapid development of tools and suitable abstractions for demonstrating concepts. The architecture will be informed by existing research in provenance ontology and model version research. The evaluation of the architecture is expected to be done using two case studies. The first will implement self-explanation as a primary concern in the building of a system. The second case will attempt to fit self-explanation to an existing system.
Original languageEnglish
Title of host publicationProceedings - 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion, MODELS-C 2019
EditorsLoli Burgueno, Loli Burgueno, Alexander Pretschner, Sebastian Voss, Michel Chaudron, Jorg Kienzle, Markus Volter, Sebastien Gerard, Mansooreh Zahedi, Erwan Bousse, Arend Rensink, Fiona Polack, Gregor Engels, Gerti Kappel
PublisherIEEE
Pages624-628
Number of pages5
ISBN (Electronic)978-1-7281-5125-0
ISBN (Print)978-1-7281-5126-7
DOIs
Publication statusPublished - 21 Nov 2019
Event2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C) - Munich, Germany
Duration: 15 Sep 201920 Sep 2019

Conference

Conference2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)
Period15/09/1920/09/19

Keywords

  • Autonomous
  • Decision-making
  • Model-driven
  • Self-explanation

Fingerprint Dive into the research topics of 'Towards Model-Driven Self-Explanation for Autonomous Decision-Making Systems'. Together they form a unique fingerprint.

  • Cite this

    Reynolds, O. (2019). Towards Model-Driven Self-Explanation for Autonomous Decision-Making Systems. In L. Burgueno, L. Burgueno, A. Pretschner, S. Voss, M. Chaudron, J. Kienzle, M. Volter, S. Gerard, M. Zahedi, E. Bousse, A. Rensink, F. Polack, G. Engels, & G. Kappel (Eds.), Proceedings - 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion, MODELS-C 2019 (pp. 624-628). [8904475] IEEE. https://doi.org/10.1109/MODELS-C.2019.00095