RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable markov decision processes

Luis Hernán García Paucar, Nelly Bencomo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Different model-based techniques have been used to model and underpin requirements management and decision-making strategies under uncertainty for self-adaptive Systems (SASs). The models specify how the partial or total fulfilment of non-functional requirements (NFRs) drive the decision-making process at runtime. There has been considerable progress in this research area. However, precarious progress has been made by the use of models at runtime using machine learning to deal with uncertainty and support decision-making based on new evidence learned during execution. New techniques are needed to systematically revise the current model and the satisficement of its NFRs when empirical evidence becomes available from the monitoring infrastructure. In this paper, we frame the decision-making problem and trade-off specifications of NFRs in terms of Partially Observable Markov Decision Processes (POMDPs) models. The mathematical probabilistic framework based on the concept of POMDPs serves as a runtime model that can be updated with new learned evidence to support reasoning about partial satisficement of NFRs and their trade-off under the new changes in the environment. In doing so, we demonstrate how our novel approach RE-STORM underpins reasoning over uncertainty and dynamic changes during the system's execution.
Original languageEnglish
Title of host publicationProceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, SEAMS@ICSE 2018, Gothenburg, Sweden, May 28-29, 2018
Pages19-25
Number of pages7
ISBN (Electronic)978-1-4503-5715-9
DOIs
Publication statusPublished - 28 May 2018
Event13th International Conference on Software Engineering for Adaptive and Self-Managing Systems - Gothenburg, Sweden
Duration: 28 May 201829 May 2018

Conference

Conference13th International Conference on Software Engineering for Adaptive and Self-Managing Systems
CountrySweden
CityGothenburg
Period28/05/1829/05/18

Fingerprint

Decision making
Adaptive systems
Learning systems
Specifications
Monitoring
Uncertainty

Cite this

Paucar, L. H. G., & Bencomo, N. (2018). RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable markov decision processes. In Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, SEAMS@ICSE 2018, Gothenburg, Sweden, May 28-29, 2018 (pp. 19-25) https://doi.org/10.1145/3194133.3195537
Paucar, Luis Hernán García ; Bencomo, Nelly. / RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable markov decision processes. Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, SEAMS@ICSE 2018, Gothenburg, Sweden, May 28-29, 2018. 2018. pp. 19-25
@inproceedings{d139832851f449ba8bbcf1f01b935371,
title = "RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable markov decision processes",
abstract = "Different model-based techniques have been used to model and underpin requirements management and decision-making strategies under uncertainty for self-adaptive Systems (SASs). The models specify how the partial or total fulfilment of non-functional requirements (NFRs) drive the decision-making process at runtime. There has been considerable progress in this research area. However, precarious progress has been made by the use of models at runtime using machine learning to deal with uncertainty and support decision-making based on new evidence learned during execution. New techniques are needed to systematically revise the current model and the satisficement of its NFRs when empirical evidence becomes available from the monitoring infrastructure. In this paper, we frame the decision-making problem and trade-off specifications of NFRs in terms of Partially Observable Markov Decision Processes (POMDPs) models. The mathematical probabilistic framework based on the concept of POMDPs serves as a runtime model that can be updated with new learned evidence to support reasoning about partial satisficement of NFRs and their trade-off under the new changes in the environment. In doing so, we demonstrate how our novel approach RE-STORM underpins reasoning over uncertainty and dynamic changes during the system's execution.",
author = "Paucar, {Luis Hern{\'a}n Garc{\'i}a} and Nelly Bencomo",
year = "2018",
month = "5",
day = "28",
doi = "10.1145/3194133.3195537",
language = "English",
pages = "19--25",
booktitle = "Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, SEAMS@ICSE 2018, Gothenburg, Sweden, May 28-29, 2018",

}

Paucar, LHG & Bencomo, N 2018, RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable markov decision processes. in Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, SEAMS@ICSE 2018, Gothenburg, Sweden, May 28-29, 2018. pp. 19-25, 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, Gothenburg, Sweden, 28/05/18. https://doi.org/10.1145/3194133.3195537

RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable markov decision processes. / Paucar, Luis Hernán García; Bencomo, Nelly.

Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, SEAMS@ICSE 2018, Gothenburg, Sweden, May 28-29, 2018. 2018. p. 19-25.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable markov decision processes

AU - Paucar, Luis Hernán García

AU - Bencomo, Nelly

PY - 2018/5/28

Y1 - 2018/5/28

N2 - Different model-based techniques have been used to model and underpin requirements management and decision-making strategies under uncertainty for self-adaptive Systems (SASs). The models specify how the partial or total fulfilment of non-functional requirements (NFRs) drive the decision-making process at runtime. There has been considerable progress in this research area. However, precarious progress has been made by the use of models at runtime using machine learning to deal with uncertainty and support decision-making based on new evidence learned during execution. New techniques are needed to systematically revise the current model and the satisficement of its NFRs when empirical evidence becomes available from the monitoring infrastructure. In this paper, we frame the decision-making problem and trade-off specifications of NFRs in terms of Partially Observable Markov Decision Processes (POMDPs) models. The mathematical probabilistic framework based on the concept of POMDPs serves as a runtime model that can be updated with new learned evidence to support reasoning about partial satisficement of NFRs and their trade-off under the new changes in the environment. In doing so, we demonstrate how our novel approach RE-STORM underpins reasoning over uncertainty and dynamic changes during the system's execution.

AB - Different model-based techniques have been used to model and underpin requirements management and decision-making strategies under uncertainty for self-adaptive Systems (SASs). The models specify how the partial or total fulfilment of non-functional requirements (NFRs) drive the decision-making process at runtime. There has been considerable progress in this research area. However, precarious progress has been made by the use of models at runtime using machine learning to deal with uncertainty and support decision-making based on new evidence learned during execution. New techniques are needed to systematically revise the current model and the satisficement of its NFRs when empirical evidence becomes available from the monitoring infrastructure. In this paper, we frame the decision-making problem and trade-off specifications of NFRs in terms of Partially Observable Markov Decision Processes (POMDPs) models. The mathematical probabilistic framework based on the concept of POMDPs serves as a runtime model that can be updated with new learned evidence to support reasoning about partial satisficement of NFRs and their trade-off under the new changes in the environment. In doing so, we demonstrate how our novel approach RE-STORM underpins reasoning over uncertainty and dynamic changes during the system's execution.

UR - http://doi.acm.org/10.1145/3194133.3195537

U2 - 10.1145/3194133.3195537

DO - 10.1145/3194133.3195537

M3 - Conference contribution

SP - 19

EP - 25

BT - Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, SEAMS@ICSE 2018, Gothenburg, Sweden, May 28-29, 2018

ER -

Paucar LHG, Bencomo N. RE-STORM: mapping the decision-making problem and non-functional requirements trade-off to partially observable markov decision processes. In Proceedings of the 13th International Conference on Software Engineering for Adaptive and Self-Managing Systems, SEAMS@ICSE 2018, Gothenburg, Sweden, May 28-29, 2018. 2018. p. 19-25 https://doi.org/10.1145/3194133.3195537