Reinforcement learning based adaptive power pinch analysis for energy management of stand-alone hybrid energy storage systems considering uncertainty

Nyong-bassey Bassey Etim*, Damian Giaouris, Charalampos Patsios, Simira Papadopoulou, Athanasios I. Papadopoulos, Sara Walker, Spyros Voutetakis, Panos Seferlis, Shady Gadoue

*Corresponding author for this work

Research output: Contribution to journalArticle


Hybrid energy storage systems (HESS) involve synergies between multiple energy storage technologies with complementary operating features aimed at enhancing the reliability of intermittent renewable energy sources (RES). Nevertheless, coordinating HESS through optimized energy management strategies (EMS) introduces complexity. The latter has been previously addressed by the authors through a systems-level graphical EMS via Power Pinch Analysis (PoPA). Although of proven efficiency, accounting for uncertainty with PoPA has been an issue, due to the assumption of a perfect day ahead (DA) generation and load profiles forecast. This paper proposes three adaptive PoPA-based EMS, aimed at negating load demand and RES stochastic variability. Each method has its own merits such as; reduced computational complexity and improved accuracy depending on the probability density function of uncertainty. The first and simplest adaptive scheme is based on a receding horizon model predictive control framework. The second employs a Kalman filter, whereas the third is based on a machine learning algorithm. The three methods are assessed on a real isolated HESS microgrid built in Greece. In validating the proposed methods against the DA PoPA, the proposed methods all performed better with regards to violation of the energy storage operating constraints and plummeting carbon emission footprint.
Original languageEnglish
Article number116622
Early online date2 Dec 2019
Publication statusPublished - 15 Feb 2020


Bibliographical note

© 2019, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International

Funding: Petroleum Technology Development Fund.


  • Energy management strategies
  • Hybrid energy storage systems
  • Kalman filter
  • Model predictive control
  • Reinforcement learning

Cite this