Fully probabilistic control design in an adaptive critic framework

Randa Herzallah, Miroslav Kárný

    Research output: Contribution to journalArticlepeer-review


    Optimal stochastic controller pushes the closed-loop behavior as close as possible to the desired one. The fully probabilistic design (FPD) uses probabilistic description of the desired closed loop and minimizes Kullback-Leibler divergence of the closed-loop description to the desired one. Practical exploitation of the fully probabilistic design control theory continues to be hindered by the computational complexities involved in numerically solving the associated stochastic dynamic programming problem. In particular very hard multivariate integration and an approximate interpolation of the involved multivariate functions. This paper proposes a new fully probabilistic contro algorithm that uses the adaptive critic methods to circumvent the need for explicitly evaluating the optimal value function, thereby dramatically reducing computational requirements. This is a main contribution of this short paper.
    Original languageEnglish
    Pages (from-to)1128-1135
    Number of pages8
    JournalNeural Networks
    Issue number10
    Early online date22 Jun 2011
    Publication statusPublished - Dec 2011

    Bibliographical note

    NOTICE: this is the author’s version of a work that was accepted for publication in Neural networks. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Herzallah, R & Kárný, M, 'Fully probabilistic control design in an adaptive critic framework' Neural networks, vol. 24, no. 10 (2011) DOI http://dx.doi.org/10.1016/j.neunet.2011.06.006


    • stochastic control design
    • fully probabilistic design
    • adaptive control
    • adaptive critic


    Dive into the research topics of 'Fully probabilistic control design in an adaptive critic framework'. Together they form a unique fingerprint.

    Cite this