Temporal Logic Control of General Markov Decision Processes by Approximate Policy Refinement
Authors: Sofie Haesaert, Sadegh Soudjani and Alessandro Abate
Paper Information
Title: | Temporal Logic Control of General Markov Decision Processes by Approximate Policy Refinement |
Authors: | Sofie Haesaert, Sadegh Soudjani and Alessandro Abate |
Proceedings: | ADHS Full papers |
Editor: | Alessandro Abate |
Keywords: | aaa, bbb, ccc |
Abstract: | ABSTRACT. The formal verification and controller synthesis for general Markov decision processes (gMDPs) that evolve over uncountable state spaces are computationally hard and thus generally rely on the use of approximate abstractions. In this paper, we contribute to the state of the art of control synthesis for temporal logic properties by computing and quantifying a less conservative gridding of the continuous state space of linear stochastic dynamic systems and by giving a new approach for control synthesis and verification that is robust to the incurred approximation errors. The approximation errors are expressed as both deviations in the outputs of the gMDPs and in the probabilistic transitions. |
Pages: | 6 |
Talk: | Jul 11 14:00 (Session 66C: Stochastic systems 1) |
Paper: |