Conditional Value-at-Risk for Reachability and Mean Payoff in Markov Decision Processes
Authors: Jan Kretinsky and Tobias Meggendorfer
Paper Information
| Title: | Conditional Value-at-Risk for Reachability and Mean Payoff in Markov Decision Processes |
| Authors: | Jan Kretinsky and Tobias Meggendorfer |
| Proceedings: | LICS PDF files |
| Editors: | Anuj Dawar and Erich Grädel |
| Keywords: | Markov decision processes, probabilistic verification, multi-objective optimization, conditional value at risk, expected shortfall |
| Abstract: | ABSTRACT. We present the conditional value-at-risk (CVaR) in the context of Markov chains and Markov decision processes with reachability and mean-payoff objectives. CVaR quantifies risk by means of the expectation of the worst p-quantile. As such it can be used to design risk-averse systems. We consider not only CVaR constraints, but also introduce their conjunction with expectation constraints and quantile constraints (value-at-risk, VaR). We derive lower and upper bounds on the computational complexity of the respective decision problems and characterize the structure of the strategies in terms of memory and randomization. |
| Pages: | 10 |
| Talk: | Jul 10 16:20 (Session 57B) |
| Paper: | ![]() |
