A Convex Analytic Approach to Risk-Aware Markov Decision Processes

  title={A Convex Analytic Approach to Risk-Aware Markov Decision Processes},
  author={William B. Haskell and Rahul Jain},
  journal={SIAM J. Control and Optimization},
Abstract. In classical Markov decision process (MDP) theory, we search for a policy that say, minimizes the expected infinite horizon discounted cost. Expectation is of course, a risk neutral measure, which does not su ce in many applications, particularly in finance. We replace the expectation with a general risk functional, and call such models risk-aware MDP models. We consider minimization of such risk functionals in two cases, the expected utility framework, and Conditional Value-at-Risk… CONTINUE READING
Highly Cited
This paper has 38 citations. REVIEW CITATIONS

1 Figure or Table



Citations per Year

Citation Velocity: 9

Averaging 9 citations per year over the last 3 years.

Learn more about how we calculate this metric in our FAQ.