Mixed risk-neutral/minimax control of discrete-time, finite-state Markov decision processes

@article{Coraluppi2000MixedRC,
  title={Mixed risk-neutral/minimax control of discrete-time, finite-state Markov decision processes},
  author={Stefano P. Coraluppi and Steven I. Marcus},
  journal={IEEE Trans. Automat. Contr.},
  year={2000},
  volume={45},
  pages={528-532}
}
This paper addresses the control design problem for discrete-time, nite-state Markov Decision Processes (MDPs), when both risk-neutral and minimax objectives are of interest. We introduce the mixed risk-neutral/minimax objective, and utilize results from risk-neutral and minimax control to derive an information state process and dynamic programming equations for the value function. We synthesize optimal control laws both on the nite and innnite horizon. We study the eeectiveness of both the… CONTINUE READING
Highly Cited
This paper has 25 citations. REVIEW CITATIONS

From This Paper

Topics from this paper.

Citations

Publications citing this paper.
Showing 1-10 of 15 extracted citations

Dynamic programming equations for discounted constrained stochastic control

IEEE Transactions on Automatic Control • 2004
View 11 Excerpts
Highly Influenced

A unified framework for risk-sensitive Markov control processes

53rd IEEE Conference on Decision and Control • 2014
View 3 Excerpts

Dynamic programming with non-convex risk-sensitive measures

2013 American Control Conference • 2013
View 1 Excerpt

References

Publications referenced by this paper.
Showing 1-10 of 15 references

Optimal Control of Markov Decision Processes for Performance and Robustness

S. P. Coraluppi
PhD thesis, University of Maryland, • 1997
View 5 Excerpts
Highly Influenced

Mixed H2 and H1 performance objectives I: robust performance analysis

K. Zhou, K. Glover, B. Bodenheimer, J. Doyle
IEEE Transactions on Automatic Control, • 1994

Mixed H2 and H1 performance objectives II: optimal control

J. Doyle, K. Zhou, K. Glover, B. Bodenheimer
IEEE Transactions on Automatic Control, • 1994

A note on exact solution of partially observed markov decision processes

W. S. Lovejoy
Technical report, • 1989

State-space formulae for all stabilizing controllers that satisfy an H1-norm bound and relations to risk sensitivity

K. Glover, J. C. Doyle
Systems and Control Letters, • 1988
View 1 Excerpt

Stochastic Systems: Estimation, Identi cation, and Adaptive Control

P. R. Kumar, P. Varaiya
1986
View 1 Excerpt

Similar Papers

Loading similar papers…