Markov Decision Processes with Multiple Long-Run Average Objectives

@inproceedings{Chatterjee2007MarkovDP,
  title={Markov Decision Processes with Multiple Long-Run Average Objectives},
  author={Krishnendu Chatterjee},
  booktitle={FSTTCS},
  year={2007}
}
We consider Markov decision processes (MDPs) with multiple long-run average objectives. Such MDPs occur in design problems where one wishes to simultaneously optimize several criteria, for example, latency and power. The possible trade-offs between the different objectives are characterized by the Pareto curve. We show that every Pareto optimal point can be Ɛ-approximated by a memoryless strategy, for all Ɛ > 0. In contrast to the single-objective case, the memoryless strategy may require… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 37 CITATIONS

From verification to synthesis under cost-utility constraints

VIEW 4 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Multi-objective Monte-Carlo Tree Search

VIEW 4 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

The 10, 000 Facets of MDP Model Checking

  • Computing and Software Science
  • 2019
VIEW 1 EXCERPT
CITES BACKGROUND

References

Publications referenced by this paper.
SHOWING 1-10 OF 14 REFERENCES

M

K. Etessami
  • Kwiatkowska, M.Y. Vardi and M.Yannakakis. Multi-objective model checking of Markov decision processes. In TACAS’07 LNCS 4424, Springer,
  • 2007
VIEW 9 EXCERPTS
HIGHLY INFLUENTIAL

On the approximability of trade-offs and optimal access of Web sources

  • Proceedings 41st Annual Symposium on Foundations of Computer Science
  • 2000
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Markov decision processes with multiple long-run average objectives

K. Chatterjee
  • Technical Report, UC Berkeley, UCB/EECS-2007-105,
  • 2007
VIEW 1 EXCERPT

Time-energy design space exploration for multi-layer memory architectures

  • Proceedings Design, Automation and Test in Europe Conference and Exhibition
  • 2004
VIEW 1 EXCERPT

Pareto-optimization-based run-time task scheduling for embedded systems

  • First IEEE/ACM/IFIP International Conference on Hardware/ Software Codesign and Systems Synthesis (IEEE Cat. No.03TH8721)
  • 2003
VIEW 1 EXCERPT

Efficient information gathering on the Internet

  • Proceedings of 37th Conference on Foundations of Computer Science
  • 1996
VIEW 1 EXCERPT

Game Theory

G. Owen
  • Academic Press,
  • 1995
VIEW 2 EXCERPTS