Correlated Q-Learning

  title={Correlated Q-Learning},
  author={Amy Greenwald and Keith Hall},
There have been several attempts to design multiagent Q-learning algorithms capable of learning equilibrium policies in general-sum Markov games, just as Q-learning learns optimal policies in Markov decision processes. We introduce correlated Q-learning, one such algorithm based on the correlated equilibrium solution concept. Motivated by a fixed point proof of the existence of stationary correlated equilibrium policies in Markov games, we present a generic multiagent Q-learning algorithm of… CONTINUE READING
Highly Influential
This paper has highly influenced 28 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 379 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 187 extracted citations

380 Citations

Citations per Year
Semantic Scholar estimates that this publication has 380 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 30 references

A direct proof of the existence of correlated equilibrium policies in general-sum markov games

  • A. Greenwald, M. Zinkevich
  • Technical Report CS-05-07,
  • 2005
Highly Influential
7 Excerpts

Correlated Q-learning

  • A. Greenwald, K. Hall
  • In Proceedings of the Twentieth International…
  • 2003
Highly Influential
4 Excerpts

Equilibrium in a stochastic n-person game

  • A. M. Fink
  • Journal of Science in Hiroshima University,
  • 1964
Highly Influential
4 Excerpts

Equilibrium policies in Markov games

  • A. Greenwald
  • Working Paper , August
  • 2002

Similar Papers

Loading similar papers…