Iterated Prisoner’s Dilemma contains strategies that dominate any evolutionary opponent

@article{Press2012IteratedPD,
  title={Iterated Prisoner’s Dilemma contains strategies that dominate any evolutionary opponent},
  author={William H. Press and Freeman J. Dyson},
  journal={Proceedings of the National Academy of Sciences},
  year={2012},
  volume={109},
  pages={10409 - 10413}
}
  • W. Press, F. Dyson
  • Published 21 May 2012
  • Psychology
  • Proceedings of the National Academy of Sciences
The two-player Iterated Prisoner’s Dilemma game is a model for both sentient and evolutionary behaviors, especially including the emergence of cooperation. It is generally assumed that there exists no simple ultimatum strategy whereby one player can enforce a unilateral claim to an unfair share of rewards. Here, we show that such strategies unexpectedly do exist. In particular, a player X who is witting of these strategies can (i) deterministically set her opponent Y’s score, independently of… 

Figures from this paper

Extortion and Evolution in the Iterated Prisoner's Dilemma
The Prisoner’s Dilemma is a two player game where playing rationally leads to a suboptimal outcome for both players. The game is simple to analyze, but when it is played repeatedly, complex dynamics
Extortion and Evolution in the Iterated Prisoner ’ s Dilemma
The Prisoner’s Dilemma is a two player game where playing rationally leads to a suboptimal outcome for both players. The game is simple to analyze, but when it is played repeatedly, complex dynamics
Evolution of extortion in Iterated Prisoner’s Dilemma games
TLDR
It is shown that in reasonably large populations, so-called zero-determinant strategies can act as catalysts for the evolution of cooperation, similar to tit-for-tat, but that they are not the stable outcome of natural selection.
The Iterated Prisoner's Dilemma: Good Strategies and Their Dynamics
TLDR
There exist Markov strategies which solve the problem when the authors restrict attention to the long term average payoff for the iterated Prisoner’s Dilemma and these good strategies effectively stabilize cooperative behavior.
TURAN: Evolving non-deterministic players for the iterated prisoner's dilemma
TLDR
Experimental results show that the proposed approach is able to obtain good performances against different kind of opponent, whether their strategies can or cannot be implemented as finite state machines.
Payoff Control in the Iterated Prisoner's Dilemma
TLDR
Under the conventional iterated prisoner’s dilemma, this work develops a general framework for controlling the feasible region where the players’ payoff pairs lie and shows that the control strategies perform well either in a tournament or against a human-like opponent.
Win-Stay-Lose-Shift as a self-confirming equilibrium in the iterated Prisoner’s Dilemma
TLDR
It is argued that players can escape from full defection into a cooperative equilibrium supported by Win-Stay-Lose-Shift in a self-confirming manner, provided that the cost of cooperation is low and the observational learning supplies sufficiently large uncertainty.
The Robustness of Extortion in Iterated Prisoner ’ s Dilemma ∗
Press and Dyson (2012) discovered a special set of strategies, called extortionate strategies, in the two-player Iterated Prisoner’s Dilemma. Surprisingly, a player using such strategies obtains an
Only Two Types of Strategies Enforce Linear Payoff Relationships Under Observation Errors in Repeated Prisoner’s Dilemma Games
The repeated prisoner’s dilemma (RPD) game has revealed how cooperation and competition arise among competitive players in long-run relationships. In the RPD game with no errors, zero-determinant
Zero-determinant strategies in iterated multi-strategy games
TLDR
A theory for zero-determinant strategies for multi-strategy games, with any number of strategies, is developed and can be seen as degenerate case of the iterated prisoner's dilemma.
...
...

References

SHOWING 1-10 OF 22 REFERENCES
Effects of increasing the number of players and memory size in the iterated Prisoner's Dilemma: a numerical approach
  • C. Hauert, H. Schuster
  • Psychology
    Proceedings of the Royal Society of London. Series B: Biological Sciences
  • 1997
The Prisoner's Dilemma has become a paradigm for the evolution of altruistic behaviour. Here we present results of numerical simulations of the infinitely iterated stochastic simultaneous Prisoner's
A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game
TLDR
Extended evolutionary simulations of heterogeneous ensembles of probabilistic strategies including mutation and selection are presented and the unexpected success of another protagonist: Pavlov is reported, suggesting that cooperative behaviour in natural situations may often be based on win-stay, lose-shift.
Prisoner's Dilemma
From the Publisher: Should you watch public television without pledging?...Exceed the posted speed limit?...Hop a subway turnstile without paying? These questions illustrate the so-called
Fairness versus reason in the ultimatum game.
TLDR
It is shown that fairness will evolve if the proposer can obtain some information on what deals the responder has accepted in the past, and similarly to the evolution of cooperation, is linked to reputation.
The evolution of cooperation.
TLDR
A model is developed based on the concept of an evolutionarily stable strategy in the context of the Prisoner's Dilemma game to show how cooperation based on reciprocity can get started in an asocial world, can thrive while interacting with a wide range of other strategies, and can resist invasion once fully established.
The Further Evolution of Cooperation
TLDR
Empirical andoretical work has led to a deeper understanding of the role of other factors in the evolution of cooperation: the number of players, the range of possible choices, variation in the payoff structure, noise, the shadow of the future, population dynamics, and population structure.
Cartel Behaviour and Adverse Selection
CARTELS ARE central to any general theory of market structure. For, given the prevailing notion of rationality based upon self-interest, the rational behaviour of a group of firms should be to form
Five Rules for the Evolution of Cooperation
TLDR
Five mechanisms for the evolution of cooperation are discussed: kin selection, direct reciprocity, indirect reciprocities, network reciprocation, group selection, and group selection.
Does the chimpanzee have a theory of mind?
Abstract An individual has a theory of mind if he imputes mental states to himself and others. A system of inferences of this kind is properly viewed as a theory because such states are not directly
...
...