Evolution of cooperation facilitated by reinforcement learning with adaptive aspiration levels.

  title={Evolution of cooperation facilitated by reinforcement learning with adaptive aspiration levels.},
  author={Shoma Tanabe and Naoki Masuda},
  journal={Journal of theoretical biology},

Figures and Tables from this paper

Evolution of cooperation in social dilemmas under the coexistence of aspiration and imitation mechanisms.
This work explores the evolution of cooperation in dyadic games under the coexistence of imitation and aspiration dynamics in an infinitely large well-mixed population and examines the coevolution of strategies, aspirations, and update rules which leads to a binary state of obeying either imitation or aspiration dynamics.
Aspiration promotes cooperation in the prisoner's dilemma game with the imitation rule.
The numerical results indicate that more aspiration-driven individuals lead to a higher mean fraction of imitation-driven cooperators, which means the invasion of the aspiration- driven individuals is conducive to promoting the cooperation of the imitation- Driven individuals.
Coevolution of aspirations and cooperation in spatial prisoner's dilemma game
Suboptimal outcomes are often more acceptable than the best ones when the latter are hard or even impossible to find. In order to describe the emergence of cooperation when suboptimal alternatives
Network rewiring promotes cooperation in an aspirational learning model
This work shows that a low-information strategy-update model can be very effective in ensuring dominance of cooperators in social dilemmas and reinforces the usefulness of an internal criterion for strategy updates, together with network restructuring, in ensuring the dominance of altruistic strategies over long time-scales.
Effect of Initial Fraction of Cooperators on Cooperative Behavior in Evolutionary Prisoner's Dilemma Game
It is demonstrated that when the tendency of three cooperation cluster characteristics (cluster size, cluster number and cluster shape) are consistent within END and EXP periods, the state that maximizes cooperation can be favored.
Network rewiring promotes cooperation in an aspirational learning model.
We analyze a cooperative decision-making model that is based on individual aspiration levels using the framework of a public goods game in static and dynamic networks. Sensitivity to differences in
A Sustainable Ecosystem through Emergent Cooperation in Multi-Agent Reinforcement Learning
This paper considers sustainable and cooperative behavior in multi-agent systems. In the proposed predator-prey simulation, multiple selfish predators can learn to act sustainably by maintaining a
Dynamic noise from action errors enhances network reciprocity in the prisoner's dilemma game
A spatial prisoner's dilemma model where an agent commits action errors proportionally varying with the increasing/decreasing rate of the global cooperation fraction is established, finding that errors in behavior in a chaotic environment contribute to the evolution of cooperation.


Numerical analysis of a reinforcement learning model with the dynamic aspiration level in the iterated Prisoner's dilemma.
A Theoretical Analysis of Temporal Difference Learning in the Iterated Prisoner’s Dilemma Game
A reinforcement learning model called temporal difference learning is analyzed and its performance in the iterated Prisoner's Dilemma game is studied to show that learners with only two internal states properly learn to cooperate with retaliatory players and to defect against unconditional cooperators and defectors.
Multiagent reinforcement learning in the Iterated Prisoner's Dilemma.
Evolutionary Games and Population Dynamics
In this book the authors investigate the nonlinear dynamics of the self-regulation of social and economic behavior, and of the closely related interactions among species in ecological communities.
Learning and Innovative Elements of Strategy Adoption Rules Expand Cooperative Network Topologies
The results suggest that a balanced duo of learning and innovation may help to preserve cooperation during the re-organization of real-world networks, and may play a prominent role in the evolution of self-organizing, complex systems.
Learning dynamics in social dilemmas
  • M. Macy, A. Flache
  • Economics
    Proceedings of the National Academy of Sciences of the United States of America
  • 2002
The Nash equilibrium, the main solution concept in analytical game theory, cannot make precise predictions about the outcome of repeated mixed-motive games. Nor can it tell us much about the dynamics
The Influence of Learning on Evolution: A Mathematical Framework
It is shown that a positive gain-function derivative implies that learning accelerates evolution, and a negative one implies deceleration under the condition that the population is distributed on a monotonic part of the fitness landscape.
A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game
Extended evolutionary simulations of heterogeneous ensembles of probabilistic strategies including mutation and selection are presented and the unexpected success of another protagonist: Pavlov is reported, suggesting that cooperative behaviour in natural situations may often be based on win-stay, lose-shift.
Stochastic dynamics of invasion and fixation.
A simple closed formula is derived that determines the feasibility of cooperation in finite populations, whenever cooperation is modeled in terms of any symmetric two-person game, and is valid at all intensities of selection and for any initial condition.