Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling.

@article{Redish2007ReconcilingRL,
  title={Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling.},
  author={A. Redish and S. Jensen and A. Johnson and Zeb L. Kurth-Nelson},
  journal={Psychological review},
  year={2007},
  volume={114 3},
  pages={
          784-805
        }
}
  • A. Redish, S. Jensen, +1 author Zeb L. Kurth-Nelson
  • Published 2007
  • Psychology, Medicine
  • Psychological review
  • Because learned associations are quickly renewed following extinction, the extinction process must include processes other than unlearning. However, reinforcement learning models, such as the temporal difference reinforcement learning (TDRL) model, treat extinction as an unlearning of associated value and are thus unable to capture renewal. TDRL models are based on the hypothesis that dopamine carries a reward prediction error signal; these models predict reward by driving that reward error to… CONTINUE READING
    281 Citations

    Figures, Tables, and Topics from this paper

    Rethinking Extinction
    • 91
    • PDF
    Gradual extinction prevents the return of fear: implications for the discovery of state
    • 89
    • Highly Influenced
    • PDF
    A Neurocomputational Model for Cocaine Addiction
    • 41
    • PDF
    Modeling Decision-Making Systems in Addiction
    • 14
    • PDF
    A Dual Association Model for Acquisition and Extinction

    References

    SHOWING 1-10 OF 285 REFERENCES
    Addiction as a Computational Process Gone Awry
    • 432
    • PDF
    TD models of reward predictive responses in dopamine neurons
    • 140
    • PDF
    Context and behavioral processes in extinction.
    • M. Bouton
    • Psychology, Medicine
    • Learning & memory
    • 2004
    • 1,437
    • Highly Influential
    • PDF
    Reinforcement learning models of the dopamine system and their behavioral implications
    • 67
    • Highly Influential
    • PDF
    A neurocomputational hypothesis for nicotine addiction.
    • 78
    • PDF
    Dopamine responses comply with basic assumptions of formal learning theory
    • 913
    • PDF
    Addiction: a disease of learning and memory.
    • S. E. Hyman
    • Psychology, Medicine
    • The American journal of psychiatry
    • 2005
    • 500
    • PDF
    Reward-produced memories regulate memory-discrimination learning, extinction, and other forms of discrimination learning.
    • 2
    Drug Addiction, Dysregulation of Reward, and Allostasis
    • 2,375
    • PDF