Representation and Timing in Theories of the Dopamine System

@article{Daw2006RepresentationAT,
  title={Representation and Timing in Theories of the Dopamine System},
  author={N. Daw and Aaron C. Courville and D. Touretzky},
  journal={Neural Computation},
  year={2006},
  volume={18},
  pages={1637-1677}
}
Although the responses of dopamine neurons in the primate midbrain are well characterized as carrying a temporal difference (TD) error signal for reward prediction, existing theories do not offer a credible account of how the brain keeps track of past sensory events that may be relevant to predicting future reward. Empirically, these shortcomings of previous theories are particularly evident in their account of experiments in which animals were exposed to variation in the timing of events. The… Expand
157 Citations
Stimulus Representation and the Timing of Reward-Prediction Errors in Models of the Dopamine System
  • 122
  • Highly Influenced
  • PDF
Tamping Ramping: Algorithmic, Implementational, and Computational Explanations of Phasic Dopamine Signals in the Accumbens
  • 30
  • PDF
Alternative time representation in dopamine models
  • 22
  • Highly Influenced
  • PDF
Believing in dopamine
  • 38
Cortico-striatal representation of time in animals and humans
  • 339
  • PDF
Hidden State Inference in the Midbrain Dopamine System
  • Highly Influenced
Shifting Attention Using a Temporal Difference Prediction Error and High-Dimensional Input
  • 8
Dopamine role in learning and action inference
  • 6
  • PDF
Reinforcement learning in the brain
  • 430
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 112 REFERENCES
Dopamine, uncertainty and TD learning
  • 139
Reinforcement learning models of the dopamine system and their behavioral implications
  • 67
  • PDF
Long-Term Reward Prediction in TD Models of the Dopamine System
  • 70
  • PDF
The Effects of Uncertainty on TD Learning
  • 2
  • PDF
A computational substrate for incentive salience
  • 385
  • PDF
Time and memory: towards a pacemaker-free theory of interval timing.
  • 357
  • PDF
Multiple model-based reinforcement learning explains dopamine neuronal activity
  • 16
  • PDF
Modeling dopamine activity by Reinforcement Learning methods: implications from two recent models
  • 2
  • PDF
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
  • 1,772
  • PDF
...
1
2
3
4
5
...