A neural substrate of prediction and reward.

@article{Schultz1997ANS,
  title={A neural substrate of prediction and reward.},
  author={Wolfram Schultz and Peter Dayan and P. Read Montague},
  journal={Science},
  year={1997},
  volume={275 5306},
  pages={
          1593-9
        }
}
The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of… CONTINUE READING
Highly Influential
This paper has highly influenced 324 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 6,686 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.

Explore Further: Topics Discussed in This Paper

Citations

Publications citing this paper.
Showing 1-10 of 3,167 extracted citations

Induction and relief of curiosity elicit parietal and frontal activity.

The Journal of neuroscience : the official journal of the Society for Neuroscience • 2018
View 18 Excerpts
Method Support
Highly Influenced

Understanding Cognition by Gordon

View 6 Excerpts
Highly Influenced

Dissociable contribution of prefrontal and striatal dopaminergic genes to learning in economic games.

Proceedings of the National Academy of Sciences of the United States of America • 2014
View 11 Excerpts
Method Support
Highly Influenced

6,687 Citations

0200400'88'95'03'11'19
Citations per Year
Semantic Scholar estimates that this publication has 6,687 citations based on the available data.

See our FAQ for additional information.

References

Publications referenced by this paper.
Showing 1-9 of 9 references

Recent models of sequence generation in the striatum use fluctuating dopamine input as a scalar error signal [ G . S . Berns and T . J . Sejnowski , in Neurobiology of Decision Making ,

A. Damasio, J. F. Powell, A. D. Smith
1995

Recent models of sequence generation in the striatum use fluctuating dopamine input as a scalar error signal [G

T. Aosaki et al, ibid
Graybiel Curr. Opin. Neurobiol • 1995
View 1 Excerpt

Error (Putnam

A. R. Damasio, Descartes
New York, • 1994
View 2 Excerpts

Neural-Network Approaches to Cognition—Biobehavioral Foundations

P. R. Montague, T. J. Sejnowski, Learn
A Companion to Cognitive Science, • 1994
View 2 Excerpts

Instrumental Conditioning Theory and the Impact of Biological Constraints on Learning, S

R. M. Church, in Contemporary Learning Theories
B. Klein and R. R. Mowrer, Eds. (Erlbaum, Hillsdale, NJ, 1989), p. 41; J. Gibbon, Learn. Motiv. 22, 3 • 1991
View 1 Excerpt

For specific application to eyeblink conditioning

P. Dayan, P. R. Montague
Behav . Brain Res . • 1989

Dynamic Programming (Princeton

R. E. Bellman
Dynamic Programming and Markov Processes (MIT Press, • 1957
View 1 Excerpt

[Conditioned reflex].

Fel'dsher i akusherka • 1951
View 2 Excerpts