Neuronal coding of prediction errors.

@article{Schultz2000NeuronalCO,
  title={Neuronal coding of prediction errors.},
  author={W. Schultz and A. Dickinson},
  journal={Annual review of neuroscience},
  year={2000},
  volume={23},
  pages={
          473-500
        }
}
Associative learning enables animals to anticipate the occurrence of important outcomes. Learning occurs when the actual outcome differs from the predicted outcome, resulting in a prediction error. Neurons in several brain structures appear to code prediction errors in relation to rewards, punishments, external stimuli, and behavioral reactions. In one form, dopamine neurons, norepinephrine neurons, and nucleus basalis neurons broadcast prediction errors as global reinforcement or teaching… Expand
Learning prediction error neurons in a canonical interneuron circuit
TLDR
A well-orchestrated interplay of three interneuron types shapes the development and refinement of negative prediction-error neurons in a computational model of mouse primary visual cortex, making a range of testable predictions that may shed light on the circuitry underlying the neural computation of prediction errors. Expand
Learning prediction error neurons in a canonical interneuron circuit
TLDR
A well-orchestrated interplay of three interneuron types shapes the development and refinement of negative prediction-error neurons in a computational model of mouse primary visual cortex, making a range of testable predictions that may shed light on the circuitry underlying the neural computation of prediction errors. Expand
The Basal Ganglia and the Encoding of Value
Publisher Summary Neural firing proportional to reward-prediction error has been reported for midbrain dopamine neurons. Functional brain-imaging experiments also report reward-predictive andExpand
Prediction error for free monetary reward in the human prefrontal cortex
TLDR
Activity time-locked to prediction errors in frontotemporal circuits suggests that they are involved in encoding the associations between visual cues and monetary rewards in the human brain. Expand
Striatal Prediction Error Modulates Cortical Coupling
TLDR
Nonlinear dynamic causal modeling is used to demonstrate that striatal prediction errors are used to tune functional coupling in cortical networks during learning and provides direct empirical evidence for formal learning theories that posit a central role for prediction error-dependent plasticity. Expand
Human Neural Learning Depends on Reward Prediction Errors in the Blocking Paradigm
TLDR
The data suggest that learning in primary reward structures in the human brain correlates with prediction errors in a manner that complies with principles of formal learning theory. Expand
A Causal Link Between Prediction Errors, Dopamine Neurons and Learning
TLDR
It is observed that optogenetic activation of dopamine neurons concurrent with reward delivery, mimicking a prediction error, was sufficient to cause long-lasting increases in cue-elicited reward-seeking behavior, establishing a causal role for temporally precise dopamine neuron signaling incue-reward learning. Expand
Reward prediction error signals by reticular formation neurons.
As a key part of the brain's reward system, midbrain dopamine neurons are thought to generate signals that reflect errors in the prediction of reward. However, recent evidence suggests thatExpand
Prediction-error neurons in circuits with multiple neuron types: Formation, refinement and functional implications
Predictable sensory stimuli do not evoke significant responses in a subset of cortical excitatory neurons. Some of those neurons, however, change their activity upon mismatches between actual andExpand
Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons
TLDR
An awake electrophysiological recording system is established, combined with rabies virus and optogenetic cell-type identification, to characterize the firing patterns of monosynaptic inputs to dopamine neurons while mice performed classical conditioning tasks, and reveals unexpected redundancy for a simple computation in the brain. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 117 REFERENCES
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
TLDR
This study explored a neural network model that used a reward-prediction error signal strongly resembling dopamine responses for learning movement sequences and efficiently allowed the model to learn long sequences. Expand
Dopamine neurons report an error in the temporal prediction of reward during learning
TLDR
Dopamine neuron responses reflected the changes in reward prediction during individual learning episodes; dopamine neurons were activated by rewards during early trials, but activation was progressively reduced as performance was consolidated and rewards became more predictable. Expand
Value-dependent selection in the brain: Simulation in a synthetic neural model
TLDR
The main aim of this paper is to show that, if value-dependent modulation is extended to the inputs of neural value systems themselves, initially neutral cues can acquire value, which has important implications for the acquisition of behavioral sequences. Expand
Importance of unpredictability for reward responses in primate dopamine neurons.
TLDR
D dopamine neurons responded to liquid reward during learning but not when task performance was established, at which time the neuronal response occurred to the conditioned, reward-predicting, movement-triggering stimulus. Expand
Predictive reward signal of dopamine neurons.
  • W. Schultz
  • Psychology, Medicine
  • Journal of neurophysiology
  • 1998
TLDR
Dopamine systems may have two functions, the phasic transmission of reward information and the tonic enabling of postsynaptic neurons. Expand
Modifications of reward expectation-related neuronal activity during learning in primate striatum.
TLDR
Investigating neuronal activity in the anterior striatum while monkeys repeatedly learned to associate new instruction stimuli with known behavioral reactions and reinforcers showed changes related to adaptations or reductions of expectations in new task situations and displayed activations that might serve to induce structural changes during learning. Expand
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
TLDR
A theoretical framework is developed that shows how mesencephalic dopamine systems could distribute to their targets a signal that represents information about future expectations and shows that, through a simple influence on synaptic plasticity, fluctuations in dopamine release can act to change the predictions in an appropriate manner. Expand
Is the short-latency dopamine response too short to signal reward error?
TLDR
It is suggested that the initial burst of dopaminergic-neurone firing could represent an essential component in the process of switching attentional and behavioural selections to unexpected, behaviourally important stimuli and might be part of a general short-latency response that is mediated by catecholamines and prepares the organism for an appropriate reaction to biologically significant events. Expand
Prediction of complex two-dimensional trajectories by a cerebellar model of smooth pursuit eye movement.
TLDR
A neural network model based on the anatomy and physiology of the cerebellum is presented that can generate both simple and complex predictive pursuit, while also responding in a feedback mode to visual perturbations from an ongoing trajectory, which suggests that both the model and the eye make short-term predictions about future events to compensate for visual feedback delays in receiving information about the direction of a target moving along a changing trajectory. Expand
Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects.
We describe a model of visual processing in which feedback connections from a higher- to a lower- order visual cortical area carry predictions of lower-level neural activities, whereas theExpand
...
1
2
3
4
5
...