A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping.

@article{Takikawa2004APR,
  title={A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping.},
  author={Yoriko Takikawa and Reiko Kawagoe and Okihide Hikosaka},
  journal={Journal of neurophysiology},
  year={2004},
  volume={92 4},
  pages={
          2520-9
        }
}
Dopamine (DA) neurons respond to sensory stimuli that predict reward. To understand how DA neurons acquire such ability, we trained monkeys on a one-direction-rewarded version of memory-guided saccade task (1DR) only when we recorded from single DA neurons. In 1DR, position-reward mapping was changed across blocks of trials. In the early stage of training of 1DR, DA neurons responded to reward delivery; in the later stages, they responded predominantly to the visual cue that predicted reward or… 

Figures and Tables from this paper

Reward-Dependent Modulation of Neuronal Activity in the Primate Dorsal Raphe Nucleus
TLDR
The results suggest that the DRN, probably including serotonin neurons, signals the reward value associated with the current behavior, whereas dopamine neurons encode the difference between the expected and received rewards.
Lateral habenula as a source of negative reward signals in dopamine neurons
TLDR
It is shown that the primate lateral habenula, part of the structure called the epithalamus, is a major candidate for a source of negative reward-related signals in dopamine neurons, and the inhibitory input from the lateral ha benula plays an important role in determining the reward- related activity of dopamine neurons.
Immediate changes in anticipatory activity of caudate neurons associated with reversal of position-reward contingency.
TLDR
It is suggested that anticipatory activity of caudate neurons reflects the reversal set of reward-position contingency, which is sensitive to position-reward contingencies and correlates with saccade latency,Which is shorter toward a rewarded position.
A pallidus-habenula-dopamine pathway signals inferred stimulus values.
TLDR
It is shown that a neural pathway controlling the dopamine system does not rely exclusively on either stimulus-reward pairings or abstract inference but instead uses a combination of the two: the pallidus-habenula-dopamine pathway signals reward values estimated through both experience and inference.
Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network
TLDR
It is demonstrated that the persistent reward responses of DA cells during conditioning are only accurately replicated by a TD model with long-lasting eligibility traces (nonzero values for the parameter λ) and low learning rate (α), suggesting that eligibility traces and low per-trial rates of plastic modification may be essential features of neural circuits for reward learning in the brain.
The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons
TLDR
The authors show how the effort of obtaining rewards affects reward-related activity of dopamine neurons, and in turn the speed of learning stimulus-reward associations, by recording from dopamine neurons in awake behaving monkeys during performance of an effortful saccade task.
Dopamine neuronal responses in monkeys performing visually cued reward schedules
TLDR
Dopamine neurons seem to respond to behaviourally important, i.e. salient, events even when the events have been well‐predicted, within and across trials.
Basal Ganglia Mechanisms of Reward‐Oriented Eye Movement
  • O. Hikosaka
  • Biology, Psychology
    Annals of the New York Academy of Sciences
  • 2007
TLDR
D dopamine‐dependent information processing in the CD is necessary for the reward‐dependent modulation of saccadic eye movement and D1 and D2 receptors play differential roles depending on the positive and negative reward outcomes.
Dopamine-Mediated Learning and Switching in Cortico-Striatal Circuit Explain Behavioral Changes in Reinforcement Learning
TLDR
A computational model of reinforcement learning that uses different thresholds of D1- and D2-mediatedaptic plasticity which are antagonized by DA-independent synaptic plasticity is proposed, which can explain the robust behavioral adaptation observed in a location-reward-value-association task.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 36 REFERENCES
Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement.
TLDR
Activity of midbrain dopamine neurons and caudate projection neurons is examined while monkeys were performing a one-direction-rewarded version of memory-guided saccade task to suggest that DA neurons, with their connection to CD neurons, modulate the spatially selective signals in CD neurons in the reward-predicting manner andCD neurons in turn modulate saccades parameters with their polysynaptic connections to the oculomotor brain stem.
Importance of unpredictability for reward responses in primate dopamine neurons.
TLDR
D dopamine neurons responded to liquid reward during learning but not when task performance was established, at which time the neuronal response occurred to the conditioned, reward-predicting, movement-triggering stimulus.
Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task
TLDR
Dopamine neurons respond phasically to alerting external stimuli with behavioral significance whose detection is crucial for learning and performing delayed response tasks.
Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus
TLDR
It is suggested that both rewarded and unrewarded saccades are facilitated by caudate saccadic activity, and the neuronal activity of unrewarding-saccade neurons might reflect the required execution of unreWARDed eye movements on the way to future reward.
Modulation of saccadic eye movements by predicted reward outcome
TLDR
A memory-guided saccade task in which only one fixed direction out of four was rewarded, called the one-direction-rewarded task (1DR), found that the parameters of saccades changed depending on whether or not the saccADE was followed by reward.
Role of Primate Substantia Nigra Pars Reticulata in Reward-Oriented Saccadic Eye Movement
TLDR
The results suggest that the CD–SNr–SC mechanism would promote saccades oriented to reward, where neurons show reward-contingent pre-cue and post-cue activity.
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus
Responses of monkey dopamine neurons during learning of behavioral reactions.
TLDR
D dopamine neurons responded simultaneously to the sight of primary food reward and to the conditioned stimulus associated with reward, thus demonstrating specificity for the behavioral significance of stimuli.
Is the short-latency dopamine response too short to signal reward error?
...
1
2
3
4
...