Uncertainty, Neuromodulation, and Attention

@article{Yu2005UncertaintyNA,
  title={Uncertainty, Neuromodulation, and Attention},
  author={Angela J. Yu and Peter Dayan},
  journal={Neuron},
  year={2005},
  volume={46},
  pages={681-692}
}
View on Elsevier
cell.com
1,417 Citations
Highly Influential Citations
107
Background Citations
760
Methods Citations
75
Results Citations
63

Figures from this paper

1,417 Citations

Ach and NE : Bayes, uncertainty, attention and learning.

It is proposed that the neuromodulatory systems such as acetylcholine (ACh) and norepinephrine (NE) play a major role in the brain's implementation of these uncertainty computations, and they exhibit properties that are consistent with a diverse body of pharmacological, behavioral, electrophysiological, and neurological findings.

FOUR Uncertainty and Neuromodulation : Focus on Acetylcholine and Sustained Attention

Decision making is an essential component of intelligent behavior. Whether interpreting sensory inputs, allocating cognitive resources, or planning actions, the brain constantly makes decisions based…

Pharmacological Fingerprints of Contextual Uncertainty

It is proposed that noradrenaline influences learning of uncertain events arising from unexpected changes in the environment, and acetylcholine balances attribution of uncertainty to chance fluctuations within an environmental context, defined by a stable set of probabilistic associations, or to gross environmental violations following a contextual switch.

The Computational, Pharmacological, and Physiological Determinants of Sensory Learning under Uncertainty

Dopamine, Inference, and Uncertainty

It is postulated that orbitofrontal cortex transforms the stimulus representation through recurrent dynamics, such that a simple error-driven learning rule operating on the transformed representation can implement the Bayesian reinforcement learning update.

Switching Operation Modes in the Neocortex via Cholinergic Neuromodulation

This model proposes that cortical acetylcholine favors sensory exploration over exploitation in a cortical microcircuit dedicated to estimating sensory uncertainty, and identifies its interactions with cortical inhibitory interneurons and derives a biophysically grounded computational model able to capture and learn from uncertainty.

Attention, Uncertainty, and Free-Energy

It is shown that if the precision depends on the states, one can explain many aspects of attention, including attentional bias or gating, competition for attentional resources, attentional capture and associated speed-accuracy trade-offs.

Phasic norepinephrine: A neural interrupt signal for unexpected events

It is proposed that it is unexpected changes in the world within the context of a task that activate the noradrenergic interrupt signal, and this idea is quantified in a Bayesian model of a well-studied visual discrimination task, demonstrating that the model captures a rich repertoire of nor adrenergic responses at the sub-second temporal resolution.

Representations of uncertainty in sensorimotor control

The neurobiology of uncertainty: implications for statistical learning

  • U. Hasson
  • Biology
    Philosophical Transactions of the Royal Society B: Biological Sciences
  • 2017
It may be useful to establish closer links between neurobiological research on uncertainty and SL, considering particularly mechanisms sensitive to local and global structure in inputs, the degree of input uncertainty, the complexity of the system generating the input, learning mechanisms that operate on different temporal scales and the use of learnt information for online prediction.
...

References

SHOWING 1-10 OF 96 REFERENCES

Expected and Unexpected Uncertainty: ACh and NE in the Neocortex

It is suggested that norepinephrine reports the radical divergence of bottom-up inputs from prevailing top-down interpretations, to influence inference and plasticity.

Acetylcholine in cortical inference

Bayesian integration in sensorimotor learning

This work shows that subjects internally represent both the statistical distribution of the task and their sensory uncertainty, combining them in a manner consistent with a performance-optimizing bayesian process.

Uncertainty and Learning

The links between learning and uncertainty are reviewed from three perspectives: statistical theories such as the Kalman filter, psychological models in which differential attention is paid to stimuli with an effect on the speed of learning associated with those stimuli, and neurobiological data on the influence of the neuromodulators acetylcholine and norepinephrine on learning and inference.

Metalearning and neuromodulation

  • K. Doya
  • Psychology, Biology
    Neural Networks
  • 2002

Learning by neurones: role of attention, reinforcement and behaviour.

  • S. Sara
  • Biology, Psychology
    Comptes rendus de l'Academie des sciences. Serie III, Sciences de la vie
  • 1998

Inference, Attention, and Decision in a Bayesian Neural Architecture

A hierarchical neural architecture is proposed, which implements Bayesian integration of noisy sensory input and top-down attentional priors, leading to sound perceptual discrimination and a possible reconciliation of cortical and neuromodulatory representations of uncertainty.

Inference and computation with population codes.

This paper reviews both approaches to neural computation, with a particular emphasis on the latter, which the authors see as a very promising framework for future modeling and experimental work.

Neuromodulation: acetylcholine and memory consolidation

  • M. Hasselmo
  • Biology, Psychology
    Trends in Cognitive Sciences
  • 1999

Locus coeruleus-evoked responses in behaving rats: A clue to the role of noradrenaline in memory

...