Uncertainty, Neuromodulation, and Attention

  title={Uncertainty, Neuromodulation, and Attention},
  author={Angela J. Yu and Peter Dayan},

Figures from this paper

Ach and NE : Bayes, uncertainty, attention and learning.

It is proposed that the neuromodulatory systems such as acetylcholine (ACh) and norepinephrine (NE) play a major role in the brain's implementation of these uncertainty computations, and they exhibit properties that are consistent with a diverse body of pharmacological, behavioral, electrophysiological, and neurological findings.

FOUR Uncertainty and Neuromodulation : Focus on Acetylcholine and Sustained Attention

Decision making is an essential component of intelligent behavior. Whether interpreting sensory inputs, allocating cognitive resources, or planning actions, the brain constantly makes decisions based

Pharmacological Fingerprints of Contextual Uncertainty

It is proposed that noradrenaline influences learning of uncertain events arising from unexpected changes in the environment, and acetylcholine balances attribution of uncertainty to chance fluctuations within an environmental context, defined by a stable set of probabilistic associations, or to gross environmental violations following a contextual switch.

Attention, Uncertainty, and Free-Energy

It is shown that if the precision depends on the states, one can explain many aspects of attention, including attentional bias or gating, competition for attentional resources, attentional capture and associated speed-accuracy trade-offs.

Phasic norepinephrine: A neural interrupt signal for unexpected events

It is proposed that it is unexpected changes in the world within the context of a task that activate the noradrenergic interrupt signal, and this idea is quantified in a Bayesian model of a well-studied visual discrimination task, demonstrating that the model captures a rich repertoire of nor adrenergic responses at the sub-second temporal resolution.

Representations of uncertainty in sensorimotor control

The neurobiology of uncertainty: implications for statistical learning

  • U. Hasson
  • Biology
    Philosophical Transactions of the Royal Society B: Biological Sciences
  • 2017
It may be useful to establish closer links between neurobiological research on uncertainty and SL, considering particularly mechanisms sensitive to local and global structure in inputs, the degree of input uncertainty, the complexity of the system generating the input, learning mechanisms that operate on different temporal scales and the use of learnt information for online prediction.

Uncertainty, epistemics and active inference

A generative model is proposed that represents the beliefs an agent might possess about their own uncertainty and how uncertainty influences optimal epistemic (visual) foraging by simulating a noisy and volatile environment.

Simulation of cholinergic and noradrenergic modulation of behavior in uncertain environments

A model of an attention task that involves expected and unexpected uncertainty is developed and sheds light on how the noradrenergic and cholinergic systems interact with each other and a distributed set of neural areas, and how this could lead to behavioral adaptation in the face of uncertainty.



Expected and Unexpected Uncertainty: ACh and NE in the Neocortex

It is suggested that norepinephrine reports the radical divergence of bottom-up inputs from prevailing top-down interpretations, to influence inference and plasticity.

Acetylcholine in cortical inference

Bayesian integration in sensorimotor learning

This work shows that subjects internally represent both the statistical distribution of the task and their sensory uncertainty, combining them in a manner consistent with a performance-optimizing bayesian process.

Uncertainty and Learning

The links between learning and uncertainty are reviewed from three perspectives: statistical theories such as the Kalman filter, psychological models in which differential attention is paid to stimuli with an effect on the speed of learning associated with those stimuli, and neurobiological data on the influence of the neuromodulators acetylcholine and norepinephrine on learning and inference.

Metalearning and neuromodulation

  • K. Doya
  • Psychology, Biology
    Neural Networks
  • 2002

Learning by neurones: role of attention, reinforcement and behaviour.

  • S. Sara
  • Biology, Psychology
    Comptes rendus de l'Academie des sciences. Serie III, Sciences de la vie
  • 1998

Inference, Attention, and Decision in a Bayesian Neural Architecture

A hierarchical neural architecture is proposed, which implements Bayesian integration of noisy sensory input and top-down attentional priors, leading to sound perceptual discrimination and a possible reconciliation of cortical and neuromodulatory representations of uncertainty.

Inference and computation with population codes.

This paper reviews both approaches to neural computation, with a particular emphasis on the latter, which the authors see as a very promising framework for future modeling and experimental work.

Neuromodulation: acetylcholine and memory consolidation

  • M. Hasselmo
  • Biology, Psychology
    Trends in Cognitive Sciences
  • 1999

Locus coeruleus-evoked responses in behaving rats: A clue to the role of noradrenaline in memory