Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex

@article{Alexander2015HierarchicalER,
  title={Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex},
  author={William H. Alexander and Joshua W. Brown},
  journal={Neural Computation},
  year={2015},
  volume={27},
  pages={2354-2410}
}
Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we… 
View on MIT Press
ccsrv1.psych.indiana.edu
81 Citations
Highly Influential Citations
3
Background Citations
34
Methods Citations
19
Results Citations
4

81 Citations

Interactions of Medial and Lateral Prefrontal Cortex in Hierarchical Predictive Coding

The HER model is extended to incorporate real-time temporal dynamics and it is demonstrated how the extended model is able to capture single-unit neurophysiological, behavioral, and network effects previously reported in the literature.

Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort

These modeling attempts to characterize the neurocognitive architecture of anterior cingulate cortex are critically evaluated, highlighting the continued need to reconcile the array of disparate ACC observations within a coherent, unifying framework.

The Role of the Anterior Cingulate Cortex in Prediction Error and Signaling Surprise

The result is a predictive coding model of the frontal lobes, suggesting that predictive coding may be a unifying computational principle across the neocortex.

Frontal cortex function as derived from hierarchical predictive coding

By reconceptualizing lateral prefrontal activity as anticipating prediction errors, the HER model provides a novel unifying account of prefrontal cortex function with broad implications for understanding the frontal cortex across multiple levels of description, from the level of single neurons to behavior.

Dorsal anterior cingulate-midbrain ensemble as a reinforcement meta-learner

A new model is proposed–the Reinforcement Meta Learner (RML)–in which core insights are exploited into the anatomical connections of the ACC with two midbrain catecholamine nuclei to generate an autonomous control system with the ability of learning to solve hierarchical decision problems without having an intrinsic hierarchical structure itself.

Macaque anterior cingulate cortex deactivation impairs performance and alters lateral prefrontal oscillatory activities in a rule-switching task

During both rule switching and maintenance, dACC deactivation prolonged the animals’ reaction time and reduced task-related theta/alpha activities in the dlPFC; it also weakened theta-gamma phase-amplitude modulation, which played a critical role in the maintenance of a new, challenging rule.

Predicting motivation: computational models of PFC can explain neural coding of motivation and effort-based decision-making in health and disease

This work discusses how the PRO model, based on prediction error, can explain effort-related activity in MPFC, by reframing effort-based behavior in a predictive context, and proposes that MPFC activity reflects monitoring of motivationally relevant variables, by coding expectations, and discrepancies from such expectations.

Surprise, value and control in anterior cingulate cortex during speeded decision-making

It is found that the single mechanism of surprise best accounts for activity in dACC during a task requiring response invigoration, suggesting surprise signalling as a shared driver of inhibitory and motivated control.

Mediofrontal Negativity Signals Unexpected Timing of Salient Outcomes

Mediofrontal ERP signals of prediction error were observed for outcomes occurring at unexpected times but were specific for salient (shock-associated), as compared with neutral, outcomes, which suggest a critical role of timing and salience information in prediction error signaling.

Neural encoding of task-dependent errors during adaptive learning

Using multi-voxel pattern classification, the brains of human participants performing a predictive-inference task with two conditions that had different sources of errors were imaged, providing new insights into how the human brain represents errors in a task-dependent manner and guides subsequent adaptive behavior.
...

References

SHOWING 1-10 OF 114 REFERENCES

Distinct regions of anterior cingulate cortex signal prediction and outcome evaluation

Functional Magnetic Resonance Imaging Evidence for a Hierarchical Organization of the Prefrontal Cortex

Test whether the rostro-caudal axis of the PFC is organized hierarchically, based on the level of abstraction at which multiple representations compete to guide selection of action, finding that activation in PFC subregions was consistent with an abstract representational hierarchy.

A general role for medial prefrontal cortex in event prediction

It is shown that the existing PRO model can learn to predict outcomes in a general sense, and not only when the outcomes are contingent on actions, which suggests that the mPFC learns to predict salient events in general.

Learned Predictions of Error Likelihood in the Anterior Cingulate Cortex

It is shown that ACC learns to predict error likelihood in a given context, even for trials in which there is no error or response conflict, which supports a more general error-likelihood theory of ACC function based on reinforcement learning.

Dissociable frontal-striatal and frontal-parietal networks involved in updating hierarchical contexts in working memory.

The results suggest that hierarchical contexts are organized by distinct frontal-striatal and frontal-parietal networks.

Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control.

Event-related functional magnetic resonance imaging and a task-switching version of the Stroop task were used to examine whether these components of cognitive control have distinct neural bases in the human brain and a double dissociation was found.

A Parallel Functional Topography between Medial and Lateral Prefrontal Cortex: Evidence and Implications for Cognitive Control

A model of cognitive control characterized by hierarchical interactions—whose level depends on current environmental demands—between functional subdivisions of medial and lateral PFC is posited.

Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia

This article presents an attempt to deconstruct this homunculus through powerful learning mechanisms that allow a computational model of the prefrontal cortex to control both itself and other brain areas in a strategic, task-appropriate manner.

Interactions between decision making and performance monitoring within prefrontal cortex

Using functional magnetic resonance imaging, this work demonstrates complementary and reciprocal roles for the human orbitofrontal (OFC) and dorsal anterior cingulate cortices (ACd) in monitoring the outcome of behavior.

The Architecture of Cognitive Control in the Human Prefrontal Cortex

Using brain imaging in humans, it is shown that the lateral PFC is organized as a cascade of executive processes from premotor to anterior PFC regions that control behavior according to stimuli, the present perceptual context, and the temporal episode in which stimuli occur, respectively.
...