The hippocampus as a predictive map

@article{Stachenfeld2017TheHA,
  title={The hippocampus as a predictive map},
  author={Kimberly L. Stachenfeld and Matthew M. Botvinick and Samuel J. Gershman},
  journal={Nature Neuroscience},
  year={2017},
  volume={20},
  pages={1643-1653}
}
A cognitive map has long been the dominant metaphor for hippocampal function, embracing the idea that place cells encode a geometric representation of space. However, evidence for predictive coding, reward sensitivity and policy dependence in place cells suggests that the representation is not purely spatial. We approach this puzzle from a reinforcement learning perspective: what kind of spatial representation is most useful for maximizing future reward? We show that the answer takes the form… Expand

Figures and Topics from this paper

Neurobiological successor features for spatial navigation
TLDR
It is shown that the place and grid cells generated using the BVC‐SR model provide a good account of biological data for a variety of environmental manipulations, including dimensional stretches, barrier inserts, and the influence of environmental geometry on the hippocampal representation of space. Expand
Neurobiological successor features for spatial navigation
TLDR
It is shown that the place and grid cells generated using the BVC-SR model provide a good account of biological data for a variety of environmental manipulations, including dimensional stretches, barrier inserts, and the influence of environmental geometry on the hippocampal representation of space. Expand
A Dedicated Population for Reward Coding in the Hippocampus
TLDR
A virtual reality task with shifting reward contingencies to distinguish place versus reward encoding revealed a small, specialized cell population that was only active near reward yet whose activity could not be explained by sensory cues or stereotyped reward anticipation behavior. Expand
Predictive Representations in Hippocampal and Prefrontal Hierarchies
TLDR
It is hypothesized that multiscale predictive representations guide naturalistic navigation, and these scales are organized along posterior-anterior prefrontal and hippocampal hierarchies, and that anterior PFC showed the largest predictive horizons, posterior hippocampus the smallest, with the anterior hippocampus and orbitofrontal regions in between. Expand
Goal-centered representations in the human hippocampus
TLDR
It is demonstrated that, during planning, the hippocampus carries a context-specific representation of a future goal, and reinstatement of activity patterns in the hippocampus ahead of participants’ required actions, which was strongest for behaviorally relevant points in the sequence. Expand
Learning of distant state predictions by the orbitofrontal cortex in humans
TLDR
Activity across learning in the orbitofrontal cortex comes to represent expected states, up to 30 s in the future, which provides a mechanism by which the brain can build models of the world that span long-timescales to make predictions. Expand
A non-spatial account of place and grid cells based on clustering models of concept learning
TLDR
It is found that a domain-general learning algorithm explains key findings in both spatial and conceptual domains. Expand
Experience dependent contextual codes in the hippocampus
TLDR
This work shows that remapping of neural representations in region CA1 of the hippocampus is strongly driven by prior beliefs about the frequency of certain contexts, and that remapped is equivalent to an optimal estimate of the identity of the current context under that prior. Expand
Grid coding, spatial representation, and navigation: Should we assume an isomorphism?
TLDR
This work provides a critique of the frequently employed assumption of an isomorphism between patterns of neural activity, mental representation, and behavior and suggests that human spatial navigation is perhaps best characterized by a wide variety of both metric and nonmetric strategies. Expand
Hippocampal representations switch from errors to predictions during acquisition of predictive associations
TLDR
It is found that the hippocampus initially preferentially represented unexpected shapes, but later switched to representing the cue-predicted shape regardless of which was actually presented. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 59 REFERENCES
Grid Cells, Place Cells, and Geodesic Generalization for Spatial Reinforcement Learning
TLDR
This work examines how two of the brain's location representations—hippocampal place cells and entorhinal grid cells—are adapted to serve as basis functions for approximating value over space for RL, and proposes a proposal that place and grid responses should be modulated by geodesic distances. Expand
A map of abstract relational knowledge in the human hippocampal–entorhinal cortex
TLDR
It is shown that the human hippocampal–entorhinal system can represent relationships between objects using a metric that depends on associative strength, akin to the successor representation that has been proposed to account for place and grid-cell firing patterns. Expand
A Model of Spatial Map Formation in the Hippocampus of the Rat
TLDR
Using experimental facts about long-term potentiation (LTP) and hippocampal place cells, this model demonstrates how behaviorally generated modifications of synaptic strengths can be read out to affect subsequent behavior and suggests a way that navigational maps can be constructed from experimental recordings of hippocampus. Expand
Interpreting hippocampal function as recoding and forecasting
TLDR
A model of hippocampal function, centered on region CA3, reproduces many of the cognitive and behavioral functions ascribed to the hippocampus and confirms the critical importance of randomly driven recoding and the neurocognitive relevance of sequence learning and compression. Expand
An event map of memory space in the hippocampus
TLDR
Monitoring the de novo formation of a spatio-temporal representation of space and time in humans using fMRI provides evidence for a common coding mechanism underlying spatial and temporal aspects of episodic memory in the hippocampus and sheds new light on its role in interleaving multiple episodes in a neural event map of memory space. Expand
The role of the hippocampus in prediction and imagination.
  • R. Buckner
  • Psychology, Medicine
  • Annual review of psychology
  • 2010
TLDR
In rats, hippocampal ensembles preplay and replay event sequences in the absence of overt behavior could provide the neural building blocks for simulating upcoming events during decision-making, planning, and when imagining novel scenarios. Expand
A model of hippocampally dependent navigation, using the temporal difference learning rule
TLDR
The model successfully captures gradual acquisition in both tasks, and, in particular, the ultimate development of one‐trial learning in the delayed matching‐to‐place task. Expand
Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point
TLDR
The data suggest that the hippocampus does not represent space as a passive computation, but rather that hippocampal spatial processing is an active process likely regulated by cognitive mechanisms. Expand
Statistical learning of temporal community structure in the hippocampus
TLDR
It is found that the hippocampus is indeed sensitive to higher‐order structure, as revealed by its representations, activity dynamics, and connectivity with other regions, which suggest that it is a sophisticated learner of environmental regularities, able to uncover higher-order structure that requires sensitivity to overlapping associations. Expand
Functional organization of the hippocampal longitudinal axis
TLDR
Together, anatomical studies and electrophysiological recordings in rodents suggest a model in which functional long-axis gradients are superimposed on discrete functional domains, which provides a potential framework to explain and test the multiple functions ascribed to the hippocampus. Expand
...
1
2
3
4
5
...