The overfitted brain: Dreams evolved to assist generalization

  title={The overfitted brain: Dreams evolved to assist generalization},
  author={Erik P. Hoel},
  • Erik P. Hoel
  • Published 2021
  • Computer Science, Biology, Medicine
  • Patterns
Summary Understanding of the evolved biological function of sleep has advanced considerably in the past decade. However, no equivalent understanding of dreams has emerged. Contemporary neuroscientific theories often view dreams as epiphenomena, and many of the proposals for their biological function are contradicted by the phenomenology of dreams themselves. Now, the recent advent of deep neural networks (DNNs) has finally provided the novel conceptual framework within which to understand the… Expand
Intelligence plays dice: Stochasticity is essential for machine learning
It is argued that stochasticity plays a fundamentally different role in machine learning (ML) and is likely a critical ingredient of intelligent systems. Expand
Memory semantization through perturbed and adversarial dreaming
Classical theories of memory consolidation emphasize the importance of replay in extracting semantic information from episodic memories. However, the characteristic creative nature of dreams suggestsExpand
RL Generalization in a Theory of Mind Game Through a Sleep Metaphor (Student Abstract)
This work introduces a novel model trained using a sleep metaphor on a reduced complexity version of the Hanabi game, which consists of an altered training regiment, as well as an informationtheoretic constraint on the agent’s policy. Expand
Relationship Between Epilepsy and Dreaming: Current Knowledge, Hypotheses, and Perspectives
The interactions between epilepsy and sleep are numerous and the impact of epilepsy on cognition is well documented. Epilepsy is therefore likely to influence dreaming as one sleep-related cognitiveExpand
The Ouroboros Model, Proposal for Self-Organizing General Cognition Substantiated
The Ouroboros Model has been proposed as a biologically-inspired comprehensive cognitive architecture for general intelligence, comprising natural and artificial manifestations, and how the postulated structures have met with supportive evidence over recent years is described. Expand
The overfitted brain hypothesis
This issue of Patterns, Erik Hoel proposes a novel hypothesis, namely, that dreaming provides a means to reduce overfitting, which is interesting both for neuroscience and for the development of new machine-learning systems. Expand
Apical drive—A cellular mechanism of dreaming?
It is proposed that during dreams the output of certain pyramidal neurons is mainly driven by input into the apical integration zone (AIZ), and it is suggested that apical drive may also contribute to waking experiences, such as mental imagery. Expand


Beyond the neuropsychology of dreaming: Insights into the neural basis of dreaming with new techniques of sleep recording and analysis.
Hd-EEG techniques, used on their own or in combination with neuroimaging, appear able to provide further important insights into how the brain generates not only dreaming during sleep but also some dreamlike experiences in waking. Expand
Dreamed Movement Elicits Activation in the Sensorimotor Cortex
It is shown here that a predefined motor task performed during dreaming elicits neuronal activation in the sensorimotor cortex, providing first evidence that specific contents of REM-associated dreaming can be visualized by neuroimaging. Expand
Dreaming and the brain: from phenomenology to neurophysiology
It is possible to start integrating these two strands of research to address fundamental questions that dreams pose for cognitive neuroscience: how conscious experiences in sleep relate to underlying brain activity; why the dreamer is largely disconnected from the environment; and whether dreaming is more closely related to mental imagery or to perception. Expand
The neural substrate for dreaming: is it a subsystem of the default network?
It is argued that the likely neural substrate that supports dreaming, which was discovered through converging lesion and neuroimaging studies, may be a subsystem of the waking default network, which is active during mind wandering, daydreaming, and simulation. Expand
Dreaming and the default network: A review, synthesis, and counterintuitive research proposal
The seemingly counterintuitive hypothesis that the neural correlates for dreaming could be further specified in the process of carrying out EEG/fMRI studies of mind-wandering and default network activity is presented. Expand
The neural correlates of dreaming
Monitoring this posterior 'hot zone' in real time predicted whether an individual reported dreaming or the absence of dream experiences during NREM sleep, suggesting that it may constitute a core correlate of conscious experiences in sleep. Expand
The Functional Role of Dreaming in Emotional Processes
Dream experience can defuse emotional traumatic memories when the emotional regulation and the fear extinction mechanisms are compromised by traumatic and frightening events, and could represent a sort of simulation of reality, providing the possibility to create a new scenario with emotional mastery elements to cope with dysphoric items included in nightmares. Expand
Human cognition during REM sleep and the activity profile within frontal and parietal cortices: a reappraisal of functional neuroimaging data.
The significance of a meta-analysis of a large dataset of positron emission tomography scans acquired during wakefulness, slow wave sleep and REM sleep to explain the alteration in executive processes, episodic memory retrieval and self representation during REM sleep dreaming as well as the incorporation of external stimuli into the dream narrative is discussed. Expand
A deep learning framework for neuroscience
It is argued that a deep network is best understood in terms of components used to design it—objective functions, architecture and learning rules—rather than unit-by-unit computation. Expand
Nightmares, Bad Dreams, and Emotion Dysregulation
Nightmares—vivid, emotionally dysphoric dreams—are quite common and are associated with a broad range of psychiatric conditions. However, the origin of such dreams remains largely unexplained, andExpand