Neuroimaging: Decoding mental states from brain activity in humans

  title={Neuroimaging: Decoding mental states from brain activity in humans},
  author={John-Dylan Haynes and Geraint Rees},
  journal={Nature Reviews Neuroscience},
Recent advances in human neuroimaging have shown that it is possible to accurately decode a person's conscious experience based only on non-invasive measurements of their brain activity. Such 'brain reading' has mostly been studied in the domain of visual perception, where it helps reveal the way in which individual experiences are encoded in the human brain. The same approach can also be extended to other types of mental state, such as covert attitudes and lie detection. Such applications… 
Decoding visual consciousness from human brain signals
  • J. Haynes
  • Psychology, Biology
    Trends in Cognitive Sciences
  • 2009
Thought experiment: Decoding cognitive processes from the fMRI data of one individual
The study shows how the information contained in a single fMRI session and in each of its single blocks can allow to draw inferences about the cognitive processes an individual engaged in.
The role of fMRI in Cognitive Neuroscience: where do we stand?
A Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives
Detecting cognitive states from the analysis of structural and functional images of the brain: two applications of Multi-Voxel Pattern Analysis on MRI and fMRI data
The aim of this thesis is to contribute to the amount of studies showing the usefulness of multivariate techniques in decoding “mental states” starting from the analysis of structural and functional brain imaging data, as well as the potential uses in clinical and forensic settings.
Decoding mental activity from neuroimaging data — the science behind mind-reading
The ability to tell, by scanning someones brain, which picture they were looking at, is the result of a study carried out at the University of California, Berkeley, and it may soon be possible to reconstruct a picture of a persons visual experience from measurements of brain activity alone.
Inferring Cognition from fMRI Brain Images
This work describes the process used to reduce the extremely high-dimensional feature space and a comparison of the models used for prediction, and provides experimental evidence that non-linear models such as multi-layer perceptron and especially recurrent neural networks are significantly better.
Multivariate decoding of fMRI data
An overview of several developments, spanning from applications in cognitive neuroscience to methodology (information flow, surface-based searchlight decoding) and medical diagnostics, are provided.
Decoding Multiple Subject fMRI Data using Manifold based Representation of Cognitive State Neural Signatures
In this paper, the process of creating a geometrical representation of the activations using non-linear manifolds is described and it is shown that this kind of representation is able to give high accuracy in classification studies as compared to using activation profiles.


Inferring behavior from functional brain images
It is reported here that functional magnetic resonance images of motor cortex have sufficient signal-to-noise ratio to accurately predict the subject's manual behavior on a single-trial basis with close to 100% accuracy.
Classifying Instantaneous Cognitive States from fMRI Data
A machine learning approach to the problem of detecting the instantaneous cognitive state of a human subject based on their observed functional Magnetic Resonance Imaging (fMRI) data is described and its successful use for discriminating cognitive states is reported.
Decoding the visual and subjective contents of the human brain
It is found that ensemble fMRI signals in early visual areas could reliably predict on individual trials which of eight stimulus orientations the subject was seeing, when subjects had to attend to one of two overlapping orthogonal gratings.
Behavioural and functional anatomical correlates of deception in humans
Lying was associated with longer response times and greater activity in bilateral ventrolateral prefrontal cortices and Ventrolateral cortex may be engaged in generating lies or withholding the truth.
Learning to Decode Cognitive States from Brain Images
This paper describes recent research applying machine learning methods to the problem of classifying the cognitive state of a human subject based on fRMI data observed over a single time interval, and presents case studies in which classifiers are successfully trained to distinguish cognitive states.
Can cognitive processes be inferred from neuroimaging data?
Information-based functional brain mapping.
The development of high-resolution neuroimaging and multielectrode electrophysiological recording provides neuroscientists with huge amounts of multivariate data, but the local averaging standardly applied to this end may obscure the effects of greatest neuroscientific interest.
Neural correlates of different types of deception: an fMRI investigation.
Deception is a complex cognitive activity, and different types of lies could arise from different neural systems. We investigated this possibility by first classifying lies according to two
Repetition and the brain: neural models of stimulus-specific effects
A Cortical Area Selective for Visual Processing of the Human Body
A series of functional magnetic resonance imaging studies revealing substantial evidence for a distinct cortical region in humans that responds selectively to images of the human body, as compared with a wide range of control stimuli.