Brain Decoding from Functional MRI Using Long Short-Term Memory Recurrent Neural Networks

@article{Li2018BrainDF,
  title={Brain Decoding from Functional MRI Using Long Short-Term Memory Recurrent Neural Networks},
  author={Hongming Li and Yong Fan},
  journal={Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year={2018},
  volume={11072},
  pages={
          320-328
        }
}
  • Hongming Li, Yong Fan
  • Published 14 September 2018
  • Computer Science, Psychology
  • Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain functional connectivity or brain activation signatures for a variety of brain decoding tasks. However, most of existing studies have built decoding models upon features extracted from imaging data at individual time points or temporal windows with a fixed… 
Robust Brain State Decoding using Bidirectional Long Short Term Memory Networks in functional MRI
TLDR
This paper performs robust brain state decoding via information encapsulation from both the past and future instances of fMRI data via bi-directional LSTM, which allows for explicitly modeling the dynamics of BOLD response without any delay adjustment.
Decoding Brain States From fMRI Signals by Using Unsupervised Domain Adaptation
TLDR
The proposed deep cross-subject adaptation decoding (DCAD) framework can automatically learn the common spatiotemporal features of labeled source data to generate a distinct descriptor via an unsupervised domain adaptation (UDA) method, which can help to accurately decode the cognitive states across subjects.
fMRI Brain Decoding and Its Applications in Brain–Computer Interface: A Survey
TLDR
Current brain activity decoding models with high attention are reviewed: variational auto-encoder (VAE), generative confrontation network (GAN), and the graph convolutional network (GCN).
Decoding Task States by Spotting Salient Patterns at Time Points and Brain Regions
TLDR
A customised neural network architecture, Salient Patterns Over Time and Space (SPOTS), which not only captures dependencies of brain states at different time points but also pays attention to key brain regions associated with the task.
Attention module improves both performance and interpretability of four‐dimensional functional magnetic resonance imaging decoding neural network
TLDR
The proposed 4D model with attention module performed well and facilitated interpretation of DNNs, which is helpful for subsequent research.
Brain Decoding Using fMRI Images for Multiple Subjects through Deep Learning
TLDR
This research proposes an improved CNN technique where features will be functionally aligned, and the highly dimensional feature vector will be transformed into low dimensional space for dimensionality reduction through autoadjusted weights and combination of best activation functions.
Design of Deep Learning Model for Task-Evoked fMRI Data Classification
TLDR
A model is proposed that simultaneously utilizes characteristics of both spatial and temporal sequential information of fMRI data with deep neural networks to classify the fMRI task states and adds the attention mechanism to the recurrent network module, which more effectively highlights the brain activation state at the moment of reaction.
Jointly Discriminative and Generative Recurrent Neural Networks for Learning from fMRI
TLDR
A novel RNN-based model that learns to discriminate between classes while simultaneously learning to generate the fMRI time-series data and improves classification learning while also producing robust and meaningful functional communities for better model understanding is designed.
An Automatic Encoding and Decoding Method for Differentiating Alzheimer's Disease with Functional MRI
TLDR
This study focuses on the image feature automatic encoding and decoding in sequence by a network, where convolutional neural network is used to extract abstract image features in each time step and a long-short term recurrent neural network used to combine features at all time.
...
...

References

SHOWING 1-10 OF 26 REFERENCES
Task state decoding and mapping of individual four-dimensional fMRI time series using deep neural network
TLDR
The reported findings were the first to demonstrate the ability of DNN to classify and extract heatmaps from a 4-D fMRI time series, as well as its ability to be transfer trained by a small dataset.
Decoding subject-driven cognitive states with whole-brain connectivity patterns.
TLDR
It is demonstrated that free-streaming subject-driven cognitive states can be decoded using a novel whole-brain functional connectivity analysis, and this approach should enable decoding a myriad of subject- driven cognitive states from brief imaging data samples.
Jointly Discriminative and Generative Recurrent Neural Networks for Learning from fMRI
TLDR
A novel RNN-based model that learns to discriminate between classes while simultaneously learning to generate the fMRI time-series data and improves classification learning while also producing robust and meaningful functional communities for better model understanding is designed.
Decoding fMRI activity in the time domain improves classification performance
Decoding the individual finger movements from single‐trial functional magnetic resonance imaging recordings of human brain activity
TLDR
The results suggest that the non‐invasive fMRI technique may provide informative features for decoding individual finger movements and the potential of developing an fMRI‐based brain–machine interface for finger movement.
Detecting Cognitive States from fMRI Images by Machine Learning and Multivariate Classification
TLDR
A hybrid feature selection method is utilized to select the most discriminative features, which are used to train a SVM classifier for decoding brain states from fMRI images, and yielded better results compared to other commonly used fMRI image classification methods.
Decoding the Semantic Content of Natural Movies from Human Brain Activity
TLDR
A decoding algorithm is presented that makes it possible to decode detailed information about the object and action categories present in natural movies from human brain activity signals measured by functional MRI.
...
...