Generalizing Brain Decoding Across Subjects with Deep Learning
@article{Csaky2022GeneralizingBD, title={Generalizing Brain Decoding Across Subjects with Deep Learning}, author={Richard Csaky and Mats W. J. van Es and Oiwi Parker Jones and Mark W. Woolrich}, journal={ArXiv}, year={2022}, volume={abs/2205.14102} }
Decoding experimental variables from brain imaging data is gaining popularity, with applications in brain-computer interfaces and the study of neural representations. Decoding is typically subject-specific and does not generalise well over subjects. Here, we investigate ways to achieve cross-subject decoding. We used magnetoencephalography (MEG) data where 15 subjects viewed 118 different images, with 30 examples per image. Training on the entire 1s window following the presentation of each…
Figures from this paper
References
SHOWING 1-10 OF 47 REFERENCES
Sequence Transfer Learning for Neural Decoding
- Computer SciencebioRxiv
- 2017
This work demonstrates that LSTMS are a versatile model that can accurately capture temporal patterns in neural data and can provide a foundation for transfer learning in neural decoding.
Inter-Subject MEG Decoding for Visual Information with Hybrid Gated Recurrent Network
- Computer ScienceApplied Sciences
- 2021
A hybrid gated recurrent network (HGRN) is proposed for inter-subject visual MEG decoding and can be considered as a new tool for decoding and analyzing brain MEG signal, which is significant for visual cognitive research in neuroscience.
Brain Encoding and Decoding in fMRI with Bidirectional Deep Generative Models
- Computer ScienceEngineering
- 2019
Optimizing Layers Improves CNN Generalization and Transfer Learning for Imagined Speech Decoding from EEG
- Computer Science2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)
- 2019
Two distinct TL methodologies are employed to classify EEG data corresponding to imagined speech production of vowels, using a deep convolutional neural network (CNN), and fine-tuning of the input layers resulted in the highest overall accuracy.
Across-subject offline decoding of motor imagery from MEG and EEG
- Computer SciencebioRxiv
- 2018
MTL and training with other subject’s MI is efficient for inter-subject decoding of MI, and passive movements of other subjects are likely suboptimal for training the MI classifiers.
The relationship between frequency content and representational dynamics in the decoding of neurophysiological data
- Computer ScienceNeuroImage
- 2022
Identifying natural images from human brain activity
- Biology, PsychologyNature
- 2008
A decoding method based on quantitative receptive-field models that characterize the relationship between visual stimuli and fMRI activity in early visual areas is developed and it is suggested that it may soon be possible to reconstruct a picture of a person’s visual experience from measurements of brain activity alone.
Classification of imagined spoken Word-Pairs using Convolutional Neural Networks
- Computer ScienceGBCIC
- 2019
The potential of deep learning is considered as a possible alternative to traditional BCI methodologies in relation to imagined speech EEG decoding, and two different convolutional neural networks were trained on multiple imagined speech word-pairs.
Intra- and Inter-subject Variability in EEG-Based Sensorimotor Brain Computer Interface: A Review
- Psychology, Computer ScienceFrontiers in Computational Neuroscience
- 2019
The importance of measuring inter-session/subject performance predictors for generalized BCI frameworks for both normal and motor-impaired people is highlighted, reducing the necessity for tedious and annoying calibration sessions and BCI training.
Decoding Imagined and Spoken Phrases From Non-invasive Neural (MEG) Signals
- Computer ScienceFrontiers in Neuroscience
- 2020
This study investigated the decoding of five imagined and spoken phrases from single-trial, non-invasive magnetoencephalography (MEG) signals collected from eight adult subjects and found convolutional neural networks applied on the spatial, spectral and temporal features extracted from the MEG signals to be highly effective.