Corpus ID: 199000714

Multi-task Generative Adversarial Learning on Geometrical Shape Reconstruction from EEG Brain Signals

  title={Multi-task Generative Adversarial Learning on Geometrical Shape Reconstruction from EEG Brain Signals},
  author={Xinyang Zhang and Xiaocong Chen and Manqing Dong and H. Liu and Chang Ge and Lina Yao},
  journal={Aust. J. Intell. Inf. Process. Syst.},
Synthesizing geometrical shapes from human brain activities is an interesting and meaningful but very challenging topic. Recently, the advancements of deep generative models like Generative Adversarial Networks (GANs) have supported the object generation from neurological signals. However, the Electroencephalograph (EEG)-based shape generation still suffer from the low realism problem. In particular, the generated geometrical shapes lack clear edges and fail to contain necessary details. In… Expand
Generative Adversarial U-Net for Domain-free Medical Image Augmentation
This paper develops a novel generative method named generative adversarial U-Net, which utilizes both generatives adversarial network and U- net and is domain-free and generalizable to various medical images. Expand
Neural Photofit: Gaze-based Mental Image Reconstruction
We propose a novel method that leverages human fixations to visually decode the image a person has in mind into a photofit (facial composite). Our method combines three neural networks: An encoder, aExpand


Generative Adversarial Networks Conditioned by Brain Signals
The results show that for classes represented by well-defined visual patterns, the generated images are realistic and highly resemble those evoking the EEG signals used for conditioning GANs, resulting in an actual reading-the-mind process. Expand
Generative adversarial networks for reconstructing natural images from brain activity
A method for reconstructing visual stimuli from brain activity using a deep convolutional generative adversarial network capable of generating gray scale photos, similar to stimuli presented during two functional magnetic resonance imaging experiments is explored. Expand
Brain2Image: Converting Brain Signals into Images
A deep-learning framework consisting of an LSTM stacked with a generative method, which learns a more compact and noise-free representation of EEG data and employs it to generate the visual stimuli evoking specific brain responses to generate images that are semantically coherent to the evoking visual stimuli. Expand
On the Vulnerability of CNN Classifiers in EEG-Based BCIs
  • Xiao Zhang, Dongrui Wu
  • Computer Science, Medicine
  • IEEE Transactions on Neural Systems and Rehabilitation Engineering
  • 2019
An unsupervised fast gradient sign method (UFGSM) is proposed to attack three popular CNN classifiers in BCI, and its effectiveness is demonstrated, and the transferability of adversarial examples in BCIs is verified. Expand
Improved Techniques for Training GANs
This work focuses on two applications of GANs: semi-supervised learning, and the generation of images that humans find visually realistic, and presents ImageNet samples with unprecedented resolution and shows that the methods enable the model to learn recognizable features of ImageNet classes. Expand
Generative Adversarial Nets
We propose a new framework for estimating generative models via an adversarial process, in which we simultaneously train two models: a generative model G that captures the data distribution, and aExpand
Conditional Image Synthesis with Auxiliary Classifier GANs
A variant of GANs employing label conditioning that results in 128 x 128 resolution image samples exhibiting global coherence is constructed and it is demonstrated that high resolution samples provide class information not present in low resolution samples. Expand
Converting Your Thoughts to Texts: Enabling Brain Typing via Deep Feature Learning of EEG Signals
A novel deep neural network based learning framework that affords perceptive insights into the relationship between the MI-EEG data and brain activities is proposed, which outperforms a series of baselines and the competitive state-of-the-art methods. Expand
Conditional Generative Adversarial Nets
The conditional version of generative adversarial nets is introduced, which can be constructed by simply feeding the data, y, to the generator and discriminator, and it is shown that this model can generate MNIST digits conditioned on class labels. Expand
Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals
In this work, a 13-layer deep convolutional neural network (CNN) algorithm is implemented to detect normal, preictal, and seizure classes and achieved an accuracy, specificity, and sensitivity of 88.67%, 90.00% and 95.00%, respectively. Expand