Corpus ID: 221655410

Synthesizing brain tumor images and annotations by combining progressive growing GAN and SPADE

  title={Synthesizing brain tumor images and annotations by combining progressive growing GAN and SPADE},
  author={Mehdi Foroozandeh and Anders Eklund},
Training segmentation networks requires large annotated datasets, but manual annotation is time consuming and costly. We here investigate if the combination of a noise-to-image GAN and an image-to-image GAN can be used to synthesize realistic brain tumor images as well as the corresponding tumor annotations (labels), to substantially increase the number of training images. The noise-to-image GAN is used to synthesize new label images, while the image-to-image GAN generates the corresponding MR… Expand

Figures and Tables from this paper

A Review of Generative Adversarial Networks in Cancer Imaging: New Applications, New Solutions
The potential of GANs to address a number of key challenges of cancer imaging, including data scarcity and imbalance, domain and dataset shifts, data access and privacy, data annotation and quantification, as well as cancer detection, tumour profiling and treatment planning are assessed. Expand
Anonymization of labeled TOF-MRA images for brain vessel segmentation using generative adversarial networks
Synthetic image-label pairs retained generalizable information and showed good performance for vessel segmentation and showed that synthetic patches can be used in a transfer learning approach with independent data, paving the way to overcome the challenges of scarce data and anonymization in medical imaging. Expand


GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification
It is shown that generated medical images can be used for synthetic data augmentation, and improve the performance of CNN for medical image classification, and generalize to other medical classification applications and thus support radiologists’ efforts to improve diagnosis. Expand
Feeding the zombies: Synthesizing brain volumes using a 3D progressive growing GAN
  • A. Eklund
  • Computer Science, Engineering
  • ArXiv
  • 2019
Preliminary results are presented showing that a 3D progressive growing GAN can be used to synthesize MR brain volumes. Expand
U-Net: Convolutional Networks for Biomedical Image Segmentation
It is shown that such a network can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks. Expand
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
The set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences are reported, finding that different algorithms worked best for different sub-regions, but that no single algorithm ranked in the top for all sub-Regions simultaneously. Expand
A survey on deep learning in medical image analysis
This paper reviews the major deep learning concepts pertinent to medical image analysis and summarizes over 300 contributions to the field, most of which appeared in the last year, to survey the use of deep learning for image classification, object detection, segmentation, registration, and other tasks. Expand
GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks
The feasibility of introducing GAN derived synthetic data to the training datasets in two brain segmentation tasks is demonstrated, leading to improvements in Dice Similarity Coefficient of between 1 and 5 percentage points under different conditions, with the strongest effects seen fewer than ten training image stacks are available. Expand
Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features
This set of labels and features should enable direct utilization of the TCGA/TCIA glioma collections towards repeatable, reproducible and comparative quantitative studies leading to new predictive, prognostic, and diagnostic assessments, as well as performance evaluation of computer-aided segmentation methods. Expand
Progressive Growing of GANs for Improved Quality, Stability, and Variation
A new training methodology for generative adversarial networks is described, starting from a low resolution, and adding new layers that model increasingly fine details as training progresses, allowing for images of unprecedented quality. Expand
Synthetic Medical Images from Dual Generative Adversarial Networks
A novel, two-stage pipeline for generating synthetic medical images from a pair of generative adversarial networks, tested in practice on retinal fundi images and develops a hierarchical generation process to divide the complex image generation task into two parts: geometry and photorealism. Expand
Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge
This study assesses the state-of-the-art machine learning methods used for brain tumor image analysis in mpMRI scans, during the last seven instances of the International Brain Tumor Segmentation (BraTS) challenge, i.e., 2012-2018, and investigates the challenge of identifying the best ML algorithms for each of these tasks. Expand