Multimodal brain tumor classification

  title={Multimodal brain tumor classification},
  author={Marvin Lerousseau and Eric Deutsch and Nikos Paragios},
Cancer is a complex disease that provides various types of information depending on the scale of observation. While most tumor diagnostics are performed by observing histopathological slides, radiology images should yield additional knowledge towards the efficacy of cancer diagnostics. This work investigates a deep learning method combining whole slide images and magnetic resonance images to classify tumors. In particular, our solution comprises a powerful, generic and modular architecture for… 
Combining Radiology and Pathology for Automatic Glioma Classification
An innovative two-stage model to classify gliomas into three subtypes (i.e., glioblastoma, oligodendroglioma, and astrocytoma) based on radiology and histology data is proposed, which could advance multimodal-based glioma research and provide assistance to pathologists and neurologists in diagnosingglioma subtypes.


Weakly supervised multiple instance learning histopathological tumor segmentation
A weakly supervised framework for whole slide imaging segmentation that relies on standard clinical annotations, available in most medical systems, is proposed that exploits a multiple instance learning scheme for training models.
Segmentation and Classification in Digital Pathology for Glioma Research: Challenges and Deep Learning Approaches
The evaluations of the four deep learning-based image analysis methods presented indicate that carefully constructed deep learning algorithms are able to produce high accuracy in the analysis of biomedical image data and the combination of radiographic with histologic image information improves classification performance.
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
A multiple instance learning-based deep learning system that uses only the reported diagnoses as labels for training, thereby avoiding expensive and time-consuming pixel-wise manual annotations, and has the ability to train accurate classification models at unprecedented scale.
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
A new scaling method is proposed that uniformly scales all dimensions of depth/width/resolution using a simple yet highly effective compound coefficient and is demonstrated the effectiveness of this method on scaling up MobileNets and ResNet.
A Combined Radio-Histological Approach for Classification of Low Grade Gliomas
This work demonstrates the utility of deep learning and radiomics features for classification of low grade gliomas (LGG) into astrocytoma and oligodendroglioma and achieves a classification accuracy of 90% on the challenge test set.
Dropout-Enabled Ensemble Learning for Multi-Scale Biomedical Data
This work proposes a methodology to combine independent CNN models built for histopathology and radiology images in order to improve diagnostic accuracy and achieves second place in the MICCAI 2018 Computational Precision Medicine Challenge.
A Review on a Deep Learning Perspective in Brain Cancer Classification
The relationship between brain cancer and other brain disorders like stroke, Alzheimer's, Parkinson's, and Wilson’s disease, leukoriaosis, and other neurological disorders are highlighted in the context of machine learning and the deep learning paradigm.
Label-Efficient Breast Cancer Histopathological Image Classification
A deep active learning framework is designed and implemented for classification of breast cancer histopathological images, with the goal of maximizing the learning accuracy from very limited labeling and can reduce annotation costs up to 66.67%, with higher accuracy and less expensive annotation than standard query strategy.
Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning
A deep convolutional neural network model is trained on whole-slide images obtained from The Cancer Genome Atlas to accurately and automatically classify them into LUAD, LUSC or normal lung tissue and predicts the ten most commonly mutated genes in LUAD.