Deep Learning With Conformal Prediction for Hierarchical Analysis of Large-Scale Whole-Slide Tissue Images

  title={Deep Learning With Conformal Prediction for Hierarchical Analysis of Large-Scale Whole-Slide Tissue Images},
  author={H{\aa}kan Wieslander and Philip John Harrison and Gabriel Skogberg and Sonya Jackson and Marcus Friden and Johan Karlsson and Ola Spjuth and Carolina W{\"a}hlby},
  journal={IEEE Journal of Biomedical and Health Informatics},
With the increasing amount of image data collected from biomedical experiments there is an urgent need for smarter and more effective analysis methods. Many scientific questions require analysis of image sub-regions related to some specific biology. Finding such regions of interest (ROIs) at low resolution and limiting the data subjected to final quantification at full resolution can reduce computational requirements and save time. In this paper we propose a three-step pipeline: First, bounding… 

Figures and Tables from this paper

Colon Tissues Classification and Localization in Whole Slide Images Using Deep Learning
Artificial intelligence (AI)-based classification and localization models are proposed for determining and localizing the abnormal regions in WSI that will make the task of tissue examination faster and lesser time-consuming.
Translating polygenic risk scores for clinical use by estimating the confidence bounds of risk prediction
A machine-learning technique, Mondrian Cross-Conformal Prediction (MCCP), is introduced, to estimate the confidence bounds of PRS-to-disease-risk prediction and can report disease status conditional probability value for each individual and give a prediction at a desired error level.
Rapid development of cloud-native intelligent data pipelines for scientific data streams using the HASTE Toolkit
A model that introduces automated, autonomous decision making in data pipelines, such that a stream of data can be partitioned into a tiered or ordered data hierarchy, based on data content rather than a priori metadata is proposed.


U-Net: Convolutional Networks for Biomedical Image Segmentation
It is shown that such a network can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks.
Fast ScanNet: Fast and Dense Analysis of Multi-Gigapixel Whole-Slide Images for Cancer Metastasis Detection
This paper proposes a novel method with anchor layers for model conversion, which not only leverages the efficiency of fully convolutional architectures to meet the speed requirement in clinical practice but also densely scans the whole-slide image to achieve accurate predictions on both micro- and macro-metastases.
ScanNet: A Fast and Dense Scanning Framework for Metastastic Breast Cancer Detection from Whole-Slide Image
A novel framework by leveraging fully convolutional networks for efficient inference to meet the speed requirement for clinical practice, while reconstructing dense predictions under different offsets for ensuring accurate detection on both microand macro-metastases is proposed.
Transfer Learning with Deep Convolutional Neural Networks for Classifying Cellular Morphological Changes
The ability to quickly and accurately distinguish between different cell morphologies from a scarce amount of labeled data illustrates the combined benefit of transfer learning and deep convolutional neural networks for interrogating cell-based images.
Deep learning for cellular image analysis
The intersection between deep learning and cellular image analysis is reviewed and an overview of both the mathematical mechanics and the programming frameworks of deep learning that are pertinent to life scientists are provided.
Deep Learning in Image Cytometry: A Review
This review focuses on deep learning and how it is applied to microscopy image data of cells and tissue samples, and gives the reader an overview of the key concepts of neural networks, and an understanding of how deep learning differs from more classical approaches for extracting information from image data.
Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification
A novel Expectation-Maximization (EM) based method is formulated that automatically locates discriminative patches robustly by utilizing the spatial relationships of patches and applies it to the classification of glioma and non-small-cell lung carcinoma cases into subtypes.
Deep Learning in Microscopy Image Analysis: A Survey
A snapshot of the fast-growing deep learning field for microscopy image analysis, which explains the architectures and the principles of convolutional neural networks, fully Convolutional networks, recurrent neural Networks, stacked autoencoders, and deep belief networks and their formulations or modelings for specific tasks on various microscopy images.
Automatic labeling of molecular biomarkers of immunohistochemistry images using fully convolutional networks
The method can be used by pathologists to differentiate between different grades of cervical intraepithelial neoplasia by quantitatively assessing the percentage of proliferating cells in the different layers of HPV positive lesions.