• Corpus ID: 239616115

MHAttnSurv: Multi-Head Attention for Survival Prediction Using Whole-Slide Pathology Images

  title={MHAttnSurv: Multi-Head Attention for Survival Prediction Using Whole-Slide Pathology Images},
  author={Shuai Jiang and Arief A. Suriawinata and Saeed Hassanpour},
In pathology, whole-slide images (WSI) based survival prediction has attracted increasing interest. However, given the large size of WSIs and the lack of pathologist annotations, extracting the prognostic information from WSIs remains a challenging task. Previous studies have used multiple instance learning approaches to combine the information from multiple randomly sampled patches, but different visual patterns may contribute differently to prognosis prediction. In this study, we developed a… 

Figures and Tables from this paper

Multi-Attention Multiple Instance Learning
A new multi-attention based method for solving the MIL problem (MAMIL), which takes into account the neighboring patches or instances of each analyzed patch in a bag, is proposed. In the method, one


WSISA: Making Survival Prediction from Whole Slide Histopathological Images
This paper proposes an effective Whole Slide Histopathological Images Survival Analysis framework (WSISA) that can efficiently exploit and utilize all discriminative patterns in WSIs to predict patients survival status and applies it to the survival predictions of glioma and non-small-cell lung cancer.
Whole slide images based cancer survival prediction using attention guided deep multiple instance learning networks
This work proposes Deep Attention Multiple Instance Survival Learning (DeepAttnMISL) by introducing both siamese MI-FCN and attention-based MIL pooling to efficiently learn imaging features from the WSI and then aggregate WSI-level information to patient-level.
CapSurv: Capsule Network for Survival Analysis With Whole Slide Pathological Images
The proposed CapSurv model has the ability to improve the performance of the prediction by comparing with state-of-the-art survival models, and semantic-level features extracted by VGG16, are used to distinguish discriminative patches from whole slide pathological images.
Deep Multi-instance Learning for Survival Prediction from Whole Slide Images
This work takes advantages of a deep multiple instance learning to encode all possible patterns from WSIs and considers the joint effects from different patterns for clinical outcomes prediction to improve the prediction performances compared with existing state-of-the-arts survival analysis approaches.
Predicting Prognosis and IDH Mutation Status for Patients with Lower-Grade Gliomas Using Whole Slide Images
We developed end-to-end deep learning models using whole slide images of adults diagnosed with diffusely infiltrating, World Health Organization (WHO) grade 2 gliomas to predict prognosis and the
Graph CNN for Survival Analysis on Whole Slide Pathological Images
This work proposes to model WSI as graph and then develop a graph convolutional neural network (graph CNN) with attention learning that better serves the survival prediction by rendering the optimal graph representations of WSIs.
Deep Learning with Multimodal Representation for Pancancer Prognosis Prediction
This work shows that it is possible to build a pancancer model for prognosis that also predicts prognosis in single cancer sites, and presents a powerful automated tool to accurately determine prognosis, a key step towards personalized treatment for cancer patients.
Interpretable survival prediction for colorectal cancer using deep learning
A deep learning system for predicting disease-specific survival for stage II and III colorectal cancer using 3652 cases and clustering embeddings from a deep-learning-based image-similarity model showed that the clustering-derived feature most strongly associated with high DLS scores was also highly prognostic in isolation.
Predicting cancer outcomes from histology and genomics using convolutional networks
A computational approach based on deep learning to predict the overall survival of patients diagnosed with brain tumors from microscopic images of tissue biopsies and genomic biomarkers, which surpasses the prognostic accuracy of human experts using the current clinical standard for classifying brain tumors.
Deep convolutional neural network for survival analysis with pathological images
From the extensive experiments on the National Lung Screening Trial (NLST) lung cancer data, it is shown that the proposed DeepConvSurv model improves significantly compared with four state-of-the-art methods.