Explainable Medical Image Segmentation via Generative Adversarial Networks and Layer-wise Relevance Propagation

  title={Explainable Medical Image Segmentation via Generative Adversarial Networks and Layer-wise Relevance Propagation},
  author={Awadelrahman M. A. Ahmed and Leen A. M. Ali},
This paper contributes in automating medical image segmentation by proposing generative adversarial network based models to segment both polyps and instruments in endoscopy images. A main contribution of this paper is providing explanations for the predictions using layer-wise relevance propagation approach, showing which pixels in the input image are more relevant to the predictions. The models achieved 0.46 and 0.70, on Jaccard index and 0.84 and 0.96 accuracy, on the polyp segmentation and… 

Figures and Tables from this paper

Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanations

The post-hoc eXplainable Artificial Intelligence method L-CRP is proposed to generate explanations that automatically identify and visualize relevant concepts learned, recognized and used by the model during inference as well as precisely locate them in input space.



Kvasir-SEG: A Segmented Polyp Dataset

This paper presents Kvasir-SEG: an open-access dataset of gastrointestinal polyp images and corresponding segmentation masks, manually annotated by a medical doctor and then verified by an experienced gastroenterologist, and demonstrates the use of the dataset with a traditional segmentation approach and a modern deep-learning based Convolutional Neural Network approach.

MedAI: Transparency in Medical Image Segmentation

This work proposes three tasks to meet specific gastrointestinal image segmentation challenges collected from experts within the field, including two separate segmentation scenarios and one scenario on transparent ML systems.

Kvasir-Instrument: Diagnostic and therapeutic tool segmentation dataset in gastrointestinal endoscopy

Both, qualitative and quantitative results show that the model performs reasonably good, but there is a large potential for further improvements.

Image-to-Image Translation with Conditional Adversarial Networks

Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.

Layer-Wise Relevance Propagation: An Overview

This chapter gives a concise introduction to LRP with a discussion of how to implement propagation rules easily and efficiently, how the propagation procedure can be theoretically justified as a ‘deep Taylor decomposition’, how to choose the propagation rules at each layer to deliver high explanation quality, and how LRP can be extended to handle a variety of machine learning scenarios beyond deep neural networks.

Explainable AI: Interpreting, Explaining and Visualizing Deep Learning

This introductory paper presents recent developments and applications in the deep learning field and makes a plea for a wider use of explainable learning algorithms in many applications.

On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation

This work proposes a general solution to the problem of understanding classification decisions by pixel-wise decomposition of nonlinear classifiers by introducing a methodology that allows to visualize the contributions of single pixels to predictions for kernel-based classifiers over Bag of Words features and for multilayered neural networks.

Kvasir-seg: A segmented polyp

  • dataset. International Conference on Multimedia Modeling
  • 2020