Efficient and Generic Interactive Segmentation Framework to Correct Mispredictions during Clinical Evaluation of Medical Images

  title={Efficient and Generic Interactive Segmentation Framework to Correct Mispredictions during Clinical Evaluation of Medical Images},
  author={Bhavani Sambaturu and Ashutosh Gupta and C.V. Jawahar and Chetan Arora},
Semantic segmentation of medical images is an essential first step in computer-aided diagnosis systems for many applications. However, given many disparate imaging modalities and inherent variations in the patient data, it is difficult to consistently achieve high accuracy using modern deep neural networks (DNNs). This has led researchers to propose interactive image segmentation techniques where a medical expert can interactively correct the output of a DNN to the desired accuracy. However… Expand

Figures and Tables from this paper


Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning
A novel deep learning-based interactive segmentation framework by incorporating CNNs into a bounding box and scribble-based segmentation pipeline and proposing a weighted loss function considering network and interaction-based uncertainty for the fine tuning is proposed. Expand
DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation
A deep learning-based interactive segmentation method to improve the results obtained by an automatic CNN and to reduce user interactions during refinement for higher accuracy, and obtains comparable and even higher accuracy with fewer user interventions and less time compared with traditional interactive methods. Expand
UI-Net: Interactive Artificial Neural Networks for Iterative Image Segmentation Based on a User Model
This work proposes a learning-based cooperative segmentation approach which includes the computing entity as well as the user into the task and can yield superior results compared to networks without the user input channel component, due to a consistent improvement in segmentation quality after each interaction. Expand
Multi-Scale Self-Guided Attention for Medical Image Segmentation
  • Ashish Sinha, J. Dolz
  • Computer Science, Medicine
  • IEEE Journal of Biomedical and Health Informatics
  • 2021
Compared to other state-of-the-art segmentation networks, this model yields better segmentation performance, increasing the accuracy of the predictions while reducing the standard deviation, which demonstrates the efficiency of the approach to generate precise and reliable automatic segmentations of medical images. Expand
Interactive Image Segmentation via Backpropagating Refinement Scheme
An interactive image segmentation algorithm, which accepts user-annotations about a target object and the background, is proposed and the backpropagating refinement scheme (BRS) is developed, which corrects the mislabeled pixels in the initial result. Expand
Detection-aided liver lesion segmentation using deep learning
This work proposes a method to segment the liver and its lesions from Computed Tomography scans using Convolutional Neural Networks, that have proven good results in a variety of computer vision tasks, including medical imaging. Expand
Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++
This work follows the idea of Polygon-RNN to produce polygonal annotations of objects interactively using humans-in-the-loop and achieves a high reduction in annotation time for new datasets, moving a step closer towards an interactive annotation tool to be used in practice. Expand
A Multi-Organ Nucleus Segmentation Challenge
Several of the top techniques compared favorably to an individual human annotator and can be used with confidence for nuclear morphometrics as well as heavy data augmentation in the MoNuSeg 2018 challenge. Expand
NuClick: From Clicks in the Nuclei to Nuclear Boundaries
A simple yet efficient framework based on convolutional neural networks, named NuClick, which can precisely segment nuclei boundaries by accepting a single point position (or click) inside each nucleus, which leads to superior segmentation output for deep models. Expand
Deep Interactive Object Selection
This paper presents a novel deep-learning-based algorithm which has much better understanding of objectness and can reduce user interactions to just a few clicks and is superior to all existing interactive object selection approaches. Expand