Hetero-Modal Learning and Expansive Consistency Constraints for Semi-Supervised Detection from Multi-Sequence Data

  title={Hetero-Modal Learning and Expansive Consistency Constraints for Semi-Supervised Detection from Multi-Sequence Data},
  author={Bolin Lai and Yuhsuan Wu and Xiao-Yun Zhou and Peng Wang and Le Lu and Lingyun Huang and Mei Han and Jing Xiao and Heping Hu and Adam P. Harrison},
Lesion detection serves a critical role in early diagnosis and has been well explored in recent years due to methodological advances and increased data availability. However, the high costs of annotations hinder the collection of large and completely labeled datasets, motivating semi-supervised detection approaches. In this paper, we introduce mean teacher hetero-modal detection (MTHD), which addresses two important gaps in current semi-supervised detection. First, it is not obvious how to… 

Figures and Tables from this paper


Learning From Multiple Datasets With Heterogeneous and Partial Labels for Universal Lesion Detection in CT
A universal lesion detection algorithm to detect a variety of lesions and proposed strategies to mine missing annotations from partially-labeled datasets by exploiting clinical prior knowledge and cross-dataset knowledge transfer are proposed.
Lesion-Harvester: Iteratively Mining Unlabeled Lesions and Hard-Negative Examples at Scale
This work introduces Lesion-Harvester—a powerful system to harvest missing annotations from lesion datasets at high precision, and presents a pseudo 3D IoU evaluation metric that corresponds much better to the real 3 D IoU than current DeepLesion evaluation metrics.
DeepLesion: automated mining of large-scale lesion annotations and universal lesion detection with deep learning
Using DeepLesion, a universal lesion detector is trained that can find all types of lesions with one unified framework and achieves a sensitivity of 81.1% with five false positives per image.
FocalMix: Semi-Supervised Learning for 3D Medical Image Detection
A novel method is proposed, called FocalMix, which is the first to leverage recent advances in semi-supervised learning (SSL) for 3D medical image detection, and can achieve a substantial improvement over state-of-the-art supervised learning approaches with 400 unlabeled CT scans.
MVP-Net: Multi-view FPN with Position-aware Attention for Deep Universal Lesion Detection
With the proposed model design, the data-hunger problem is relieved as the learning task is made easier with the correctly induced clinical practice prior, and promising results are shown on the NIH DeepLesion dataset.
ElixirNet: Relation-aware Network Architecture Adaptation for Medical Lesion Detection
A novel ElixirNet that includes three components, TruncatedRPN balances positive and negative data for false positive reduction, Auto-lesion Block is automatically customized for medical images to incorporates relation-aware operations among region proposals, and leads to more suitable and efficient classification and localization.
Collaborative Learning of Semi-Supervised Segmentation and Classification for Medical Images
  • Yi Zhou, Xiaodong He, +4 authors L. Shao
  • Computer Science
    2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2019
This paper proposes a collaborative learning method to jointly improve the performance of disease grading and lesion segmentation by semi-supervised learning with an attention mechanism and achieves consistent improvements over state-of-the-art methods on three public datasets.
Co-Heterogeneous and Adaptive Segmentation from Multi-Source and Multi-Phase CT Imaging Data: A Study on Pathological Liver and Lesion Segmentation
A novel segmentation strategy, co-heterogenous and adaptive segmentation (CHASe), which only requires a small labeled cohort of single phase imaging data to adapt to any unlabeled cohort of heterogenous multi-phase data with possibly new clinical scenarios and pathologies is presented.
Consistency-based Semi-supervised Learning for Object detection
A Consistency-based Semi-supervised learning method for object Detection (CSD), which is a way of using consistency constraints as a tool for enhancing detection performance by making full use of available unlabeled data.
Unbiased Teacher for Semi-Supervised Object Detection
This work revisits the Semi-Supervised Object Detection (SS-OD) and identifies the pseudo-labeling bias issue in SSOD, and introduces Unbiased Teacher, a simple yet effective approach that jointly trains a student and a gradually progressing teacher in a mutually-beneficial manner.