Semi-Automatic RECIST Labeling on CT Scans with Cascaded Convolutional Neural Networks

  title={Semi-Automatic RECIST Labeling on CT Scans with Cascaded Convolutional Neural Networks},
  author={Youbao Tang and Adam P. Harrison and Mohammadhadi Bagheri and Jing Xiao and Ronald M. Summers},
Response evaluation criteria in solid tumors (RECIST) is the standard measurement for tumor extent to evaluate treatment responses in cancer patients. As such, RECIST annotations must be accurate. However, RECIST annotations manually labeled by radiologists require professional knowledge and are time-consuming, subjective, and prone to inconsistency among different observers. To alleviate these problems, we propose a cascaded convolutional neural network based method to semi-automatically label… 

Weakly Supervised Lesion Co-Segmentation on Ct Scans

A weakly-supervised co-segmentation model is proposed that first generates pseudo-masks from the RECIST slices and uses these as training labels for an attention-based convolutional neural network capable of segmenting common lesions from a pair of CT scans.

Weakly-supervised lesion segmentation on CT scans using co-segmentation

A convolutional neural network (CNN) based weakly-supervised lesion segmentation method, which first generates the initial lesion masks from the RECIST measurements and then utilizes co-segmentation to leverage lesion similarities and refine the initial masks.

Accurate Weakly-Supervised Deep Lesion Segmentation using Large-Scale Clinical Annotations: Slice-Propagated 3D Mask Generation from 2D RECIST

A convolutional neural network based weakly supervised slice-propagated segmentation (WSSS) method is introduced to generate the initial lesion segmentation on the axial RECIST-slice and extrapolate to segment the whole lesion slice by slice to finally obtain a volumetric segmentation.

Lesion Segmentation and RECIST Diameter Prediction via Click-driven Attention and Dual-path Connection

A prior-guided dual-path network (PDNet) to segment common types of lesions throughout the whole body and predict their RECIST diameters accurately and automatically is presented.

Recist-Net: Lesion Detection Via Grouping Keypoints On Recist-Based Annotation

RecIST-Net is proposed, a new approach to lesion detection in which the four extreme points and center point of the RECIST diameters are detected and achieves a sensitivity of 92.49% at four false positives per image, outperforming other recent methods including those using multi-task learning.

One Click Lesion RECIST Measurement and Segmentation on CT Scans

A unified framework named SEENet for semi-automatic lesion segmentation and RECIST estimation on a variety of lesions over the entire human body and achieves state-of-the-art performance on the large-scale public DeepLesion dataset.

Weakly-Supervised Universal Lesion Segmentation with Regional Level Set Loss

This paper presents a novel weakly-supervised universal lesion segmentation method by building an attention enhanced model based on the High-Resolution Network (HRNet), named AHRNet, and proposes a regional level set (RLS) loss for optimizing lesion boundary delineation.

MULAN: Multitask Universal Lesion Analysis Network for Joint Lesion Detection, Tagging, and Segmentation

A multitask universal lesion analysis network (MULAN) for joint detection, tagging, and segmentation of lesions in a variety of body parts, which greatly extends existing work of single-task lesions analysis on specific body parts.

Accurate and Robust Lesion RECIST Diameter Prediction and Segmentation with Transformers

A transformer-based network (MeaFormer, Mea surement trans Former) for lesion RECIST diameter prediction and segmentation (LRDPS) is proposed, formulated as three correlative and complementary tasks: lesion segmentation, heatmap prediction, and keypoint regression.



Accurate Weakly Supervised Deep Lesion Segmentation on CT Scans: Self-Paced 3D Mask Generation from RECIST

A convolutional neural network based weakly supervised self-paced segmentation (WSSS) method is introduced to generate the initial lesion segmentation on the axial RECIST-slice and adapt to segment the whole volume slice by slice to finally obtain a volumetric segmentation.

Deep Lesion Graphs in the Wild: Relationship Learning and Organization of Significant Radiology Image Findings in a Diverse Large-Scale Lesion Database

A triplet network is utilized to learn lesion embeddings with a sequential sampling strategy to depict their hierarchical similarity structure and results show promising qualitative and quantitative results on lesion retrieval, clustering, and classification.

Feature Pyramid Networks for Object Detection

This paper exploits the inherent multi-scale, pyramidal hierarchy of deep convolutional networks to construct feature pyramids with marginal extra cost and achieves state-of-the-art single-model results on the COCO detection benchmark without bells and whistles.

Observer variability in RECIST-based tumour burden measurements: a meta-analysis.

Learning Feature Pyramids for Human Pose Estimation

This work designs a Pyramid Residual Module (PRMs) to enhance the invariance in scales of DCNNs and provides theoretic derivation to extend the current weight initialization scheme to multi-branch network structures.

Spatial Transformer Networks

This work introduces a new learnable module, the Spatial Transformer, which explicitly allows the spatial manipulation of data within the network, and can be inserted into existing convolutional architectures, giving neural networks the ability to actively spatially transform feature maps.

Deep Residual Learning for Image Recognition

This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth.

Stacked Hourglass Networks for Human Pose Estimation

This work introduces a novel convolutional network architecture for the task of human pose estimation that is described as a “stacked hourglass” network based on the successive steps of pooling and upsampling that are done to produce a final set of predictions.

Multi-context Attention for Human Pose Estimation

This paper proposes to incorporate convolutional neural networks with a multi-context attention mechanism into an end-to-end framework for human pose estimation and designs novel Hourglass Residual Units (HRUs) to increase the receptive field of the network.

Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields

We present an approach to efficiently detect the 2D pose of multiple people in an image. The approach uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn