Self-Semantic Contour Adaptation for Cross Modality Brain Tumor Segmentation

  title={Self-Semantic Contour Adaptation for Cross Modality Brain Tumor Segmentation},
  author={Xiaofeng Liu and Fangxu Xing and Georges El Fakhri and Jonghye Woo},
  journal={2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)},
Unsupervised domain adaptation (UDA) between two significantly disparate domains to learn high-level semantic alignment is a crucial yet challenging task. To this end, in this work, we propose exploiting low-level edge information to facilitate the adaptation as a precursor task, which has a small cross-domain gap, compared with semantic segmentation. The precise contour then provides spatial information to guide the semantic adaptation. More specifically, we propose a multi-task framework to… 

Figures and Tables from this paper

Variational Inference for Quantifying Inter-observer Variability in Segmentation of Anatomical Structures
This work proposes a novel variational inference framework to model the distribution of plausible segmentation maps, given a specific MR image, which explicitly represents the multi-reader variability, and applies a variational autoencoder network and optimize its evidence lower bound (ELBO) to efficiently approximate the distribution.


Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentation
This paper presents a novel unsupervised domain adaptation framework, called Synergistic Image and Feature Adaptation (SIFA), to effectively tackle the problem of domain shift, and extensively validated the method with a challenging application of cross-modality medical image segmentation of cardiac structures.
Deep Symmetric Adaptation Network for Cross-Modality Medical Image Segmentation
This paper presents a novel deep symmetric architecture of UDA for medical image segmentation, which consists of a segmentation sub-network, and two symmetric source and target domain translation sub-networks, and introduces a bidirectional alignment scheme via a shared encoder and two private decoders to simultaneously align features.
Generative Self-training for Cross-domain Unsupervised Tagged-to-Cine MRI Synthesis
This work proposes a novel generative self-training (GST) UDA framework with continuous value prediction and regression objective for cross-domain image synthesis, and proposes to filter the pseudo-label with an uncertainty mask, and quantify the predictive confidence of generated images with practical variational Bayes learning.
Adapting Off-the-Shelf Source Segmenter for Target Medical Image Segmentation
This work targets source free UDA for segmentation, and proposes to adapt an "off-the-shelf" segmentation model pre-trained in the source domain to the target domain, with an adaptive batch-wise normalization statistics adaptation framework.
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
The set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences are reported, finding that different algorithms worked best for different sub-regions, but that no single algorithm ranked in the top for all sub-Regions simultaneously.
Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iterate
An adversarial unsupervised domain adaptation (UDA) method under inherent conditional and label shifts, in which the marginal p(y) and align p(x|y) iteratively at the training stage, and precisely align the posterior p( y|x) at the testing stage is proposed.
Subtype-aware Unsupervised Domain Adaptation for Medical Diagnosis
This work proposes to adaptively carry out the fine-grained subtype-aware alignment by explicitly enforcing the class-wise separation and sub type-wise compactness with intermediate pseudo labels in an online fashion.
Object Contour Detection with a Fully Convolutional Encoder-Decoder Network
A deep learning algorithm for contour detection with a fully convolutional encoder-decoder network that generalizes well to unseen object classes from the same supercategories on MS COCO and can match state-of-the-art edge detection on BSDS500 with fine-tuning.
Learning Transferable Features with Deep Adaptation Networks
A new Deep Adaptation Network (DAN) architecture is proposed, which generalizes deep convolutional neural network to the domain adaptation scenario and can learn transferable features with statistical guarantees, and can scale linearly by unbiased estimate of kernel embedding.