Corpus ID: 236428529

Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentation

  title={Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentation},
  author={Lian Xu and Wanli Ouyang and Mohammed Bennamoun and Farid Boussaid and Ferdous Sohel and Dan Xu},
Semantic segmentation is a challenging task in the absence of densely labelled data. Only relying on class activation maps (CAM) with image-level labels provides deficient segmentation supervision. Prior works thus consider pre-trained models to produce coarse saliency maps to guide the generation of pseudo segmentation labels. However, the commonly used off-line heuristic generation process cannot fully exploit the benefits of these coarse saliency maps. Motivated by the significant inter-task… Expand

Figures and Tables from this paper

Maximize the Exploration of Congeneric Semantics for Weakly Supervised Semantic Segmentation
  • Ke Zhang, Sihong Chen, Qi Ju, Yong Jiang, Yucong Li, Xin He
  • Computer Science
  • ArXiv
  • 2021
This paper constructs the patch-level graph neural network (P-GNN) based on the self-detected patches from different images that contain the same class labels, and proposes soft-complementary loss functions matched with the whole network structure. Expand
Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrast
Weakly-supervised pixel-to-prototype contrast that can provide pixel-level supervisory signals to narrow the gap between classification and segmentation is proposed and seamlessly incorporated into existing WSSS models without any changes to the base networks and does not incur any extra inference burden. Expand


Learning Saliency-Free Model with Generic Features for Weakly-Supervised Semantic Segmentation
Experiments show that the proposed saliency-free method outperforms the previous approaches under the same weakly-supervised setting and achieves superior segmentation results, which are 64.5% on the validation set and 64.6%" on the test set concerning mIoU metric. Expand
Learning Pixel-Level Semantic Affinity with Image-Level Supervision for Weakly Supervised Semantic Segmentation
  • Jiwoon Ahn, Suha Kwak
  • Computer Science
  • 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
  • 2018
On the PASCAL VOC 2012 dataset, a DNN learned with segmentation labels generated by the method outperforms previous models trained with the same level of supervision, and is even as competitive as those relying on stronger supervision. Expand
Weakly-Supervised Semantic Segmentation via Sub-Category Exploration
This work proposes a simple yet effective approach that introduces a self-supervised task by exploiting the sub- category information and performs clustering on image features to generate pseudo sub-categories labels within each annotated parent class. Expand
Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentation
A unified multi-task learning framework to jointly solve WSSS and SD using a single network, i.e. saliency and segmentation network (SSNet), which compares favorably against state-of-the-art weakly supervised segmentation methods and fully supervised saliency detection methods. Expand
Group-Wise Semantic Mining for Weakly Supervised Semantic Segmentation
This work addresses weakly supervised semantic segmentation (WSSS) as a novel group-wise learning task that explicitly models semantic dependencies in a group of images to estimate more reliable pseudo ground-truths, which can be used for training more accurate segmentation models. Expand
Reliability Does Matter: An End-to-End Weakly Supervised Semantic Segmentation Approach
This work harnesses the image-level labels to produce reliable pixel-level annotations and design a fully end-to-end network to learn to predict segmentation maps and gets a new state-of-the-art performance on the Pascal VOC. Expand
Weakly-Supervised Semantic Segmentation by Iterative Affinity Learning
An iterative algorithm to learn reliable pixel affinity without accurate annotation is proposed, which consists of two branches, a unary segmentation network which learns the label probabilities for each pixel, and a pairwise affinity network which learning affinity matrix and refines the probability map generated from the unary network. Expand
Self-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation
A self-supervised equivariant attention mechanism (SEAM) to discover additional supervision and narrow the gap between full and weak supervisions, and a pixel correlation module (PCM), which exploits context appearance information and refines the prediction of current pixel by its similar neighbors, leading to further improvement on CAMs consistency. Expand
Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features
An iterative bottom-up and top-down framework which alternatively expands object regions and optimizes segmentation network and outperforms previous state-of-the-art methods by a large margin is proposed. Expand
Discovering Class-Specific Pixels for Weakly-Supervised Semantic Segmentation
It is shown that properly combining saliency and attention maps allows for reliable cues capable of significantly boosting the performance, and a simple yet powerful hierarchical approach to discover the class-agnostic salient regions, obtained using a salient object detector, is proposed. Expand