Simultaneous Detection and Segmentation

@inproceedings{Hariharan2014SimultaneousDA,
  title={Simultaneous Detection and Segmentation},
  author={Bharath Hariharan and Pablo Arbel{\'a}ez and Ross B. Girshick and Jitendra Malik},
  booktitle={ECCV},
  year={2014}
}
We aim to detect all instances of a category in an image and, for each instance, mark the pixels that belong to it. [...] Key Method We build on recent work that uses convolutional neural networks to classify category-independent region proposals (R-CNN [16]), introducing a novel architecture tailored for SDS. We then use category-specific, top-down figure-ground predictions to refine our bottom-up proposals. We show a 7 point boost (16% relative) over our baselines on SDS, a 5 point boost (10% relative) over…Expand
Region-Based Convolutional Networks for Accurate Object Detection and Segmentation
TLDR
A simple and scalable detection algorithm that improves mean average precision (mAP) by more than 50 percent relative to the previous best result on VOC 2012-achieving a mAP of 62.4 percent. Expand
Bridging Category-level and Instance-level Semantic Image Segmentation
TLDR
An approach to instance-level image segmentation that is built on top of category-level segmentation, which follows a different pipeline to the popular detect-then-segment approaches that first predict instances' bounding boxes. Expand
Beyond Bounding Boxes: Precise Localization of Objects in Images
Object recognition in computer vision comes in many flavors, two of the most popular being object detection and semantic segmentation. Object detection systems detect every instance of a category inExpand
Shape-aware Instance Segmentation
TLDR
This paper introduces a novel object segment representation based on the distance transform of the object masks, and designs an object mask network (OMN) with a new residual-deconvolution architecture that infers such a representation and decodes it into the final binary object mask. Expand
Region-Based Semantic Segmentation with End-to-End Training
We propose a novel method for semantic segmentation, the task of labeling each pixel in an image with a semantic class. Our method combines the advantages of the two main competing paradigms. MethodsExpand
SOLO: A Simple Framework for Instance Segmentation
TLDR
This paper introduces the notion of “instance categories”, which assigns categories to each pixel within an instance according to the instance’s location, and proposes segmenting objects by locations (SOLO), a simple, direct, and fast framework for instance segmentation with strong momentum. Expand
Boundary-Aware Instance Segmentation
TLDR
This paper introduces a novel object segment representation based on the distance transform of the object masks, and designs an object mask network (OMN) with a new residual-deconvolution architecture that infers such a representation and decodes it into the final binary object mask. Expand
Region-Based Semantic Segmentation with End-to-End Training
TLDR
A novel method for semantic segmentation, the task of labeling each pixel in an image with a semantic class, is proposed, which improves the state-of-the-art in terms of class-average accuracy and is particularly accurate at object boundaries. Expand
A Simultaneous Object Detection and Component Segmentation Approach Based on Mask R-CNN
  • Deshuai Zheng, Jin Yan, Y. Liu, Tao Xue
  • Computer Science
  • 2020 10th Institute of Electrical and Electronics Engineers International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER)
  • 2020
TLDR
This paper proposes a simultaneous object detection and component segmentation approach based on Mask R-CNN, and defines an Overlapping Area Ratio (OAR) between object bounding box and component boundingbox to confirm their relationships. Expand
Instance Segmentation with Point Supervision
TLDR
The method obtains competitive results compared to fully-supervised methods in certain scenarios; outperforms fully- and weakly- supervised methods with a fixed annotation budget; and is a first strong baseline for instance segmentation with point-level supervision. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 38 REFERENCES
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
TLDR
This paper proposes a simple and scalable detection algorithm that improves mean average precision (mAP) by more than 30% relative to the previous best result on VOC 2012 -- achieving a mAP of 53.3%. Expand
Bottom-Up Segmentation for Top-Down Detection
TLDR
A novel deformable part-based model which exploits region-based segmentation algorithms that compute candidate object regions by bottom-up clustering followed by ranking of those regions that outperform the previous state-of-the-art on VOC 2010 test by 4%. Expand
Semantic segmentation using regions and parts
TLDR
A novel design for region-based object detectors that integrates efficiently top-down information from scanning-windows part models and global appearance cues is proposed that produces class-specific scores for bottom-up regions, and then aggregate the votes of multiple overlapping candidates through pixel classification. Expand
Learning to localize detected objects
  • Qieyun Dai, Derek Hoiem
  • Computer Science
  • 2012 IEEE Conference on Computer Vision and Pattern Recognition
  • 2012
TLDR
This paper describes and evaluates several color models and edge cues for local predictions, and proposes two approaches for localization: learned graph cut segmentation and structural bounding box prediction. Expand
Learning Hierarchical Features for Scene Labeling
TLDR
A method that uses a multiscale convolutional network trained from raw pixels to extract dense feature vectors that encode regions of multiple sizes centered on each pixel, alleviates the need for engineered features, and produces a powerful representation that captures texture, shape, and contextual information. Expand
Segmentation as selective search for object recognition
TLDR
This work adapt segmentation as a selective search by reconsidering segmentation to generate many approximate locations over few and precise object delineations because an object whose location is never generated can not be recognised and appearance and immediate nearby context are most effective for object recognition. Expand
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
TLDR
This integrated framework for using Convolutional Networks for classification, localization and detection is the winner of the localization task of the ImageNet Large Scale Visual Recognition Challenge 2013 and obtained very competitive results for the detection and classifications tasks. Expand
What, Where and How Many? Combining Object Detectors and CRFs
TLDR
A probabilistic framework for reasoning about regions, objects, and their attributes such as object class, location, and spatial extent is presented, which combines results from sliding window detectors, and low-level pixel-based unary and pairwise relations. Expand
Constrained parametric min-cuts for automatic object segmentation
TLDR
It is shown that this algorithm significantly outperforms the state of the art for low-level segmentation in the VOC09 segmentation dataset and achieves the same average best segmentation covering as the best performing technique to date. Expand
Layered Object Models for Image Segmentation
TLDR
A generative probabilistic model that composites the output of a bank of object detectors in order to define shape masks and explain the appearance, depth ordering, and labels of all pixels in an image is described. Expand
...
1
2
3
4
...