Corpus ID: 1996665

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs

@article{Chen2015SemanticIS,
  title={Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs},
  author={Liang-Chieh Chen and George Papandreou and Iasonas Kokkinos and Kevin P. Murphy and Alan Loddon Yuille},
  journal={CoRR},
  year={2015},
  volume={abs/1412.7062}
}
Deep Convolutional Neural Networks (DCNNs) have recently shown state of the art performance in high level vision tasks, such as image classification and object detection. [...] Key Method We overcome this poor localization property of deep networks by combining the responses at the final DCNN layer with a fully connected Conditional Random Field (CRF). Qualitatively, our "DeepLab" system is able to localize segment boundaries at a level of accuracy which is beyond previous methods. Quantitatively, our method…Expand
Image Semantic Segmentation Using Deep Convolutional Nets, Fully Connected Conditional Random Fields, and Dilated Convolution
  • Degui Xiao, P. Zhong
  • Computer Science
  • 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS)
  • 2019
TLDR
This work combines a new feature extraction network with a dilated convolution layer to improve the accuracy of the model's mission, and introduces multi-scale feature fusion technology to improved the performance of DCNN. Expand
Improving Semantic Image Segmentation With a Probabilistic Superpixel-Based Dense Conditional Random Field
TLDR
A probabilistic superpixel-based dense conditional random field model (PSP-CRF) is proposed to refine label assignments as a post-processing optimization method for deep convolutional neural networks. Expand
A top-down manner-based DCNN architecture for semantic image segmentation
TLDR
In the study, superpixels containing visual attention information are introduced in a top-down manner, and an extensible architecture is proposed to improve the segmentation results of current DCNN-based methods. Expand
Segmentation-aware convolutional nets
TLDR
A new deep convolutional neural network architecture to train the DCNN to produce internal representations that respect object boundaries, which exceeds the prior state-of-the-art on the PASCAL VOC2012 segmentation task. Expand
Learning contextual information for indoor semantic segmentation
TLDR
The proposed model outperform the existing state-of-the-art methods on a challenging 40 classes task, yielding a higher class average accuracy and pixel average accuracy of 66.4%. Expand
Semantic Image Segmentation with Deep Convolutional Neural Networks and Quick Shift
TLDR
This paper presents a novel semantic segmentation algorithm with DeepLab v3+ and super-pixel segmentation algorithms-quick shift, and results show that the proposed method can provide a more efficient solution. Expand
Semantic Image Segmentation with Task-Specific Edge Detection Using CNNs and a Discriminatively Trained Domain Transform
TLDR
This work proposes replacing the fully-connected CRF with domain transform (DT), a modern edge-preserving filtering method in which the amount of smoothing is controlled by a reference edge map, and shows that it yields comparable semantic segmentation results, accurately capturing object boundaries. Expand
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
TLDR
This work addresses the task of semantic image segmentation with Deep Learning and proposes atrous spatial pyramid pooling (ASPP), which is proposed to robustly segment objects at multiple scales, and improves the localization of object boundaries by combining methods from DCNNs and probabilistic graphical models. Expand
Joint Semantic Segmentation and Depth Estimation with Deep Convolutional Networks
TLDR
This work presents a new model for simultaneous depth estimation and semantic segmentation from a single RGB image and couple the deep CNN with fully connected CRF, which captures the contextual relationships and interactions between the semantic and depth cues improving the accuracy of the final results. Expand
Joint Semantic Segmentation and Depth Estimation with Deep Convolutional Networks
TLDR
This work presents a new model for simultaneous depth estimation and semantic segmentation from a single RGB image and couple the deep CNN with fully connected CRF, which captures the contextual relationships and interactions between the semantic and depth cues improving the accuracy of the final results. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 59 REFERENCES
Convolutional feature masking for joint object and stuff segmentation
  • Jifeng Dai, Kaiming He, Jian Sun
  • Computer Science
  • 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2015
TLDR
This paper proposes a joint method to handle objects and “stuff” (e.g., grass, sky, water) in the same framework and presents state-of-the-art results on benchmarks of PASCAL VOC and new PASCal-CONTEXT. Expand
Fully Convolutional Networks for Semantic Segmentation
TLDR
It is shown that convolutional networks by themselves, trained end- to-end, pixels-to-pixels, improve on the previous best result in semantic segmentation. Expand
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
TLDR
This paper proposes a simple and scalable detection algorithm that improves mean average precision (mAP) by more than 30% relative to the previous best result on VOC 2012 -- achieving a mAP of 53.3%. Expand
Conditional Random Fields as Recurrent Neural Networks
TLDR
A new form of convolutional neural network that combines the strengths of Convolutional Neural Networks (CNNs) and Conditional Random Fields (CRFs)-based probabilistic graphical modelling is introduced, and top results are obtained on the challenging Pascal VOC 2012 segmentation benchmark. Expand
Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation
TLDR
Expectation-Maximization (EM) methods for semantic image segmentation model training under weakly supervised and semi-supervised settings are developed and extensive experimental evaluation shows that the proposed techniques can learn models delivering competitive results on the challenging PASCAL VOC 2012 image segmentsation benchmark, while requiring significantly less annotation effort. Expand
Learning Hierarchical Features for Scene Labeling
TLDR
A method that uses a multiscale convolutional network trained from raw pixels to extract dense feature vectors that encode regions of multiple sizes centered on each pixel, alleviates the need for engineered features, and produces a powerful representation that captures texture, shape, and contextual information. Expand
Towards unified depth and semantic prediction from a single image
TLDR
This work proposes a unified framework for joint depth and semantic prediction that effectively leverages the advantages of both tasks and provides the state-of-the-art results. Expand
Simultaneous Detection and Segmentation
TLDR
This work builds on recent work that uses convolutional neural networks to classify category-independent region proposals (R-CNN), introducing a novel architecture tailored for SDS, and uses category-specific, top-down figure-ground predictions to refine the bottom-up proposals. Expand
Hypercolumns for object segmentation and fine-grained localization
TLDR
Using hypercolumns as pixel descriptors, this work defines the hypercolumn at a pixel as the vector of activations of all CNN units above that pixel, and shows results on three fine-grained localization tasks: simultaneous detection and segmentation, and keypoint localization. Expand
Untangling Local and Global Deformations in Deep Convolutional Networks for Image Classification and Sliding Window Detection
TLDR
This work introduces epitomic con-volution as a building block alternative to the common convolution-MP cascade of DCNNs and develops an efficient DCNN sliding window object detector that employs explicit search over position, scale, and aspect ratio. Expand
...
1
2
3
4
5
...