MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving

@article{Teichmann2016MultiNetRJ,
  title={MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving},
  author={Marvin Teichmann and Michael Weber and Johann Marius Z{\"o}llner and Roberto Cipolla and Raquel Urtasun},
  journal={2018 IEEE Intelligent Vehicles Symposium (IV)},
  year={2016},
  pages={1013-1020}
}
While most approaches to semantic reasoning have focused on improving performance, in this paper we argue that computational times are very important in order to enable real time applications such as autonomous driving. Towards this goal, we present an approach to joint classification, detection and semantic segmentation using a unified architecture where the encoder is shared amongst the three tasks. Our approach is very simple, can be trained end-to-end and performs extremely well in the… CONTINUE READING

Similar Papers

Citations

Publications citing this paper.
SHOWING 1-10 OF 142 CITATIONS

3-D LiDAR + Monocular Camera: An Inverse-Depth-Induced Fusion Framework for Urban Road Detection

Shuo Gu, Tao Lu, +3 authors Hui Kong
  • IEEE Transactions on Intelligent Vehicles
  • 2018
VIEW 5 EXCERPTS
CITES METHODS, BACKGROUND & RESULTS
HIGHLY INFLUENCED

Fully Convolutional Networks and Generative Adversarial Networks Applied to Sclera Segmentation

  • 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS)
  • 2018
VIEW 11 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

An illumination-invariant nonparametric model for urban road detection using monocular camera and single-line lidar

  • 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO)
  • 2017
VIEW 6 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

An Illumination-Invariant Nonparametric Model for Urban Road Detection

  • IEEE Transactions on Intelligent Vehicles
  • 2019
VIEW 4 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Hair Segmentation on Time-of-Flight RGBD Images

  • ArXiv
  • 2019
VIEW 6 EXCERPTS
CITES METHODS & RESULTS
HIGHLY INFLUENCED

AggNet: Simple Aggregated Network for Real-Time Multiple Object Detection in Road Driving Scene

  • 2018 21st International Conference on Intelligent Transportation Systems (ITSC)
  • 2018
VIEW 6 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

2017
2019

CITATION STATISTICS

  • 31 Highly Influenced Citations

  • Averaged 47 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-10 OF 59 REFERENCES

Deep Residual Learning for Image Recognition

  • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2015
VIEW 6 EXCERPTS
HIGHLY INFLUENTIAL

Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks

  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2015
VIEW 6 EXCERPTS
HIGHLY INFLUENTIAL

Are we ready for autonomous driving? The KITTI vision benchmark suite

  • 2012 IEEE Conference on Computer Vision and Pattern Recognition
  • 2012
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

ImageNet: A large-scale hierarchical image database

  • CVPR 2009
  • 2009
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Mask R-CNN.

  • IEEE transactions on pattern analysis and machine intelligence
  • 2018
VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Find your way by observing the sun and other semantic cues

  • 2017 IEEE International Conference on Robotics and Automation (ICRA)
  • 2016
VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Fast R-CNN

  • 2015 IEEE International Conference on Computer Vision (ICCV)
  • 2015
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

ImageNet Large Scale Visual Recognition Challenge

  • International Journal of Computer Vision
  • 2014
VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL