Multimodal Detection of Unknown Objects on Roads for Autonomous Driving

  title={Multimodal Detection of Unknown Objects on Roads for Autonomous Driving},
  author={Daniel Bogdoll and Enrico Eisen and Maximilian Nitsche and Christin Scheib and Johann Marius Z{\"o}llner},
—Tremendous progress in deep learning over the last years has led towards a future with autonomous vehicles on our roads. Nevertheless, the performance of their perception systems is strongly dependent on the quality of the utilized training data. As these usually only cover a fraction of all object classes an autonomous driving system will face, such systems struggle with handling the unexpected. In order to safely operate on public roads, the identification of objects from unknown classes… 

Figures from this paper


Center-based 3D Object Detection and Tracking
The framework, CenterPoint, first detects centers of objects using a keypoint detector and regresses to other attributes, including 3D size, 3D orientation, and velocity, and refines these estimates using additional point features on the object.
A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise
DBSCAN, a new clustering algorithm relying on a density-based notion of clusters which is designed to discover clusters of arbitrary shape, is presented which requires only one input parameter and supports the user in determining an appropriate value for it.
Pixel-wise Anomaly Detection in Complex Driving Scenes
This work presents a pixel-wise anomaly detection framework that uses uncertainty maps to improve over existing re-synthesis methods in finding dissimilarities between the input and generated images, which ensures anomaly detection without compromising segmentation accuracy, while significantly out performing all similar methods.
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
This work constructs BDD100K, the largest driving video dataset with 100K videos and 10 tasks to evaluate the exciting progress of image recognition algorithms on autonomous driving and shows that special training strategies are needed for existing models to perform such heterogeneous tasks.
The Cityscapes Dataset for Semantic Urban Scene Understanding
This work introduces Cityscapes, a benchmark suite and large-scale dataset to train and test approaches for pixel-level and instance-level semantic labeling, and exceeds previous attempts in terms of dataset size, annotation richness, scene variability, and complexity.
ImageNet Large Scale Visual Recognition Challenge
The creation of this benchmark dataset and the advances in object recognition that have been possible as a result are described, and the state-of-the-art computer vision accuracy with human accuracy is compared.
Anomaly Detection in Autonomous Driving: A Survey
This survey provides an extensive overview of anomaly detection techniques based on camera, lidar, radar, multimodal and abstract object level data and outlines the state-of-the-art and point out current research gaps.
CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving
A challenging dataset named CODA, which consists of 1500 carefully selected real-world driving scenes, each containing four object-level corner cases (on aver-age), spanning more than 30 object categories, is introduced that exposes this critical problem of vision-based detectors.
Ad-datasets: a meta-collection of data sets for autonomous driving
: Autonomous driving is among the largest domains in which deep learning has been fundamental for progress within the last years. The rise of datasets went hand in hand with this development. All the
VOS: Learning What You Don't Know by Virtual Outlier Synthesis
VOS is presented, a novel framework for OOD detection by adaptively synthesizing virtual outliers that can meaningfully regularize the model’s decision boundary during training, which achieves stateof-the-art performance on both object detection and image classification models.