CMRNet: Camera to LiDAR-Map Registration

  title={CMRNet: Camera to LiDAR-Map Registration},
  author={D. Cattaneo and Matteo Vaghi and Augusto Luis Ballardini and S. Fontana and D. Sorrenti and W. Burgard},
  journal={2019 IEEE Intelligent Transportation Systems Conference (ITSC)},
In this paper we present CMRNet, a realtime approach based on a Convolutional Neural Network (CNN) to localize an RGB image of a scene in a map built from LiDAR data. [...] Key Result To the best of our knowledge this is the first CNN-based approach that learns to match images from a monocular camera to a given, preexisting 3D LiDAR-map.Expand
Global visual localization in LiDAR-maps through shared 2D-3D embedding space
Line-Based 2-D–3-D Registration and Camera Localization in Structured Environments
Data-Driven Protection Levels for Camera and 3D Map-based Safe Urban Localization
Hybrid Localization using Model- and Learning-Based Methods: Fusion of Monte Carlo and E2E Localizations via Importance Sampling
CMRNet++: Map and Camera Agnostic Monocular Visual Localization in LiDAR Maps
Monocular Camera Localization in Prior LiDAR Maps with 2D-3D Line Correspondences


Monocular camera localization in 3D LiDAR maps
RegNet: Multimodal sensor registration using deep neural networks
Learning Less is More - 6D Camera Localization via 3D Surface Regression
Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images
Modelling uncertainty in deep learning for camera relocalization
  • Alex Kendall, R. Cipolla
  • Computer Science
  • 2016 IEEE International Conference on Robotics and Automation (ICRA)
  • 2016
Geometry-Aware Learning of Maps for Camera Localization
Vision meets robotics: The KITTI dataset
DSAC — Differentiable RANSAC for Camera Localization
Deep regression for monocular camera-based 6-DoF global localization in outdoor environments
  • Tayyab Naseer, W. Burgard
  • Computer Science
  • 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  • 2017
Visual Localization at Intersections with Digital Maps