Radar and vision sensors calibration for outdoor 3D reconstruction

  title={Radar and vision sensors calibration for outdoor 3D reconstruction},
  author={Ghina El Natour and Omar Ait-Aider and R. Rouveure and F. Berry and P. Faure},
  journal={2015 IEEE International Conference on Robotics and Automation (ICRA)},
In this paper we introduce a new geometric calibration algorithm, and a geometric method of 3D reconstruction using a panoramic microwave radar and a camera. These two sensors are complementary, considering the robustness to environmental conditions and depth detection ability of the radar on one hand, and the high spatial resolution of a vision sensor on the other hand. This makes the approach well adapted for large scale outdoor cartography. Firstly, we address the global calibration problem… Expand
Towards 3D reconstruction of outdoor scenes by mmw radar and a vision sensor fusion
The main goal of this PhD work is to develop 3D mapping methods of large scale environment by combining panoramic radar and cameras. Unlike existing sensor fusion methods, such as SLAM (simultaneousExpand
Extrinsic parameter calibration of 2D radar-camera using point matching and generative optimization
  • Deok-Yeong Kim, Sungho Kim
  • Computer Science
  • 2019 19th International Conference on Control, Automation and Systems (ICCAS)
  • 2019
This paper proposes a method of calibration between 2D radar and camera using point matching and top-down method, which improves the accuracy of the estimation of the calibration parameter. Expand
A Continuous-Time Approach for 3D Radar-to-Camera Extrinsic Calibration
This paper presents a continuous-time 3D radar-to-camera extrinsic calibration algorithm that utilizes radar velocity measurements and, unlike the majority of existing techniques, does not require specialized radar retroreflectors to be present in the environment. Expand
A Comparative Study on Camera-Radar Calibration Methods
Three types of the calibration methods presented in previous studies on fusing camera and radar in terms of calibration accuracy are compared and it is shown that one type of the methods is not appropriated to the camera-radar calibration, and the methods belonging to the other types provide quite similar accuracy. Expand
Targetless Rotational Auto-Calibration of Radar and Camera for Intelligent Transportation Systems
This work proposes the first data-driven method for automatic rotational radar-camera calibration without dedicated calibration targets based on a coarse and a fine convolutional neural network and demonstrates its generalization capabilities to different sensor alignments and perspectives. Expand
Vehicle Detection and Width Estimation in Rain by Fusing Radar and Vision
Empirical evaluation on a large database shows that there is a natural synergy in both sensors, as the image based estimation is found to be greatly facilitated by the accuracy of the radar detection. Expand
Sensor Guided Robot Path Generation for Surface Repair Tasks on a Large-Scale Buoyancy Module
Experimental results have shown that the proposed solution is able to accurately and efficiently remove defective regions on the surface of DRBMs. Expand


Obstacle detection using millimeter-wave radar and its visualization on image sequence
An obstacle detection method is proposed, which consists of an occupancy-grid representation, and a segmentation technique, which divides data acquired by radar into clusters (obstacles); thereafter, they are displayed as an image sequence using calibration results. Expand
Complete classification of raw LIDAR data and 3D reconstruction of buildings
This paper presents a three-stage framework for a robust automatic classification of raw LIDAR data as buildings, ground and vegetation, followed by a reconstruction of 3D models of the buildings. Expand
3-D model construction using range and image data
  • I. Stamos, P. Allen
  • Computer Science
  • Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662)
  • 2000
Range data segmentation algorithms have been developed to identify planar regions, determine linear features from planar intersections that can serve as features for registration with 2-D imagery lines, and reduce the overall complexity of the models. Expand
Integrating Millimeter Wave Radar with a Monocular Vision Sensor for On-Road Obstacle Detection Applications
A three-level fusion strategy based on visual attention mechanism and driver’s visual consciousness is provided for MMW radar and monocular vision fusion so as to obtain better comprehensive performance. Expand
High resolution mapping of the environment with a ground-based radar imager
The results show the ability of the microwave radar to build maps even in unstructured environment, as shown by the R-Slam algorithm. Expand
Detailed Real-Time Urban 3D Reconstruction from Video
A system for automatic, geo-registered, real-time 3D reconstruction from video of urban scenes that extends existing algorithms to meet the robustness and variability necessary to operate out of the lab and shows results on real video sequences comprising hundreds of thousands of frames. Expand
Real-Time Plane-Sweeping Stereo with Multiple Sweeping Directions
A multi-view plane-sweep-based stereo algorithm which correctly handles slanted surfaces and runs in real-time using the graphics processing unit (GPU), which can increase the quality of the reconstruction and reduce computation time. Expand
Evaluating SLAM Approaches for Microsoft Kinect
A hybrid technique was developed which combines those methods using a Kinect specialized ICP weight function using a loop detection algorithm to further optimize the accuracy of different SLAM approaches implemented on the Microsoft Kinect in order to calculate trajectories. Expand
A Survey of Urban Reconstruction
The goal is to provide a survey that will help researchers to better position their own work in the context of existing solutions, and to help newcomers and practitioners in computer graphics to quickly gain an overview of this vast field. Expand
Monocular Vision for Mobile Robot Localization and Autonomous Navigation
A new real-time localization system for a mobile robot that shows that autonomous navigation is possible in outdoor situation with the use of a single camera and natural landmarks and a three step approach is presented. Expand