Corpus ID: 235755204

Real-time Semantic 3D Dense Occupancy Mapping with Efficient Free Space Representations

  title={Real-time Semantic 3D Dense Occupancy Mapping with Efficient Free Space Representations},
  author={Yuanxin Zhong and Huei Peng},
A real-time semantic 3D occupancy mapping framework is proposed in this paper. The mapping framework is based on the Bayesian kernel inference strategy from the literature. Two novel free space representations are proposed to efficiently construct training data and improve the mapping speed, which is a major bottleneck for real-world deployments. Our method achieves real-time mapping even on a consumer-grade CPU. Another important benefit is that our method can handle dynamic scenarios, thanks… Expand

Figures and Tables from this paper


Semantic 3D occupancy mapping through efficient high order CRFs
An incremental and (near) real-time semantic mapping system that utilizes the CNN segmentation as prior prediction and further optimize 3D grid labels through a novel CRF model to represent the world. Expand
SuMa++: Efficient LiDAR-based Semantic SLAM
An extension of a recently published surfel-based mapping approach exploiting three-dimensional laser range scans by integrating semantic information to facilitate the mapping process, which enables us to reliably filter moving objects, but also improve the projective scan matching via semantic constraints. Expand
Bayesian Spatial Kernel Smoothing for Scalable Dense Semantic Mapping
A Bayesian continuous 3D semantic occupancy map from noisy point clouds is developed by generalizing the Bayesian kernel inference model for building occupancy maps to semantic maps, a multi-class problem and consistently outperforms current baselines. Expand
Real-time 3D reconstruction at scale using voxel hashing
An online system for large and fine scale volumetric reconstruction based on a memory and speed efficient data structure that compresses space, and allows for real-time access and updates of implicit surface data, without the need for a regular or hierarchical grid data structure. Expand
Nonparametric semantic segmentation for 3D street scenes
  • Hu He, B. Upcroft
  • Computer Science
  • 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems
  • 2013
This paper uses stereo image pairs collected from cameras mounted on a moving car to produce dense depth maps which are combined into a global 3D reconstruction using camera poses from stereo visual odometry and the resultant 3D semantic model is improved with the consideration of moving objects in the scene. Expand
REMODE: Probabilistic, monocular dense reconstruction in real time
This work proposes a novel approach to depth map computation that combines Bayesian estimation and recent development on convex optimization for image processing, and demonstrates that this method outperforms state-of-the-art techniques in terms of accuracy. Expand
Dynamic Hilbert Maps: Real-Time Occupancy Predictions in Changing Environments
Experiments performed using 2D and 3D laser data collected from crowded unstructured outdoor environments show that the proposed methodology can accurately predict occupancy states for areas of around 1000 m2 at 10 Hz, making the proposed framework ideal for online applications under real-time constraints. Expand
OctoMap: an efficient probabilistic 3D mapping framework based on octrees
An open-source framework to generate volumetric 3D environment models based on octrees and uses probabilistic occupancy estimation that represents not only occupied space, but also free and unknown areas and an octree map compression method that keeps the 3D models compact. Expand
SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
A large dataset to propel research on laser-based semantic segmentation, which opens the door for the development of more advanced methods, but also provides plentiful data to investigate new research directions. Expand
Joint Semantic Segmentation and 3D Reconstruction from Monocular Video
Improved 3D structure and temporally consistent semantic segmentation for difficult, large scale, forward moving monocular image sequences is demonstrated. Expand