Pose Estimation and 3D Reconstruction of Vehicles from Stereo-Images Using a Subcategory-Aware Shape Prior

@article{Coenen2021PoseEA,
  title={Pose Estimation and 3D Reconstruction of Vehicles from Stereo-Images Using a Subcategory-Aware Shape Prior},
  author={Max Coenen and Franz Rottensteiner},
  journal={ArXiv},
  year={2021},
  volume={abs/2107.10898}
}
The 3D reconstruction of objects is a prerequisite for many highly relevant applications of computer vision such as mobile robotics or autonomous driving. To deal with the inverse problem of reconstructing 3D objects from their 2D projections, a common strategy is to incorporate prior object knowledge into the reconstruction approach by establishing a 3D model and aligning it to the 2D image plane. However, current approaches are limited due to inadequate shape priors and the insufficiency of… Expand

References

SHOWING 1-10 OF 76 REFERENCES
Probabilistic Vehicle Reconstruction Using a Multi-Task CNN
TLDR
A probabilistic approach for shape-aware 3D vehicle reconstruction from stereo images that leverages the outputs of a novel multi-task CNN that outputs probability distributions for the vehicle's orientation and for both, vehicle keypoints and wireframe edges. Expand
RECOVERING THE 3D POSE AND SHAPE OF VEHICLES FROM STEREO IMAGES
TLDR
This work uses a deformable vehicle shape prior learned from CAD vehicle data to fully reconstruct the vehicles in 3D and to recover their 3D pose and shape and applies a robust model fitting procedure based on iterative Monte Carlo model particle sampling to minimise the energy function. Expand
DirectShape: Photometric Alignment of Shape Priors for Visual Vehicle Pose and Shape Estimation
TLDR
This paper proposes a novel approach to jointly infer the 3D rigid-body poses and shapes of vehicles from stereo images of road scenes and demonstrates that the method significantly improves accuracy for several recent detection approaches. Expand
Reconstructing vehicles from a single image: Shape priors for road scene understanding
TLDR
Though the problem appears to be ill-posed, it is demonstrated that prior knowledge about how 3D shapes of vehicles project to an image can be used to reason about the reverse process, i.e., how shapes (back-)project from 2D to 3D. Expand
Dense Reconstruction Using 3D Object Shape Priors
TLDR
A formulation of monocular SLAM which combines live dense reconstruction with shape priors-based 3D tracking and reconstruction, and automatically augments the SLAM system with object specific identity, together with 6D pose and additional shape degrees of freedom for the object(s) of known class in the scene, combining image data and depth information for the pose and shape recovery. Expand
Vehicle Pose and Shape Estimation Through Multiple Monocular Vision
TLDR
The algorithm outperforms other existing monocular and stereo methods for vehicles' pose and shape estimation and provides a new and robust solution for off-board visual vehicle localization and tracking, which can be applied to massive surveillance camera networks for intelligent transportation. Expand
PRECISE VEHICLE RECONSTRUCTION FOR AUTONOMOUS DRIVING APPLICATIONS
TLDR
A shape prior is learned, consisting of vehicle geometry and appearance features, and a vehicle model is fit to initially detected vehicles by minimising an energy function, jointly incorporating 3D and 2D information to infer the model’s optimal and precise pose parameters. Expand
DETECTION AND 3D MODELLING OF VEHICLES FROM TERRESTRIAL STEREO IMAGE PAIRS
Abstract. The detection and pose estimation of vehicles plays an important role for automated and autonomous moving objects e.g. in autonomous driving environments. We tackle that problem on theExpand
Shape priors for real-time monocular object localization in dynamic environments
TLDR
This paper presents a real-time monocular object localization system that estimates the shape and pose of dynamic objects in real- time, using video frames captured from a moving monocular camera, and presents a CNN architecture that performs precise keypoint localization. Expand
Joint 3d Estimation of Vehicles and Scene Flow
TLDR
A novel unified approach which reasons jointly about 3D scene flow as well as the pose, shape and motion of vehicles in the scene is proposed and the results provide a prove of concept and demonstrate the usefulness of the method. Expand
...
1
2
3
4
5
...