• Corpus ID: 226227028

Pose Estimation of Specular and Symmetrical Objects

  title={Pose Estimation of Specular and Symmetrical Objects},
  author={Jiaming Hu and Hongyi Ling and Priyam Parashar and Aayush Naik and Henrik I. Christensen},
In the robotic industry, specular and textureless metallic components are ubiquitous. The 6D pose estimation of such objects with only a monocular RGB camera is difficult because of the absence of rich texture features. Furthermore, the appearance of specularity heavily depends on the camera viewpoint and environmental light conditions making traditional methods, like template matching, fail. In the last 30 years, pose estimation of the specular object has been a consistent challenge, and most… 

Figures and Tables from this paper

Lessons Learned Developing an Assembly System for WRS 2020 Assembly Challenge

This work presents the approach to assembly based on integration of machine vision, robust planning and execution using behavior trees and a hierarchy of recovery strategies to ensure robust operation.



3D pose estimation and segmentation using specular cues

This work presents a system for fast model-based segmentation and 3D pose estimation of specular objects using appearance based specular features and incorporates several practical heuristics such as use of saturated/highlight pixels for fast matching and normal selection to minimize the effects of inter-reflections and cluttered backgrounds.

Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimation

A novel pose estimation method that predicts the 3D coordinates of each object pixel without textured models, and a novel loss function, the transformer loss, is proposed to handle symmetric objects by guiding predictions to the closest symmetric pose.

PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes

This work introduces PoseCNN, a new Convolutional Neural Network for 6D object pose estimation, which is highly robust to occlusions, can handle symmetric objects, and provide accurate pose estimation using only color images as input.

DPOD: 6D Pose Object Detector and Refiner

A novel deep learning method that estimates dense multi-class 2D-3D correspondence maps between an input image and available 3D models and demonstrates that a large number of correspondences is beneficial for obtaining high-quality 6D poses both before and after refinement.

Pose estimation in heavy clutter using a multi-flash camera

A novel cost function that respects both the position and the local orientation of each edge pixel is introduced that is significantly superior to traditional Chamfer cost and leads to accurate matching even in heavily cluttered scenes where traditional methods are unreliable.

Estimating 6D Pose From Localizing Designated Surface Keypoints

The core of the approach is that a set of surface points on target object model are designated as keypoints and then train a keypoint detector (KPD) to localize them and a PnP algorithm can recover the 6D pose according to the 2D-3D relationship of keypoints.

PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization

This work trains a convolutional neural network to regress the 6-DOF camera pose from a single RGB image in an end-to-end manner with no need of additional engineering or graph optimisation, demonstrating that convnets can be used to solve complicated out of image plane regression problems.

Geometric Loss Functions for Camera Pose Regression with Deep Learning

  • Alex KendallR. Cipolla
  • Computer Science
    2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2017
A number of novel loss functions for learning camera pose which are based on geometry and scene reprojection error are explored, and it is shown how to automatically learn an optimal weighting to simultaneously regress position and orientation.

Deep Model-Based 6D Pose Refinement in RGB

A new visual loss is proposed that drives the pose update by aligning object contours, thus avoiding the definition of any explicit appearance model and producing pose accuracies that come close to 3D ICP without the need for depth data.

DeepIM: Deep Iterative Matching for 6D Pose Estimation

A novel deep neural network for 6D pose matching named DeepIM is proposed, trained to predict a relative pose transformation using a disentangled representation of 3D location and 3D orientation and an iterative training process.