Corpus ID: 236447743

VIPose: Real-time Visual-Inertial 6D Object Pose Tracking

  title={VIPose: Real-time Visual-Inertial 6D Object Pose Tracking},
  author={Rundong Ge and Giuseppe Loianno},
Estimating the 6D pose of objects is beneficial for robotics tasks such as transportation, autonomous navigation, manipulation as well as in scenarios beyond robotics like virtual and augmented reality. With respect to single image pose estimation, pose tracking takes into account the temporal information across multiple frames to overcome possible detection inconsistencies and to improve the pose estimation efficiency. In this work, we introduce a novel Deep Neural Network (DNN) called VIPose… Expand

Figures and Tables from this paper


se(3)-TrackNet: Data-driven 6D Pose Tracking by Calibrating Image Residuals in Synthetic Domains
This work proposes a data-driven optimization approach for long-term, 6D pose tracking, which aims to identify the optimal relative pose given the current RGB-D observation and a synthetic image conditioned on the previous best estimate and the object’s model. Expand
PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
This work introduces PoseCNN, a new Convolutional Neural Network for 6D object pose estimation, which is highly robust to occlusions, can handle symmetric objects, and provide accurate pose estimation using only color images as input. Expand
Real-Time Seamless Single Shot 6D Object Pose Prediction
A single-shot approach for simultaneously detecting an object in an RGB image and predicting its 6D pose without requiring multiple stages or having to examine multiple hypotheses is proposed, which substantially outperforms other recent CNN-based approaches when they are all used without postprocessing. Expand
CDPN: Coordinates-Based Disentangled Pose Network for Real-Time RGB-Based 6-DoF Object Pose Estimation
This work proposes a novel 6-DoF pose estimation approach: Coordinates-based Disentangled Pose Network (CDPN), which disentangles the pose to predict rotation and translation separately to achieve highly accurate and robust pose estimation. Expand
6-DoF object pose from semantic keypoints
A novel approach to estimating the continuous six degree of freedom (6-DoF) pose (3D translation and rotation) of an object from a single RGB image by combining semantic keypoints predicted by a convolutional network with a deformable shape model. Expand
PoseRBPF: A Rao–Blackwellized Particle Filter for 6-D Object Pose Tracking
This work forms the 6D object pose tracking problem in the Rao-Blackwellized particle filtering framework, where the 3D rotation and the3D translation of an object are decoupled, and achieves state-of-the-art results on two 6D pose estimation benchmarks. Expand
DeepIM: Deep Iterative Matching for 6D Pose Estimation
A novel deep neural network for 6D pose matching named DeepIM is proposed that is able to iteratively refine the pose by matching the rendered image against the observed image. Expand
Deep Model-Based 6D Pose Refinement in RGB
A new visual loss is proposed that drives the pose update by aligning object contours, thus avoiding the definition of any explicit appearance model and producing pose accuracies that come close to 3D ICP without the need for depth data. Expand
Multi-view self-supervised deep learning for 6D pose estimation in the Amazon Picking Challenge
This paper proposes a self-supervised method to generate a large labeled dataset without tedious manual segmentation and demonstrates that the system can reliably estimate the 6D pose of objects under a variety of scenarios. Expand
Real-Time Monocular Pose Estimation of 3D Objects Using Temporally Consistent Local Color Histograms
A novel approach to 6DOF pose estimation and segmentation of rigid 3D objects using a single monocular RGB camera based on temporally consistent, local color histograms that outperforms previous methods in cases of cluttered backgrounds, heterogenous objects, and occlusions. Expand