Center-of-Mass-based Robust Grasp Planning for Unknown Objects Using Tactile-Visual Sensors

  title={Center-of-Mass-based Robust Grasp Planning for Unknown Objects Using Tactile-Visual Sensors},
  author={Qian Feng and Zhaopeng Chen and Jun Deng and Chunhui Gao and Jianwei Zhang and A. Knoll},
  journal={2020 IEEE International Conference on Robotics and Automation (ICRA)},
An unstable grasp pose can lead to slip, thus an unstable grasp pose can be predicted by slip detection. A regrasp is required afterwards to correct the grasp pose in order to finish the task. In this work, we propose a novel regrasp planner with multi-sensor modules to plan grasp adjustments with the feedback from a slip detector. Then a regrasp planner is trained to estimate the location of center of mass, which helps robots find an optimal grasp pose. The dataset in this work consists of 1… Expand
Combining Sensors Information to Enhance Pneumatic Grippers Performance
It is demonstrated that, through the use of force, torque, center of pressure and proximity information, the behavior of the developed pneumatic gripper prototype outperforms the one of the traditional pnematic gripping devices. Expand


Robot Intelligent Grasp of Unknown Objects Based on Multi-Sensor Information
By fusing all available sensor data appropriately, an intelligent real-time grasp system was achieved that is reliable enough to handle various objects with unknown weights, friction, and stiffness. Expand
Center-of-Mass-Based Grasp Pose Adaptation Using 3D Range and Force/Torque Sensing
This work introduces a new Center-of-Mass-based grasp pose adaptation method, for picking up objects using a combination of exteroceptive 3D perception and proprioceptive force/torque sensor feedback, potentially improving the reliability of the grasping and the subsequent manipulation task. Expand
Grasp stability assessment through unsupervised feature learning of tactile images
A novel way to improve robotic grasping is presented: by using tactile sensors and an unsupervised feature-learning approach, a robot can find the common denominators behind successful and failed grasps, and use this knowledge to predict whether a grasp attempt will succeed or fail. Expand
Learning to Grasp Without Seeing
This is the first attempt at learning to grasp with only tactile sensing and without any prior object knowledge and significantly boosts the overall accuracy when applied on top of a vision-based policy. Expand
Grip Stabilization of Novel Objects Using Slip Prediction
This article forms a supervised-learning problem to predict the future occurrence of slip from high-dimensional tactile information provided by a BioTac sensor, and demonstrates how different input features, slip prediction time horizons, and available tactile information channels, impact prediction accuracy. Expand
Deep learning a grasp function for grasping under gripper pose uncertainty
A new method for parallel-jaw grasping of isolated objects from depth images, under large gripper pose uncertainty, which trains a Convolutional Neural Network which takes as input a single depth image of an object, and outputs a score for each grasp pose across the image. Expand
PointNetGPD: Detecting Grasp Configurations from Point Sets
Experiments on object grasping and clutter removal show that the proposed PointNetGPD model generalizes well to novel objects and outperforms state-of-the-art methods. Expand
Deep learning for detecting robotic grasps
This work presents a two-step cascaded system with two deep networks, where the top detections from the first are re-evaluated by the second, and shows that this method improves performance on an RGBD robotic grasping dataset, and can be used to successfully execute grasps on two different robotic platforms. Expand
Review of Deep Learning Methods in Robotic Grasp Detection
The current state-of-the-art in regards to the application of deep learning methods to generalised robotic grasping is reviewed and how each element of the deep learning approach has improved the overall performance of robotic grasp detection is discussed. Expand
Tactile Regrasp: Grasp Adjustments via Simulated Tactile Transformations
A novel regrasp control policy that makes use of tactile sensing to plan local grasp adjustments by virtually searching for local transformations of tactile measurements that improve the quality of the grasp is presented. Expand