Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey

@article{Sanchez2018RoboticMA,
  title={Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey},
  author={Jose Sanchez and Juan Antonio Corrales and B. C. Bouzgarrou and Youcef Mezouar},
  journal={The International Journal of Robotics Research},
  year={2018},
  volume={37},
  pages={688 - 716}
}
We present a survey of recent work on robot manipulation and sensing of deformable objects, a field with relevant applications in diverse industries such as medicine (e.g. surgical assistance), food handling, manufacturing, and domestic chores (e.g. folding clothes). We classify the reviewed approaches into four categories based on the type of object they manipulate. Furthermore, within this object classification, we divide the approaches based on the particular task they perform on the… 
Survey on multi-robot manipulation of deformable objects
TLDR
A survey of relevant state-of-the-art approaches concerning manipulation of deformable objects by multiple robots is contributed, which includes a specific classification with different criteria and a subsequent analysis of the leading methods, the main challenges and the future research directions.
Challenges and Outlook in Robotic Manipulation of Deformable Objects
TLDR
This article reviews recent advances in deformable object manipulation and highlights the main challenges when considering deformation in each sub-field, and proposes future directions of research.
Multi-Modal Sensing and Robotic Manipulation of Non-Rigid Objects: A Survey
TLDR
The recent advances in sensing and modelling of non-rigid objects with a focus on describing the methods and technologies used to measure their shape and estimate their material and physical properties are summarized.
Modeling of Deformable Objects for Robotic Manipulation: A Tutorial and Review
TLDR
This survey article starts by providing a tutorial on foundational aspects of models of shape and shape dynamics and uses this as the basis for a review of existing work on learning and estimation of these models and on motion planning and control to achieve desired deformations.
Toward a General Framework for 3D Deformable Object Grasping and Manipulation
TLDR
This work aims to provide a path forward to solve some of the challenges pertaining to the robotic manipulation of deformableObjects and integrate these solutions in a flexible system able to manipulate various deformable objects in a taskindependent way.
Manipulation of Flexible Objects
TLDR
Applications, challenges, past research works and perspectives of flexible robot manipulation are reviewed, spanning from construction to food industry and surgery.
Grasp Selection for In-Hand Robotic Manipulation of Non-Rigid Objects with Shape Control
TLDR
This work proposes an efficient algorithm and control framework that integrates RGB-D computer vision with a three-finger robotic gripper in a systemic approach for selecting the initial grasp points for a 2D shape control task through visual inspection of the object and desired target shape contours.
Blind Manipulation of Deformable Objects Based on Force Sensing and Finite Element Modeling
TLDR
The proposed approach is thoroughly evaluated in real experiments using a robot manipulator and a force-torque sensor to show its accuracy in estimating and manipulating deformations without the use of vision sensors.
Online Shape Estimation based on Tactile Sensing and Deformation Modeling for Robot Manipulation
TLDR
A modular pipeline to track the shape of a soft object in an online manner by coupling tactile sensing with a deformation model is presented and evaluated using a Shadow Dexterous Hand equipped with BioTac sensors on its fingertips and an RGB-D sensor.
Deformable Object Recognition Using Proprioceptive and Exteroceptive Tactile Sensing
TLDR
This work shows how proprioceptive and exteroceptive sensing can help to distinguish deformable and rigid objects and presents the pipeline for recognition of object deformability based on sensor measurements.
...
...

References

SHOWING 1-10 OF 158 REFERENCES
Visual monitoring of surface deformations on objects manipulated with a robotic hand
TLDR
This visual monitoring framework, which uses state-of-the-art computer vision methods, provides a robotic hand system with comprehensive monitoring of the deformable object that it manipulates as it tracks its deformation.
Intelligent Learning for Deformable Object Manipulation
TLDR
A generalized learning algorithm for handling of 3-D deformable objects in which prior knowledge of object attributes is not required and thus it can be applied to a large class of object types.
A tactile-based grasping strategy for deformable objects' manipulation and deformability estimation
TLDR
This paper presents a control strategy for grasping deformable objects, focused on elastic foams, based on tactile information, which achieves adaptation at different elastic properties of the object because the deformability degree is estimated during the grasping process.
Control of Robot Fingers with Adaptable Tactile Servoing to Manipulate Deformable Objects
TLDR
This paper presents an adaptable tactile servoing control scheme that can be used in manipulation tasks of deformable objects and based on maintaining a force value at the contact points which changes according to the object softness.
Dexterous Robotic Manipulation of Deformable Objects with Multi-Sensory Feedback - a Review
TLDR
This chapter presents a thorough examination of the modern concepts developed by the robotic community related to deformable objects grasping and manipulation and proposes a critical evaluation of the manipulation algorithms, the instrumentation systems adopted and the examination of end-effector technologies, including dexterous robotic hands.
Identification and active exploration of deformable object boundary constraints through robotic manipulation
TLDR
A novel algorithm for estimating boundary constraints of deformable objects from robotic manipulation data is presented, which uses tissue deformation data collected with a vision system, and employs a multi-stage hill climbing procedure to estimate the boundary constraint of the object.
Automatic 3-D Manipulation of Soft Objects by Robotic Arms With an Adaptive Deformation Model
TLDR
A new feedback method to automatically servo-control the 3-D shape of soft objects with robotic manipulators by computes in real time the unknown deformation parameters of a soft object; this algorithm provides a valuable adaptive behavior to the deformation controller, something the authors cannot achieve with traditional fixed-model approaches.
On the visual deformation servoing of compliant objects: Uncalibrated control methods and experiments
TLDR
Two new visual servoing approaches to explicitly servo-control elastic deformations are presented, both of which provide a way to automatically control deformations in a model-free manner.
Passivity-based target manipulation inside a deformable object by a robotic system with noncollocated feedback
TLDR
An optimization technique is formulated that minimizes the total force applied to the object to determine the location of actuation points to affect the desired motion and a passivity-based control approach is developed to improve stability of the whole system.
Soft Object Deformation Monitoring and Learning for Model-Based Robotic Hand Manipulation
TLDR
A framework that automatically extracts and monitors the shape deformations of soft objects from a video sequence and maps them with force measurements with the goal of providing the necessary information to the controller of a robotic hand to ensure safe model-based deformable object manipulation.
...
...