Soft Biomimetic Optical Tactile Sensing With the TacTip: A Review

  title={Soft Biomimetic Optical Tactile Sensing With the TacTip: A Review},
  author={Nathan F. Lepora},
  journal={IEEE Sensors Journal},
  • N. Lepora
  • Published 30 May 2021
  • Biology
  • IEEE Sensors Journal
Reproducing the capabilities of the human sense of touch in machines is an important step in enabling robot manipulation to have the ease of human dexterity. A combination of robotic technologies will be needed, including soft robotics, biomimetics and the high-resolution sensing offered by optical tactile sensors. This combination is considered here as a SoftBOT (Soft Biomimetic Optical Tactile) sensor. This article reviews the BRL TacTip as a prototypical example of such a sensor. Topics… 

Figures and Tables from this paper

A Robust Controller for Stable 3D Pinching Using Tactile Sensing

Overall, the grasp system is demonstrated to achieve stable equilibrium poses on various objects ranging in shape and softness, with the system being robust to perturbations and measurement errors.

Elastic Tactile Sensor Skin on Double-Curved Surfaces for Robots and Wearables

This work presents a novel tactile sensor skin which is completely made from elastic silicone rubber and can stretch to multiple times its original length without damage, and can measure forces and locations of multiple simultaneous contacts.

DigiTac: A DIGIT-TacTip Hybrid Tactile Sensor for Comparing Low-Cost High-Resolution Robot Touch

All three sensors performed similarly at pose prediction, but their constructions led to differing performances at servo control, offering guidance for researchers selecting or innovating tactile sensors.

Pose-Based Tactile Servoing: Controlled Soft Touch Using Deep Learning

A new way of controlling robots using soft tactile sensors: pose-based tactile servo (PBTS) control is described, to embed a tactile perception model for estimating the sensor pose within a servo control loop that is applied to local object features, such as edges and surfaces.

Mapping Mid-Air Haptics With a Low-Cost Tactile Robot

Mid-air haptics create a new mode of feedback to allow people to feel tactile sensations in the air. Ultrasonic arrays focus acoustic radiation pressure in space, to induce tactile sensation from the

Artificial SA-I and RA-I afferents for tactile sensing of ridges and gratings

The TacTip is proposed, a three-dimensionally printed sensor skin based on the physiology of the dermal–epidermal interface with an underlying mesh of biomimetic intermediate ridges and dermal papillae, comprising inner pins tipped with markers that shows a match between artificial and natural touch at single afferent, population and perceptual levels.

Tactile Gym 2.0: Sim-to-Real Deep Reinforcement Learning for Comparing Low-Cost High-Resolution Robot Touch

This letter extends the Tactile Gym simulator to include three new optical tactile sensors (TacTip, DIGIT and DigiTac) of the two most popular types, Gelsight- style (image-shading based) and TacTip-style (marker based), and demonstrates that a single sim-to-real approach can be used with these three different sensors to achieve strong real-world performance despite the significant differences between real tactile images.

BRL/Pisa/IIT SoftHand: A Low-cost, 3D-Printed, Underactuated, Tendon-Driven Hand with Soft and Adaptive Synergies

This letter introduces the BRL/Pisa/IIT (BPI) SoftHand: a single actuator-driven, low-cost, 3D-printed, tendon-driven, underactuated robot hand that can be used to perform a range of grasping tasks.

Visual Pressure Estimation and Control for Soft Robotic Grippers

—Soft robotic grippers facilitate contact-rich ma- nipulation, including robust grasping of varied objects. Yet the beneficial compliance of a soft gripper also results in significant deformation that

Semi-Supervised Disentanglement of Tactile Contact~Geometry from Sliding-Induced Shear

This work pursues a semi-supervised approach to remove shear while preserving contact- only information, and shows that it achieves comparable performance to its fully supervised counterpart across all validation tasks with an order of magnitude less supervision.



The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies

A range of soft optical tactile sensors with various morphologies fabricated through dual-material 3D printing, inspired by the same biomimetic design principle, suitable for real-world applications in tactile perception, exploration, and manipulation.

Tactile sensing in dexterous robot hands - Review

Biomimetic Tactile Sensor Array

The performance of robotic and prosthetic hands in unstructured environments is severely limited by their having little or no tactile information compared to the rich tactile feedback of the human hand, so means to optimize the dynamic range of individual electrode sensors by texturing the inner surface of the silicone skin.

Seeing by Touch: Evaluation of a Soft Biologically-Inspired Artificial Fingertip in Real-Time Active Touch

The results prove the capability of the sensor in such active exploration tasks, with a comparable performance to the human subjects despite it using tactile data alone whereas the human participants were also able to use proprioceptive cues.

Tactile manipulation with biomimetic active touch

In general, it appears there is a trade-off between the responsiveness to unknown change and manipulation accuracy, which must be set appropriately for each task.

A Miniaturised Neuromorphic Tactile Sensor integrated with an Anthropomorphic Robot Hand

A platform to contribute to that long-term vision, combining an anthropomorphic robot hand (QB SoftHand) with a neuromorphic optical tactile sensor (neuroTac) to produce efficient, spike-based representations of information for bio-inspired processing.

GelTip: A Finger-shaped Optical Tactile Sensor for Robotic Manipulation

The extensive experiments show that the GelTip sensor can effectively localise the contacts on different locations its finger-shaped body, with a small localisation error of approximately 5 mm, on average, and under 1 mm in the best cases.

Towards integrated tactile sensorimotor control in anthropomorphic soft robotic hands

This work reports on how a sense of touch can be used to control an underactuated anthropomorphic robot hand, based on an integration that respects the hand’s mechanical functionality, and gives a foundation to endow soft robotic hands with human-like touch.

A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics

A biomimetic soft electronic skin that is composed of an array of capacitors and capable of measuring and discriminating in real time both normal and tangential forces is reported, enabled by a three-dimensional structure that mimics the interlocked dermis-epidermis interface in human skin.

GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force

This paper reviews the development of GelSight, with the emphasis in the sensing principle and sensor design, and introduces the design of the sensor’s optical system, the algorithm for shape, force and slip measurement, and the hardware designs and fabrication of different sensor versions.