Applying Depth-Sensing to Automated Surgical Manipulation with a da Vinci Robot

@article{Hwang2020ApplyingDT,
  title={Applying Depth-Sensing to Automated Surgical Manipulation with a da Vinci Robot},
  author={Minho Hwang and Daniel Seita and Brijen Thananjeyan and Jeffrey Ichnowski and Samuel Paradis and Danyal Fer and Thomas Low and Ken Goldberg},
  journal={2020 International Symposium on Medical Robotics (ISMR)},
  year={2020},
  pages={22-29}
}
Recent advances in depth-sensing have significantly increased accuracy, resolution, and frame rate, as shown in the 1920x1200 resolution and 13 frames per second Zivid RGBD camera. In this study, we explore the potential of depth sensing for efficient and reliable automation of surgical subtasks. We consider a monochrome (all red) version of the peg transfer task from the Fundamentals of Laparoscopic Surgery training suite implemented with the da Vinci Research Kit (dVRK). We use calibration… Expand
Superhuman Surgical Peg Transfer Using Depth-Sensing and Deep Recurrent Neural Networks
TLDR
This is the first fully automated system to achieve “superhuman” performance in both speed and success on peg transfer, and an approach that leverages emerging innovations in depth sensing, deep learning, and Peiper's method for computing inverse kinematics with time-minimized joint motion is presented. Expand
Efficiently Calibrating Cable-Driven Surgical Robots With RGBD Sensing, Temporal Windowing, and Linear and Recurrent Neural Network Compensation
TLDR
A novel approach to efficiently calibrate a dVRK by placing a 3D printed fiducial coordinate frame on the arm and end-effector that is tracked using RGBD sensing is proposed and it is suggested that the resulting model can reduce the mean tracking error of the physical robot. Expand
Intermittent Visual Servoing: Efficiently Learning Policies Robust to Instrument Changes for High-precision Surgical Manipulation
TLDR
Results on a da Vinci Research Kit suggest that combining the coarse policy with half a second of corrections from the learned policy during each high-precision segment improves the success rate on the Fundamentals of Laparoscopic Surgery peg transfer task. Expand
Analysis of Laser Sensors and Camera Vision in the Shoe Position Inspection System
Inspection systems are currently an evolving field in the industry. The main goal is to provide a picture of the quality of intermediates and products in the production process. The most widespreadExpand
SurRoL: An Open-source Reinforcement Learning Centered and dVRK Compatible Platform for Surgical Robot Learning
TLDR
The designed SurRoL integrates a user-friendly RL library for algorithm development and a real-time physics engine, which is able to support more PSM/ECM scenarios and more realistic physical interactions, and achieves better transferability in the real world. Expand
Efficiently Calibrating Cable-Driven Surgical Robots With RGBD Fiducial Sensing and Recurrent Neural Networks
TLDR
A novel approach to efficiently calibrate robotic surgical assistants by placing a 3D printed fiducial coordinate frames on the arm and end-effector that is tracked using RGBD sensing and considering 13 approaches to modeling to measure the coupling and history-dependent effects between joints. Expand
Autonomous task planning and situation awareness in robotic surgery*
TLDR
A framework to implement surgical task automation consisting of a task-level reasoning module based on answer set programming, a low-level motion planning moduleBased on dynamic movement primitives, and a situation awareness module that generates explainable plans and recovers from failure conditions. Expand

References

SHOWING 1-10 OF 62 REFERENCES
Learning 2D Surgical Camera Motion From Demonstrations
TLDR
A probabilistic model that identifies image features that “dwell” close to the camera's focal point in expert demonstrations is proposed, and the extent to which the system correctly segments candidate debridement targets (box accuracy) and correctly ranks those targets (rank accuracy) is evaluated. Expand
Fast and Reliable Autonomous Surgical Debridement with Cable-Driven Robots Using a Two-Phase Calibration Procedure
TLDR
A novel two-phase coarse-to-fine calibration method for debridement of raisins and pumpkin seeds as fragment phantoms and finds that without calibration, position errors average 4.55mm and the combination of Phase I and Phase II can reduce average error to 1.08mm. Expand
Transferring Know-How for an Autonomous Camera Robotic Assistant
Robotic platforms are taking their place in the operating room because they provide more stability and accuracy during surgery. Although most of these platforms are teleoperated, a lot of research isExpand
SuPer: A Surgical Perception Framework for Endoscopic Tissue Manipulation With Surgical Robotics
TLDR
This letter proposes a novel surgical perception framework, SuPer, for surgical robotic control that successfully completed soft tissue manipulation tasks with high accuracy and was implemented on the da Vinci Surgical System in real-time with an end-effector controller. Expand
Automated Extraction of Surgical Needles from Tissue Phantoms
We consider the surgical subtask of automated extraction of embedded suturing needles from silicone phantoms and propose a four-step algorithm consisting of calibration, needle segmentation, graspExpand
Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization
TLDR
Initial results suggest that the dVRK can perform suturing at 30% of human speed while completing 86% suture throws attempted, and the Suture Needle Angular Positioner (SNAP) results in a 3x error reduction in the needle pose estimate in comparison with the standard actuator. Expand
Automated Pick-Up of Suturing Needles for Robotic Surgical Assistance
TLDR
This paper presents a vision-guided needle grasping method for automatically grasping the needle that has been inserted into the patient prior to anastomosis, and shows examples of successful autonomous grasping that has the potential to simplify and decrease the operational time in RALP by assisting a small component of urethrovesical anASTomosis. Expand
An interchangeable surgical instrument system with application to supervised automation of multilateral tumor resection
TLDR
Experiments suggest that an Intuitive Surgical system using these interchangeable instruments can perform a multi-step tumor resection procedure that uses a novel haptic probe to localize the tumor, standard scalpel to expose the tumors, standard grippers to extract the subcutaneous tumor, and a fluid injection tool to seal the wound. Expand
Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms
TLDR
Using the da Vinci Research Kit (DVRK) robotic surgical assistant, this work explores a “Learning By Observation” (LBO) approach where the robot identifies, segment, and parameterize motion sequences and sensor conditions to build a finite state machine (FSM) for each subtask. Expand
Autonomous Laparoscopic Robotic Suturing with a Novel Actuated Suturing Tool and 3D Endoscope
  • H. Saeidi, H. Le, +5 authors A. Krieger
  • Computer Science, Medicine
  • 2019 International Conference on Robotics and Automation (ICRA)
  • 2019
TLDR
The authors' test results indicate that STAR can reach 2.9 times better consistency in suture spacing compared to manual method and also eliminate suture repositioning and adjustments, and the consistency of suture bite sizes obtained by STAR matches with those obtained by manual suturing. Expand
...
1
2
3
4
5
...