Registration of planar virtual fixtures by using augmented reality with dynamic textures

@article{Lonard2015RegistrationOP,
  title={Registration of planar virtual fixtures by using augmented reality with dynamic textures},
  author={Simon L{\'e}onard},
  journal={2015 IEEE International Conference on Robotics and Automation (ICRA)},
  year={2015},
  pages={4418-4423}
}
  • S. Léonard
  • Published 26 May 2015
  • Computer Science
  • 2015 IEEE International Conference on Robotics and Automation (ICRA)
This paper presents a method to align a virtual plane with a real plane in an augmented reality environment. The method addresses the challenge of configuring a planar virtual fixture during the teleoperation of a robot in a visually challenging environment. The method assists the operator to manually align the virtual plane with the real plane by providing visual cues by dynamically texturing the virtual plane. Following the manual initialization a robust evaluation of the optical flow is used… 

A Framework for Interactive Virtual Fixture Generation for Shared Teleoperation in Unstructured Environments

  • Vitalii PruksJ. Ryu
  • Computer Science
    2020 IEEE International Conference on Robotics and Automation (ICRA)
  • 2020
This work introduces a framework for the interactive generation of VF, based on the observation that a human can easily understand just by looking at the remote environment which VF could help in task execution, and proposes a user interface that detects features on camera images and permits interactive selection of the features.

Teleoperation and Visualization Interfaces for Remote Intervention in Space

It is proposed that effective teleoperation can be enabled by modeling the remote environment, providing operators with a fused view of the real environment and virtual model, and incorporating interfaces and control strategies that enable interactive planning, precise operation, and prompt detection of errors.

Accelerating Surgical Robotics Research: A Review of 10 Years With the da Vinci Research Kit

An extensive review of the publications that have been facilitated by the da Vinci Research Kit over the past decade is presented and some of the major challenges and needs for the robotics community to maintain and build upon this initiative are outlined.

Accelerating Surgical Robotics Research: Reviewing 10 Years of Research with the dVRK

An extensive review of the publications that have been facilitated by the da Vinci Research Kit over the past decade is presented and some of the major challenges and needs for the robotics community to maintain this initiative and build upon it are outlined.

References

SHOWING 1-10 OF 28 REFERENCES

Augmented reality environment with virtual fixtures for robotic telemanipulation in space

An augmented reality framework, implemented on the master console of a modified da Vinci® surgical robot, that enables the operator to design and implement assistive virtual fixtures during teleoperation to facilitate teleoperation with large time delays.

Using Kinect TM and a Haptic Interface for Implementation of Real-Time Virtual Fixtures

This paper demonstrates automatic generation of real-time haptic virtual fixtures using a low cost Xbox Kinect depth camera connected to a virtual environment and calculation of haptic forces, which are then passed on to a haptic device.

Using Kinect and a Haptic Interface for Implementation of Real-Time Virtual Fixture

It is demonstrated that haptic forces can be successfully rendered from real-time environments containing both non-moving and moving items, which has the potential to generate virtual fixtures from the patient in real- time during robotic surgery.

Homography-based 2D Visual Tracking and Servoing

Theoretical analysis and comparative experiments show that the proposed visual tracking algorithm has a higher convergence rate than standard first-order minimization techniques, and is well adapted to real-time robotic applications.

Haptic Virtual Fixtures for Robot-Assisted Manipulation

This paper discusses the design, analysis, and implementation of two categories of virtual fixtures: guidance virtual fixtures, which assist the user in moving the manipulator along desired paths or surfaces in the workspace, and forbidden-region virtual fixture, which prevent the manipulators from entering into forbidden regions of the workspace.

Spatial motion constraints: theory and demonstrations for robot guidance using virtual fixtures

Control algorithms for general motion constraints are described and demonstrated to enhance the accuracy and speed of a user manipulating in an environment with the assistance of a cooperative or telerobotic system.

Spatial Motion Constraints for Robot Assisted Suturing Using Virtual Fixtures

It is shown that with the help of VF, suturing can be performed at awkward angles without multiple trials, thus avoiding damage to tissue and demonstrating the promise of cooperative assistance in complex tasks such as sutured.

Forbidden-region virtual fixtures from streaming point clouds: Remotely touching and protecting a beating heart

  • F. RydenH. Chizeck
  • Mathematics
    2012 IEEE/RSJ International Conference on Intelligent Robots and Systems
  • 2012
The novelty in this paper is the idea of combining forbidden-region virtual fixtures with haptic rendering from streaming point clouds to protect as well as remotely touch a beating heart without any a priori knowledge of the heart geometry.

The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields

A framework based on robust estimation is presented that addresses violations of the brightness constancy and spatial smoothness assumptions caused by multiple motions of optical flow, and is applied to standard formulations of the optical flow problem thus reducing their sensitivity to violations of their underlying assumptions.

Virtual fixtures: Perceptual tools for telerobotic manipulation

  • L. Rosenberg
  • Business
    Proceedings of IEEE Virtual Reality Annual International Symposium
  • 1993
The beneficial effects of corrupting the link between operator and remote environment by introducing abstract perceptual information into the interface called virtual fixtures are described.