Methodologies for immersive robot programming in an augmented reality environment

@article{Chong2006MethodologiesFI,
  title={Methodologies for immersive robot programming in an augmented reality environment},
  author={J. W. S. Chong and S. K. Ong and Andrew Y. C. Nee},
  journal={Int. J. Virtual Real.},
  year={2006},
  volume={6},
  pages={69-79}
}
Advancements in robotics have gained much momentum in recent years. Industrial robotic systems are increasingly being used outside the factory floor, evident by the growing presence of service robots in personal environments. In light of these trends, there is currently a pressing need of identifying new ways of programming robots safely, quickly and more intuitively. These methods should focus on service robots and address long outstanding Human-Robot Interaction issues in industrial robotics… 
View on ACM
ijvr.org
27 Citations
Background Citations
6
Methods Citations
4

27 Citations

Citation Type

Citation Type

Robot Programming Using Augmented Reality
TLDR
The RPAR-II system assists the users during the robot programming process from task planning to execution and stereo vision-based methodologies for virtual objects registration as well as interactive device position tracking are employed in this system.
Towards commissioning, resilience and added value of Augmented Reality in robotics: Overcoming technical obstacles to industrial applicability
Augmented reality–based programming, planning and simulation of a robotic work cell
In this article, the development of an augmented reality–based robotic work cell is presented, consisting of a virtual robot arm, conveyor belt, pallet and computer numerical control machine that…
Embedded Augmented Reality Training System for Dynamic Human-Robot Cooperation
TLDR
Results of user performance focussing on executing times and shooting accuracy indicate a tie between AR and VR and a surpassing overall usability in both configurations, but the users' personal preference trends towards AR.
An Evaluation of Camera Pose Methods for an Augmented Reality System: Application to Teaching Industrial Robots
TLDR
A demonstrator showing the interaction of industrial robots with virtual components and allowing to train users to perform successfully their tasks on a virtual representation of a production entity is registered as a part of TRI project (Teleteaching Industrial Robots).
A Flexible Mixed Reality Simulation Framework for Software Development in Robotics
TLDR
A generic, conceptual MR framework is contributed to provide a common, standardised simulation environment for experimentation involving real and virtual objects, and an MR robot simulator is implemented based on the framework, integrating standardised data interfaces in its design to increase interoperability.
An Augmented Reality System to Support Fault Visualization in Industrial Robotic Tasks
TLDR
Results show that the adaptive modality allows users to recognize faults faster and with fewer movements than the non adaptive one, thus overcoming the limitation of the narrow field-of-view of the HoloLens device.
A systematic review of Augmented Reality interfaces for collaborative industrial robots
Spatial Programming for Industrial Robots: Efficient, Effective and User-Optimised through Natural Communication and Augmented Reality
TLDR
A robot programming system taking into account natural communication and process integrated simulation as well as a unified robot control layer and an interface towards the Digital Factory for program transmission and a user study evaluates programming duration, programming errors and subjective assessment compared with Teach-In and Offline Programming.
Overview of Human-Robot Collaboration in Manufacturing
TLDR
High-level multimodal commands include gesture and posture recognition, voice processing and sensorless haptic interaction for intuitive HRC in local and remote collaboration within the manufacturing context are presented.
...
1
2
3
...

References

SHOWING 1-10 OF 31 REFERENCES
Augmented reality for programming industrial robots
TLDR
This paper presents a demonstrator of a standalone augmented reality pilot system allowing an operator to program robot waypoints and process specific events related to paint applications, allowing him to inspect the process result before the robot has performed the actual task.
Model based vision as feedback for virtual reality robotics environments
TLDR
The paper describes the use of a VRRE for a semi-autonomous robot system comprising an industrial 5-axis robot, its virtual equivalent and a model based vision system used as feed-back and a reflex-type behavior based on vision has been implemented.
Robot programming by human demonstration: the use of human inconsistency in improving 3D robot trajectories
  • N. Delson, H. West
  • Computer Science
    Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94)
  • 1994
TLDR
The presence of human inconsistency is used to improve robot performance by generating robot trajectories that are shorter than the demonstrated ones and with the addition of a buffer between the robot and the obstacles.
Robot programming by human demonstration: the use of human variation in identifying obstacle free trajectories
  • N. Delson, H. West
  • Computer Science
    Proceedings of the 1994 IEEE International Conference on Robotics and Automation
  • 1994
TLDR
A method is presented that uses multiple demonstrations of the same task to identify a more satisfactory robot trajectory, and variation in human trajectories between trials is attributed to human inconsistency and is used to define an obstacle free region by applying the Jordan curve theorem.
Robot programming by Demonstration (RPD): Supporting the induction by human interaction
TLDR
The objective is to explore the possibilities of integrating learning and clustering algorithms for automated robot programming by investigating how human interaction within system- as well as user-initiated dialogs can support the induction component.
Leveraging on a virtual environment for robot programming by demonstration
An Augmented Reality System for Training and Assistence to Maintenance in the Industrial Context
TLDR
An AR system for training and assisting in maintaining equipment in industrial context, which superimposes the augmentations in the view of the user and a scenario-based concept, which takes users step by step through training or maintenance tasks is described.
INDUSTRIAL ROBOTS AND ROBOT SYSTEM SAFETY
  • Materials Science
  • 2008
Industrial robots are programmable multifunctional mechanical devices designed to move material, parts, tools, or specialized devices through variable programmed motions to perform a variety of…
A Survey of Augmented Reality
  • Ronald T. Azuma
  • Economics
    Presence: Teleoperators & Virtual Environments
  • 1997
TLDR
The characteristics of augmented reality systems are described, including a detailed discussion of the tradeoffs between optical and video blending approaches, and current efforts to overcome these problems are summarized.
Time-Optimal Control of Robotic Manipulators Along Specified Paths
The minimum-time manipulator control problem is solved for the case when the path is specified and the actuator torque limitations are known. The optimal open-loop torques are found, and a method is…
...
1
2
3
4
...