An accessible, hands-on tutorial system for image-guided therapy and medical robotics using a robot and open-source software

  title={An accessible, hands-on tutorial system for image-guided therapy and medical robotics using a robot and open-source software},
  author={Danielle Frances Pace and Ron Kikinis and Nobuhiko Hata},
  journal={The Insight Journal},
This paper describes a new open-source tutorial for image-guided therapy (IGT) and medical robotics that is both accessible and hands-on using the LEGO Mindstorms NXT (a commercially available robotics kit) and 3D Slicer (an open-source application for medical image processing). The tutorial covers all stages of a typical IGT or medical robotics procedure, including the concepts of imaging, preoperative planning, targeting and tracking, navigation and registration, by using the LEGO robot to… 

Figures and Tables from this paper

An open-source framework for testing tracking devices using Lego Mindstorms

This framework consists of a robotic arm built from a set of Lego Mindstorms and an open-source toolkit written in C++ to control the robot movements and assess the accuracy of the tracking devices.

Image-guided navigation: A cost effective practical introduction using the image-guided surgery toolkit (IGSTK)

  • Ö. GülerZ. Yaniv
  • Computer Science
    2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society
  • 2012
This work provides an open source implementation of all the components required for a basic image-guided navigation as part of the Image-Guided Surgery Toolkit (IGSTK).

Validation of four-dimensional ultrasound for targeting in minimally-invasive beating-heart surgery

This paper proposes that placing 4D ultrasound within an augmented reality environment, along with a patient-specific cardiac model and virtual representations of tracked surgical tools, will create a visually intuitive platform with sufficient image information to safely and accurately repair tissue within the beating heart.

ROS-IGTL-Bridge: an open network interface for image-guided therapy using the ROS environment

A new open network bridge interface integrated in ROS will allow rapid and seamless integration of advanced image-based planning/navigation offered by the medical image computing software such as 3D Slicer into ROS-based surgical robot systems.



An integrated visualization system for surgical planning and guidance using image fusion and an open MR

A surgical guidance and visualization system that uniquely integrates capabilities for data analysis and on‐line interventional guidance into the setting of interventional MRI is presented, which has been applied in 45 neurosurgical cases and found to have beneficial utility for planning and guidance.

Application of Open Source Image Guided Therapy Software in MR-guided Therapies

It is reported that graphical representation of the surgical tools, interconnectively with the tracking device, patient-to-image registration, and MRI-based thermal mapping are crucial components of MR-guided therapy in sharing such software.

Maximum Lego NXT: Building Robots with Java Brains

The LEGO Mindstorms EV3 set is the latest in robotics technology, allowing you to build incredible motorized inventions without knowing anything about electronics. As a mass market device with

From science projects to the engineering bench

The CISSRS Surgical LEGO Robot Competition leverages the increasingly multidisciplinary field of surgical robotics and the versatile but easy to learn Mindstorms system to introduce participants to CIS by giving them hands-on experience in solving real-world, cutting-edge science and engineering challenges.

IGSTK: an open source software toolkit for image-guided surgery

IGSTK applies the open source development and delivery model to reduce the costs and risks associated with adopting this new technology, resulting in a safe, inexpensive, robust, shareable, and reusable software infrastructure.


  • H. LundL. Pagliarini
  • Computer Science
    Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065)
  • 2000
The user-guided behaviour-based approach is developed in order to allow non-expert users to develop their own robots in an easy and fast manner to allow children hands-on experience with robotics.

Fiducial Point Placement and the Accuracy of Point-based, Rigid Body Registration

The placement of fiducial points is an important factor in minimizing the error rate for point-based, rigid registration by using as many points as possible, avoiding near-collinear configurations, and ensuring that the centroid of the fiducials is as near as possible to the target, TREs can be minimized.

Rapid prototyping for interactive robots

This paper proposes to tackle the problem using the well-known rapid prototyping method from the software engineering, with detailed prototyping tech- niques adjusted for the nature of the robots and the tactile interaction.

The ITK Software Guide

There is disclosed a coating device for coating bands or ribbons with a coating material in continuous operation. The coating device comprises a main frame which mounts one or two deflector rollers