Controller-free exploration of medical image data: Experiencing the Kinect

@article{Gallo2011ControllerfreeEO,
  title={Controller-free exploration of medical image data: Experiencing the Kinect},
  author={Luigi Gallo and Alessio Pierluigi Placitelli and Mario Ciampi},
  journal={2011 24th International Symposium on Computer-Based Medical Systems (CBMS)},
  year={2011},
  pages={1-6}
}
In this paper, an open-source system for a controller-free, highly interactive exploration of medical images is presented. By using a Microsoft Xbox Kinect™ as the only input device, the system's user interface allows users to interact at a distance through hand and arm gestures. The paper also details the interaction techniques we have designed specifically for the deviceless exploration of medical imaging data. Since the user interface is touch-free and does not require complex calibration… Expand
A Touchless Visualization System for Medical Volumes Based on Kinect Gesture Recognition
TLDR
A new system is developed, which can visualize 3D medical image by simple touchless single-handed interactions, and its functions are not enough for surgical support. Expand
System for touchless interaction with medical images in surgery using Leap Motion
TLDR
A new system based on combining the Leap Motion gesture recognition controller and medical imaging toolkit for touchless visualization and browsing for medical image data is presented. Expand
Waving at the Heart: Implementation of a Kinect-based real-time interactive control system for viewing cineangiogram loops during cardiac catheterization procedures
TLDR
The new Kinect from Windows was used to develop a protocol allowing real-time interaction between the interventional cardiologist and the imaging software of the fluoroscopic image viewer, based on single arm gestures to limit interference with invasive procedures. Expand
Exploration of 3D Medical Image Data for Interventional Radiology using Myoelectric Gesture Control
TLDR
A gesture-based interface for a medical image viewer that is completely touchlessly controlled by the Myo Gesture Control Armband (Thalmic Labs) is introduced and a minimal gesture set is proposed to support basic interaction tasks with radiological images and 3D models. Expand
Natural interactive 3D medical image viewer based on finger and arm gestures
TLDR
The results show that the proposed technique is applicable for controlling 3D medical image viewer software without the WIMP system. Expand
Natural interaction on 3D medical image viewer software
TLDR
The controller-free natural interaction on 3D medical image viewer software through a Kinect camera will be developed to replace WIMP such that surgeons can view medical images in the operating room without contacting mouse and keyboard. Expand
Touchfree medical interfaces
  • N. Rossol, I. Cheng, Rui Shen, A. Basu
  • Computer Science, Medicine
  • 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
  • 2014
TLDR
This work presents a novel interface that automatically adjusts for gesturing with hands and hand-held tools to precisely control medical displays via mid-air hand gestures using the recently released Leap Motion controller. Expand
An Interactive-Shoe For Surgeons: Hand-Free Interaction With Medical 2D Data
TLDR
A sensor-integrated shoe allowing surgeons to browse and manipulate 2D medical image data by foot movement is presented, which is portable and wearable and provides first indications for the effectiveness of a shoe interface in this application area. Expand
A Touchless system for image visualization during surgery: preliminary experience in clinical settings
  • C. Massaroni, F. Giurazza, +6 authors R. Setola
  • Computer Science, Medicine
  • 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  • 2018
TLDR
Assessment during tests in laboratory and clinical settings a Surgery Touchless System (STS) found that the STS was considered safe and useful by both the radiologists and patients, and found the system useful. Expand
A Touchless Gestural Platform for the Interaction with the Patients Data
TLDR
The idea is to create an interaction modality that permits doctors to interact with the patient's data without contact with any device but only moving the hand in the free space, based on the use of the Microsoft Kinect as input sensor for the detection of the user’s hand movements. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 16 REFERENCES
A Glove-Based Interface for 3D Medical Image Visualization
In this paper, a low cost and portable 3D user interface for exploring medical data is presented. By means of a data glove, equipped with five bend sensors and an accelerometer, and a Wiimote, whichExpand
Touch- and marker-free interaction with medical software
TLDR
A touch-free input device for a medical data display application based on a hand gesture recognition system that replaces completely the use of the computer’s mouse is described. Expand
A user interface for VR-ready 3D medical imaging by off-the-shelf input devices
TLDR
A novel user interface to provide a direct interaction in 3D space by off-the-shelf input devices is proposed, which features a depth-enhanced mouse pointer and a novel rotation technique that uses the object's geometry as the rotation handle. Expand
A gesture-based tool for sterile browsing of radiology images.
TLDR
"Gestix," a vision-based hand gesture capture and recognition system that interprets in real-time the user's gestures for navigation and manipulation of images in an electronic medical record (EMR) database, is presented. Expand
A Gesture Interface for Radiological Workstations
TLDR
A prototype that aims to integrate common functions such as virtual manipulation and navigation control, with a basic gesture interface is presented, combining independent hand posture and trajectory recognition to send command messages to the host application. Expand
OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images
TLDR
OsiriX was designed for display and interpretation of large sets of multidimensional and multimodality images such as combined PET-CT studies and ensures that all new developments in image processing that could emerge from other academic institutions using these libraries can be directly ported to the OsiriX program. Expand
Gesture Control for Consumer Electronics
TLDR
This chapter presents a review on gesture control technologies for CE devices and introduces different sensing technologies and then focuses on camera-based gesture sensing and interpretation, which provides a promising solution for natural user interfaces. Expand
PRISM interaction for enhancing control in immersive virtual environments
TLDR
This work presents PRISM, which dynamically adjusts the C/D ratio between the hand and the controlled object to provide increased control when moving slowly and direct, unconstrained interaction when moving rapidly. Expand
User interface paradigms for patient-specific surgical planning: lessons learned over a decade of research.
This paper covers work in virtual reality-based, patient-specific surgical planning over the past decade. It aims to comprehensively examine the user interface paradigms and system designs duringExpand
Smoothed Pointing: A User-Friendly Technique for Precision Enhanced Remote Pointing
TLDR
The distinctive features of the control-to-display ratio adaptation technique designed to reduce the effect of both noise in input device signals and of hand tremors on the cursor stability and increase the accuracy of pointing when performed on large, high resolution displays are introduced. Expand
...
1
2
...