Hand Gesture Recognition for Contactless Device Control in Operating Rooms

@article{NasrEsfahani2016HandGR,
  title={Hand Gesture Recognition for Contactless Device Control in Operating Rooms},
  author={Ebrahim Nasr-Esfahani and Nader Karimi and S. Mohamad R. Soroushmehr and M. Jafari and Mohammad Amin Khorsandi and Shadrokh Samavi and Kayvan Najarian},
  journal={ArXiv},
  year={2016},
  volume={abs/1611.04138}
}
Hand gesture is one of the most important means of touchless communication between human and machines. There is a great interest for commanding electronic equipment in surgery rooms by hand gesture for reducing the time of surgery and the potential for infection. There are challenges in implementation of a hand gesture recognition system. It has to fulfill requirements such as high accuracy and fast response. In this paper we introduce a system of hand gesture recognition based on a deep… Expand

Figures, Tables, and Topics from this paper

Hand-Gesture-Based Touchless Exploration of Medical Images with Leap Motion Controller
TLDR
A contactless interface based on the best recognition rate in order to facilitate the way of interaction with medical images in the operating room is developed. Expand
Hardware/Software-Codesign for Hand Gestures Recognition using a Convolutional Neural Network
TLDR
A convolutional neural network model is proposed that can recognize three static HGs using a simpler architecture and fewer weights than previously proposed networks and has an accuracy of 94%. Expand
A Comprehensive Evaluation of Moving Static Gesture Recognition with Convolutional Networks
TLDR
Experimental results show CNN is robust and effective for static gesture recognition in the complex environment. Expand
Kinect-Based Real-Time Gesture Recognition Using Deep Convolutional Neural Networks for Touchless Visualization of Hepatic Anatomical Models in Surgery
TLDR
A novel touchless interaction system for visualization of hepatic anatomical models in surgery using a Microsoft Kinect sensor as input device and a deep convolutional neural network used to recognize various hand gestures. Expand
Robust Hand Gesture Recognition Using Multimodal Deep Learning for Touchless Visualization of 3D Medical Images
TLDR
This study proposes a robust hand gesture recognition using multimodal deep learning to perform recognition using color and depth images and found that the proposed system achieves better real-time robust recognition than conventional methods. Expand
Multi-Features Capacitive Hand Gesture Recognition Sensor: A Machine Learning Approach
Gesture recognition technology enables machines to understand human gestures. The technology is considered as a key enabler for gaming and virtual reality applications. In this paper, we propose anExpand
Use of Commercial Off-The-Shelf Devices for the Detection of Manual Gestures in Surgery: Systematic Literature Review
TLDR
The field was still in the exploratory phase in areas requiring touchless manipulation within environments and settings that must adhere to asepsis and antisepsis protocols, such as angiography suites and operating rooms. Expand
A Survey on Hand-based Behavioral Activity Recognition
TLDR
This study examined the different neural network adopted for the recognition of hand-based behavioral activity to recognize six complex hand motion activities such as smoking, drinking, eating, typing giving a talk and writing with a pen in a non-controlled environment using accelerometer and gyroscope sensor signals acquired from smart-watch. Expand
Classification of Informative Frames in Colonoscopy Videos Using Convolutional Neural Networks with Binarized Weights
TLDR
This paper proposes a novel classification of informative frames based on a convolutional neural network with binarized weights that reaches a dice score of 71.20% and accuracy of more than 90% using the mentioned dataset. Expand
Biopsy Procedure Applied in MentorEye Molecular Surgical Navigation System
TLDR
This article describes biopsy procedure implemented in MentorEye system which aims at supporting surgeons during complex oncological treatment with virtual planning algorithm steps with further intraoperative realization under the control of the optical navigation system. Expand
...
1
2
...

References

SHOWING 1-10 OF 23 REFERENCES
Hand gesture recognition with leap motion and kinect devices
TLDR
Experimental results present a comparison between the accuracy that can be obtained from the two devices on a subset of the American Manual Alphabet and show how, by combining the two features sets, it is possible to achieve a very high accuracy in real-time. Expand
Real-time visual static hand gesture recognition system and its FPGA-based hardware implementation
Gesture recognition has been paid more and more attention as a new generation of human-computer interaction and visual input mode. In motion sensing games and other applications, gesture recognitionExpand
A novel finger and hand pose estimation technique for real-time hand gesture recognition
TLDR
A novel algorithm is proposed to directly extract fingers from salient hand edges and can not only extract extensional fingers but also flexional fingers with high accuracy and the orientation of the gesture can be calculated without the aid of arm direction. Expand
Vision-based remote control system by motion detection and open finger counting
TLDR
Experimental results show that the shape of open fingers exhibits strong features for determining correct gesture states and the use of stable features on consecutive frames yields robust and accurate performance regardless of operating conditions. Expand
Vision based hand gesture recognition for human computer interaction: a survey
TLDR
An analysis of comparative surveys done in the field of gesture based HCI and an analysis of existing literature related to gesture recognition systems for human computer interaction by categorizing it under different key parameters are provided. Expand
Feasibility of touch-less control of operating room lights
  • F. Hartmann, A. Schlaefer
  • Computer Science, Medicine
  • International Journal of Computer Assisted Radiology and Surgery
  • 2012
TLDR
Implementation of an automated operating room light and touch-less control using an RGBD camera for gesture tracking is feasible, the remaining tracking error does not affect smooth control, and the use of the system is intuitive even for inexperienced users. Expand
Gestonurse: a robotic surgical nurse for handling surgical instruments in the operating room
TLDR
The development of a robotic scrub nurse Gestonurse to support surgeons by passing surgical instruments during surgery as required is described, which responds to recognized hand signals detected through sophisticated computer vision and pattern recognition techniques. Expand
Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques
TLDR
This system includes detecting and tracking bare hand in cluttered background using skin detection and hand posture contour comparison algorithm after face subtraction, recognizing hand gestures via bag-of-features and multiclass support vector machine (SVM) and building a grammar that generates gesture commands to control an application. Expand
A gesture-based tool for sterile browsing of radiology images.
TLDR
"Gestix," a vision-based hand gesture capture and recognition system that interprets in real-time the user's gestures for navigation and manipulation of images in an electronic medical record (EMR) database, is presented. Expand
Vision-based hand-gesture applications
Body posture and finger pointing are a natural modality for human-machine interaction, but first the system must know what it's seeing.
...
1
2
3
...