Robust Part-Based Hand Gesture Recognition Using Kinect Sensor

@article{Ren2013RobustPH,
  title={Robust Part-Based Hand Gesture Recognition Using Kinect Sensor},
  author={Zhou Ren and Junsong Yuan and Jingjing Meng and Zhengyou Zhang},
  journal={IEEE Transactions on Multimedia},
  year={2013},
  volume={15},
  pages={1110-1120}
}
The recently developed depth sensors, e.g., the Kinect sensor, have provided new opportunities for human-computer interaction (HCI). Although great progress has been made by leveraging the Kinect sensor, e.g., in human body tracking, face recognition and human action recognition, robust hand gesture recognition remains an open problem. Compared to the entire human body, the hand is a smaller object with more complex articulations and more easily affected by segmentation errors. It is thus a… 
Real time hand gesture recognition via finger-emphasized multi-scale description
TLDR
A finger emphasized multi-scale descriptor is proposed to represent the noisy and articulated hand shape segmented from the Kinect images, which incorporates three types of parameters of multiple scales, which emphasize the finger features.
A multi-scale descriptor for real time RGB-D hand gesture recognition
TLDR
A new real time hand gesture recognition method that incorporates three types of parameters of multiple scales to make a discriminative representation of the hand shape and is robust to noise, articulations and rigid transformations.
Robust Features of Finger Regions Based Hand Gesture Recognition Using Kinect Sensor
TLDR
A hand cropping approach is proposed to extract the useful finger regions from a noisy hand image including palm, wrist and arm obtained by Kinect, and an original dissimilarity metric, called Balanced Finger Earth Movers Distance (BFEMD), is used to classify hand gestures along with the hierarchical recognition strategy.
Contour Model-Based Hand-Gesture Recognition Using the Kinect Sensor
  • Y. Yao, Y. Fu
  • Computer Science
    IEEE Transactions on Circuits and Systems for Video Technology
  • 2014
TLDR
A 14-patch hand partition scheme is designed for color-based semiautomatic labeling and a hand contour model is proposed to simplify the gesture matching process, which can reduce the computational complexity of gesture matching.
Real-Time Hand Gesture Recognition Using RGB-D Sensor
TLDR
In this chapter, a new hand motion capture procedure for establishing the real gesture data set is proposed and a hand contour model is proposed to simplify the gesture matching process, which can reduce the computational complexity of gesture matching.
Human-Machine Interaction based on Hand Gesture Recognition using Skeleton Information of Kinect Sensor
TLDR
A new hand gesture recognition system using the Kinect sensor's skeleton data, which works in an environment where people do not touch devices or communicate verbally, and is able to detect the presence of hand area and fingers and to recognize different hand gestures.
Vision Based Hand Gesture Recognition Using 3D Shape Context
TLDR
A novel method to capture the shape information of 3D hand gestures using the Dynamic Time Warping algorithm is proposed and the experimental results verify that the proposed method outperforms the recent related methods.
Robust human computer interaction using dynamic hand gesture recognition
TLDR
An overview of hand gesture recognition research up to date is presented, which includes common stages of hand gestures recognition, common methods and technique of each stage, the state of the recent research and summaries of some successful hand gesture Recognition models.
HAGR-D: A Novel Approach for Gesture Recognition with Depth Maps
TLDR
A novel approach for hand gesture recognition with depth maps generated by the Microsoft Kinect Sensor is proposed using a variation of the CIPBR (convex invariant position based on RANSAC) algorithm and a hybrid classifier composed of dynamic time warping (DTW) and Hidden Markov models (HMM), called the hybrid approach for gesture recognitionWith depth maps (HAGR-D).
Finger Angle-Based Hand Gesture Recognition for Smart Infrastructure Using Wearable Wrist-Worn Camera
The arising of domestic robots in smart infrastructure has raised demands for intuitive and natural interaction between humans and robots. To address this problem, a wearable wrist-worn camera
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 61 REFERENCES
Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera
TLDR
A novel distance metric for hand dissimilarity measure, called Finger-Earth Mover's Distance (FEMD), which only matches fingers while not the whole hand shape, can better distinguish hand gestures of slight differences.
Robust hand gesture recognition with kinect sensor
TLDR
This work presents a hand gesture recognition system with Kinect sensor, which operates robustly in uncontrolled environments and is insensitive to hand variations and distortions, and applies a novel shape distance metric called Finger-Earth Mover's Distance (FEMD) forHand gesture recognition.
Vision-based hand pose estimation: A review
TLDR
A literature review on the second research direction, which aims to capture the real 3D motion of the hand, which is a very challenging problem in the context of HCI.
A REVIEW OF VISION BASED HAND GESTURES RECOGNITION
TLDR
The literature on visual interpretation of hand gestures in the context of its role in HCI and various seminal works of researchers are emphasized to introduce the field of gesture recognition as a mechanism for interaction with computers.
A fuzzy rule-based approach to spatio-temporal hand gesture recognition
  • M. Su
  • Computer Science
    IEEE Trans. Syst. Man Cybern. Part C
  • 2000
TLDR
A fuzzy rule based approach to spatio-temporal hand gesture recognition based on hyperrectangutar composite neural networks (HRCNNs) that can be implemented as a small-sized dynamic hand gestures recognition system.
A real-time hand gesture recognition method
TLDR
Experimental results showed that the proposed method gained detection rate up to 91% with real-time performance, and the recognition results were obtained by the nearest neighbor method.
Mining actionlet ensemble for action recognition with depth cameras
TLDR
An actionlet ensemble model is learnt to represent each action and to capture the intra-class variance, and novel features that are suitable for depth data are proposed.
A Multi-Gesture Interaction System Using a 3-D Iris Disk Model for Gaze Estimation and an Active Appearance Model for 3-D Hand Pointing
TLDR
This paper presents a vision-based human-computer interaction system, which integrates control components using multiple gestures, including eye gaze, head pose, hand pointing, and mouth motions, and proposes and integrates a two-camera hand pointing estimation algorithm for hand gesture tracking in 3-D from a distance.
Real-time human pose recognition in parts from single depth images
TLDR
This work takes an object recognition approach, designing an intermediate body parts representation that maps the difficult pose estimation problem into a simpler per-pixel classification problem, and generates confidence-scored 3D proposals of several body joints by reprojecting the classification result and finding local modes.
Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition
TLDR
Experimental results show that motion patterns of hand gestures can be extracted and recognized accurately using motion trajectories and applied to recognize 40 hand gestures of American Sign Language.
...
1
2
3
4
5
...