Sign Language Recognition using Sequential Pattern Trees

@article{Ong2012SignLR,
  title={Sign Language Recognition using Sequential Pattern Trees},
  author={Eng-Jon Ong and H. Cooper and N. Pugeault and R. Bowden},
  journal={2012 IEEE Conference on Computer Vision and Pattern Recognition},
  year={2012},
  pages={2200-2207}
}
This paper presents a novel, discriminative, multi-class classifier based on Sequential Pattern Trees. [...] Key Method Using deterministic robust features based on hand trajectories, sign level classifiers are built from sub-units. Results are presented both on a large lexicon single signer data set and a multi-signer Kinect™ data set. In both cases it is shown to out perform the non-discriminative Markov model approach and be equivalent to previous, more costly, Sequential Pattern (SP) techniques.Expand
Sign Language Recognition Using Temporal Classification
TLDR
This work utilizes a dataset collected by a group at the University of South Wales, which contains parameters, such as hand position, hand rotation, and finger bend, for 95 unique signs, to predict which sign class this stream falls into. Expand
Sign language recognition based on adaptive HMMS with data augmentation
TLDR
This paper proposes an adaptive GMM-based (Gaussian mixture model) HMMs (Hidden Markov Models) framework and discovers that inherent latent states in HMMs are not onlyrelated to the number of key gestures and body poses, but also related to the kinds of their translation relationships. Expand
Semantics constrained dictionary learning for signer-independent sign language recognition
TLDR
A sparse coding based framework is proposed for sign language recognition (SLR) and is more effective for the signer-independent recognition problem than other baseline methods and performs well for thesigner-dependent case. Expand
Towards Multilingual Sign Language Recognition
TLDR
This paper develops a multilingual sign language approach, where hand movement modeling is also done with target sign language independent data by derivation of hand movement subunits, and demonstrates that sign language recognition systems can be effectively developed by using mult bilingual sign language resources. Expand
Modality Combination Techniques for Continuous Sign Language Recognition
TLDR
Early combination of features, late fusion of decisions, as well as synchronous combination on the hidden Markov model state level, and asynchronous combination onThe gloss level are investigated for five modalities on two publicly available benchmark databases consisting of challenging real-life data and less complex lab-data. Expand
An HMM Approach with Inherent Model Selection for Sign Language and Gesture Recognition
TLDR
This work presents a continuous HMM framework for modeling and recognizing isolated signs, which inherently performs model selection to optimize the number of states for each sign separately during recognition, and yields systems that perform competitive to the case where theNumber of states are determined based on the test set performance. Expand
Dynamic-static unsupervised sequentiality, statistical subunits and lexicon for sign language recognition
We introduce a new computational phonetic modeling framework for sign language (SL) recognition. This is based on dynamic-static statistical subunits and provides sequentiality in an unsupervisedExpand
Improving Continuous Sign Language Recognition: Speech Recognition Techniques and System Design
TLDR
This work presents a large-vocabulary ASLR system that is able to recognize sentences in continuous sign language and uses features extracted from standard single-view video cameras without using additional equipment. Expand
A DTW-Based Representation to Support Static Sign Language Recognition from Binary Images
TLDR
This work introduced a dynamic time warping (DTW) based representation approach to reveal consistent static SLR patterns from binary images, and is the first attempt to apply dissimilarity-based representations for codifying binary images in SSLR. Expand
Sign language interpretation using linear discriminant analysis and local binary patterns
  • M. Jasim, M. Hasanuzzaman
  • Computer Science
  • 2014 International Conference on Informatics, Electronics & Vision (ICIEV)
  • 2014
TLDR
A Haar-like feature-based cascaded classifier is used for hand area detection and hand gestures portraying sign language are recognized using Linear Discriminant Analysis and Local Binary Pattern based feature extractors separately. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 18 REFERENCES
Reading the signs: A video based sign dictionary
TLDR
A dictionary for Sign Language using visual sign recognition based on linguistic sub-components based on linguistics to provide sign sub-unit features and classifiers based on motion, sign-location and handshape is presented. Expand
Learning Sequential Patterns for Lipreading
TLDR
A novel machine learning algorithm (SP-Boosting) to tackle the problem of lipreading by building visual sequence classifiers based on visual sequence patterns, which achieves state of the art recognition performane, using only a small set of sequential patterns. Expand
Minimal Training, Large Lexicon, Unconstrained Sign Language Recognition
TLDR
A flexible monocular system capable of recognising sign lexicons far greater in number than previous approaches and generating extremely high recognition rates for large lexicons with as little as a single training instance per sign is presented. Expand
A System for Large Vocabulary Sign Search
A method is presented to help users look up the meaning of an unknown sign from American Sign Language (ASL). The user submits a video of the unknown sign as a query, and the system retrieves theExpand
Search-By-Example in Multilingual Sign Language Databases
TLDR
A prototype Search-by-Example or look-up tool for signs, based on a newly developed 1000-concept sign lexicon for four national sign languages, which includes a spoken language gloss, a HamNoSys description, and a video for each sign. Expand
Advances in phonetics-based sub-unit modeling for transcription alignment and sign language recognition
TLDR
A new symbolic processing approach for converting sign language annotations into structured sequences of labels according to the Posture-Detention-Transition-Steady Shift phonetic model results in improved performance compared to pure data-driven approaches, but also in meaningful phonetic sub-unit models that can be further exploited in interdisciplinary sign language analysis. Expand
Hand Tracking and Affine Shape-Appearance Handshape Sub-units in Continuous Sign Language Recognition
TLDR
The experiments indicate the effectiveness of the overall approach and especially for the modeling of handshapes when incorporated in the HSU-based framework showing promising results. Expand
Multi-class AdaBoost learning of facial feature selection through Grid Computing
  • M. Zhou, Hong Wei, +5 authors Feng Liu
  • Computer Science
  • 2010 IEEE 9th International Conference on Cyberntic Intelligent Systems
  • 2010
TLDR
The improved multi-class AdaBoost learning algorithm with parallel structure is improved, so that the task of High Performance Computing is accomplished in the environment of High Throughput Computing. Expand
Multi-class AdaBoost ∗
TLDR
A new algorithm is proposed that naturally extends the original AdaBoost algorithm to the multiclass case without reducing it to multiple two-class problems and is extremely easy to implement and is highly competitive with the best currently available multi-class classification methods. Expand
The Linguistics of British Sign Language: An Introduction
Conventions used in the text 1. Linguistics and sign linguistics 2. BSL in its social context 3. Constructing sign sentences 4. Questions and negation 5. Mouth patterns and non-manual features in BSLExpand
...
1
2
...