A framework for continuous multimodal sign language recognition

  title={A framework for continuous multimodal sign language recognition},
  author={Daniel Kelly and Jane Reilly Delannoy and John McDonald and Charles Markham},
We present a multimodal system for the recognition of manual signs and non-manual signals within continuous sign language sentences. In sign language, information is mainly conveyed through hand gestures (Manual Signs). Non-manual signals, such as facial expressions, head movements, body postures and torso movements, are used to express a large part of the grammar and some aspects of the syntax of sign language. In this paper we propose a multichannel HMM based system to recognize manual signs… CONTINUE READING