Gesture recognition for humanoid assisted interactive sign language tutoring

Abstract

This work is part of an ongoing work for sign language tutoring with imitation based turn-taking and interaction games (iSign) with humanoid robots and children with communication impairments. The paper focuses on the extension of the game, mainly for children with autism. Autism Spektrum Disorder (ASD) involves communication impairments, limited social interaction, and limited imagination. Many such children show interest in robots and find them engaging. Robots can facilitate social interaction between the child and teacher. In this work, a Nao H25 Humanoid robot assisted the human teacher to teach some signs and basic upper torso actions which were observed and imitated by the participants. Kinect camera based system was used to recognize the signs and other actions, and the robot gave visual and audial feedback to the participants based on the performance.

DOI: 10.1109/SIU.2013.6531542

Cite this paper

@article{Ertugrul2013GestureRF, title={Gesture recognition for humanoid assisted interactive sign language tutoring}, author={Bekir Sitki Ertugrul and Cemal Gurpinar and Hasan Kivrak and Hatice Kose-Bagci}, journal={2013 21st Signal Processing and Communications Applications Conference (SIU)}, year={2013}, pages={1-4} }