The ASC-Inclusion Perceptual Serious Gaming Platform for Autistic Children

@article{Marchi2019TheAP,
  title={The ASC-Inclusion Perceptual Serious Gaming Platform for Autistic Children},
  author={Erik Marchi and Tadas Baltru{\vs}aitis and Andra Adams and Marwa M. Mahmoud and Ofer Golan and Shimrit Fridenson-Hayo and Shahar Tal and Shai Newman and Noga Meir-Goren and Antonio Camurri and Stefano Piana and Bj{\"o}rn Schuller and Sven B{\"o}lte and M. Tevfik Sezgin and Nese Alyuz and Agnieszka Rynkiewicz and Aur{\'e}lie Baranger and Alice Baird and Simon Baron-Cohen and Amandine Lassalle and Helen O'Reilly and Delia Pigat and Peter Robinson and Ian P. Davies},
  journal={IEEE Transactions on Games},
  year={2019},
  volume={11},
  pages={328-339}
}
‘‘Serious games” are becoming extremely relevant to individuals who have specific needs, such as children with an autism spectrum condition (ASC). Often, individuals with an ASC have difficulties in interpreting verbal and nonverbal communication cues during social interactions. The ASC-Inclusion EU-FP7 funded project aims to provide children who have an ASC with a platform to learn emotion expression and recognition, through play in the virtual world. In particular, the ASC-Inclusion platform… 

Figures and Tables from this paper

iPad Serious Game to Aid Children with Special Needs in Emotion Learning
An iPad serious game in emotion learning is presented in this chapter for children with special needs, such as autism spectrum disorder. Some of the children with special needs suffer in recognizing
Interactive sonification to assist children with autism during motor therapeutic interventions
TLDR
This research conducts two deployment studies in Mexico using Go-with-the-Flow, a framework to sonify movements previously developed for chronic pain rehabilitation, and proposes design considerations that could guide the design of projects related to interactive sonification.
“Can you help me move this over there?”: training children with ASD to joint action through tangible interaction and virtual agent
TLDR
This paper presents the design of a tangible and virtual interactive system for the training of children with Autism Spectrum Disorder in performing joint actions and reports and discusses preliminary results of a field training study, which shows the potential of the interactive system.
Evaluating the Impact of Voice Activity Detection on Speech Emotion Recognition for Autistic Children
TLDR
The presented VAD system is a recurrent neural network with long short-term memory cells trained on 130 acoustic Low-Level Descriptors extracted from more than 17 h of audio recordings, which were richly annotated by experts in terms of perceived emotion as well as occurrence and type of vocalisations.
Conversational technology and affective computing for cognitive disability
This research investigates artificial Speech Emotion Recognition both from the semantics and from the pitch of the voice and aims at exploring its application in Conversational Technology to support
Emotional expression in psychiatric conditions: New technology for clinicians
TLDR
The aim of this paper is to review the currently used tools using modern technology and discuss their usefulness as well as possible future directions in emotional expression research and treatment strategies.
Fixed points in a changing world
The importance of emotional expression as part of human communication has been understood since the seventeenth century, and has been explored scientifically since Charles Darwin and others in the
A Three-Dimensional Animation Character Dance Movement Model Based on the Edge Distance Random Matrix
  • Yan Jin
  • Computer Science
    Mathematical Problems in Engineering
  • 2022
TLDR
The experimental results show that the edge distance random matrix method can replace the traditional motion capture method to a certain extent, simplify the use of motion capture, and reduce the cost of motion Capture.
A Three-Dimensional Animation Character Dance Movement Model Based on the Edge Distance Random Matrix
TLDR
The experimental results show that the edge distance random matrix method can replace the traditional motion capture method to a certain extent, simplify the use of motion capture, and reduce the cost of motion Capture.
...
...

References

SHOWING 1-10 OF 75 REFERENCES
ASC-Inclusion: Interactive Emotion Games for Social Inclusion of Children with Autism Spectrum Conditions
TLDR
The ASC-Inclusion project aims to create and evaluate the effectiveness of an internet-based game platform, directed for children with ASC and those interested in their inclusion, that combines several state-of-the art technologies in one comprehensive virtual world.
Recent developments and results of ASC-Inclusion: An Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions
TLDR
The ASC-Inclusion project helps children with ASC by allowing them to learn how emotions can be expressed and recognised via playing games in a virtual world through facial expressions, tone of voice and body gestures.
The state of play of ASC-Inclusion: An Integrated Internet-Based Environment for Social Inclusion of Children with Autism Spectrum Conditions
TLDR
The state of play in realising such a serious game platform is presented, the results for the different modalities are provided and the platform includes analysis of users' gestures, facial, and vocal expressions.
Voice Emotion Games: Language and Emotion in the Voice of Children with Autism Spectrum Conditio
TLDR
A database of prompted phrases was collected in English, Swedish, and Hebrew, inducing nine emotions embedded in short-stories, and the emotion task over the nine categories is evaluated, by investigating the discrimination of each emotion against the remaining ones.
‘Emotiplay’: a serious game for learning about emotions in children with autism: results of a cross-cultural evaluation
TLDR
Emotiplay’s SG is an effective and motivating psycho-educational intervention, cross-culturally teaching ER from faces, voices, body language, and their integration in context to children with high functioning ASC in an entertaining, and intrinsically motivating way.
Emotion in the speech of children with autism spectrum conditions: prosody and everything else
TLDR
A database of prompted phrases was collected in Hebrew, inducing nine emotions embedded in short-stories, which contains speech of children with ASC and typically developing children under the same conditions and investigates the discrimination of each emotion against neutral.
Automatic face analysis tools for interactive digital games
  • Computer Science
  • 2015
TLDR
A set of interactive interfaces that can assist in teaching people with social communication difficulties about facial expressions and face touches and their potential use as integral components in serious games that focus on social inclusion are presented.
Chapter 8 Voice-enabled assistive robots for handling autism spectrum conditions : an examination of the role of prosody
Autism spectrum conditions (ASC) are neurodevelopmental conditions, characterized by impairments in social interaction, communication (i.e., verbal and non-verbal language), and by restricted
Basic and complex emotion recognition in children with autism: cross-cultural findings
TLDR
The findings highlight the multimodal nature of ER deficits in ASC, which exist for basic as well as complex emotions and are relatively stable cross-culturally.
The ‘Reading the Mind in Films’ Task [Child Version]: Complex Emotion and Mental State Recognition in Children with and without Autism Spectrum Conditions
TLDR
The findings reveal that children with ASC have residual difficulties in this aspect of empathy, and the use of language-based compensatory strategies for emotion recognition is discussed.
...
...