Corpus ID: 235458014

A Two-stage Multi-modal Affect Analysis Framework for Children with Autism Spectrum Disorder

  title={A Two-stage Multi-modal Affect Analysis Framework for Children with Autism Spectrum Disorder},
  author={Jicheng Li and A. Bhat and Roghayeh Barmaki},
Autism spectrum disorder (ASD) is a developmental disorder that influences communication and social behavior of a person in a way that those in the spectrum have difficulty in perceiving other people’s facial expressions, as well as presenting and communicating emotions and affect via their own faces and bodies. Some efforts have been made to predict and improve children with ASD’s affect states in play therapy, a common method to improve children’s social skills via play and games. However… Expand
1 Citations

Figures from this paper


Automated recognition of spontaneous facial expression in individuals with autism spectrum disorder: parsing response variability
Individuals with ASD differed from the TD group in their facial expressions of positive emotion in response to “funny videos,” and identification of subgroups based on response may help in parsing heterogeneity in ASD and enable targeting of treatment based on subtypes. Expand
EmoReact: a multimodal approach and dataset for recognizing emotional responses in children
A newly collected multimodal emotion dataset of children between the ages of four and fourteen years old is introduced and a detailed analysis of the most indicative behavioral cues for emotion recognition in children is presented. Expand
Video and Text-Based Affect Analysis of Children in Play Therapy
Fine-tuned off-the-shelf deep convolutional neural networks are used for the processing of the child’s face during sessions to automatically extract valence and arousal dimensions of affect, as well as basic emotional expressions. Expand
Creative Yoga Intervention Improves Motor and Imitation Skills of Children With Autism Spectrum Disorder.
Overall, creative interventions, such as yoga, are promising tools for enhancing the motor and imitation skills of children with ASD. Expand
Atypical Gaze Cueing Pattern in a Complex Environment in Individuals with ASD
Compared with TD individuals, the cueing effect failed to enhance when using eye gaze compared with arrow cues under complex conditions in individuals with ASD, which may reflect the atypical style of gaze-triggered attention when Individuals with ASD adapt to environmental complexity. Expand
Autism Spectrum Disorder
Using DSM-IV, patients could be diagnosed with four separate disorders: autistic disorder, Asperger’s disorder, childhood disintegrative disorder, or the catch-all diagnosis of pervasiveExpand
Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2016
The prevalence of ASD varied considerably across sites and was higher than previous estimates since 2014, highlighting the variability in the evaluation and detection of ASD across communities and between sociodemographic groups. Expand
The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression
The Cohn-Kanade (CK+) database is presented, with baseline results using Active Appearance Models (AAMs) and a linear support vector machine (SVM) classifier using a leave-one-out subject cross-validation for both AU and emotion detection for the posed data. Expand
Attentive Modality Hopping Mechanism for Speech Emotion Recognition
This work explores the impact of visual modality in addition to speech and text for improving the accuracy of the emotion detection system and introduces an attention mechanism to combine the information. Expand
Emotion Recognition from Speech
This work considers emotion recognition from speech in the wider sense of application in Companion-systems, where acted and naturalistic spoken data has to be available in operational form (corpora) for the development of emotion classification. Expand