Learning deep physiological models of affect

@article{Martnez2013LearningDP,
  title={Learning deep physiological models of affect},
  author={H{\'e}ctor Perez Mart{\'i}nez and Yoshua Bengio and Georgios N. Yannakakis},
  journal={IEEE Computational Intelligence Magazine},
  year={2013},
  volume={8},
  pages={20-33}
}
More than 15 years after the early studies in Affective Computing (AC), [1] the problem of detecting and modeling emotions in the context of human-computer interaction (HCI) remains complex and largely unexplored. The detection and modeling of emotion is, primarily, the study and use of artificial intelligence (AI) techniques for the construction of computational models of emotion. The key challenges one faces when attempting to model emotion [2] are inherent in the vague definitions and fuzzy… 
Multi-Task Ensemble Learning for Affect Recognition
TLDR
This work addresses method quality (affect recognition accuracy) and method generality (the ability to work on diverse datasets) and is proposing a robust preprocessing method that removes the hardware and person-specific issues.
A Review, Current Challenges, and Future Possibilities on Emotion Recognition Using Machine Learning and Physiological Signals
TLDR
An introduction to the field of affective computing is presented though the description of key theoretical concepts, and the current state-of-the-art of emotion recognition is described, tracing the developments that helped foster the growth of the field.
Deep Learning for Classification of Peak Emotions within Virtual Reality Systems
TLDR
The proposed deep learning fusion system in this paper will use data collected from a corpus, created through collection of physiological biosignals and ranked qualitative data, and will classify these multimodal signals into target outputs of affect.
Deep Ensembles for Inter-Domain Arousal Recognition
TLDR
This is the first study that analyzes six publicly available datasets for arousal recognition from physiological signals and proposes a method capable of combining them, and shows that the novel DNN ensemble method outperforms the classical ML methods and the non-ensemble DNN methods.
A Survey of Incorporating Affective Computing for Human-System Co-adaptation
TLDR
A broad survey of the varieties of modalities used for incorporating affective computing in software systems and critically analyzed the different approaches in this field in order to detect, analyze, and respond to users' inputs efficiently is conducted.
Exploring Physiological Multimodality for Emotional Assessment
Many emotion recognition schemes have been proposed in the state-of-the-art. They generally differ in terms of the emotion elicitation methods, target emotional states to recognize, data sources or
The Ordinal Nature of Emotions: An Emerging Approach
TLDR
The thesis that emotions are by nature ordinal is supported by both theoretical arguments and evidence, and opens new horizons for the way emotions are viewed, represented and analyzed computationally.
Deep Physiological Affect Network for the Recognition of Human Emotions
  • B. H. Kim, Sungho Jo
  • Psychology, Computer Science
    IEEE Transactions on Affective Computing
  • 2020
TLDR
A robust physiological model for the recognition of human emotions, based on a convolutional long short-term memory network and a new temporal margin-based loss function, which improves the performance of emotion recognition.
User Evaluation of Affective Dynamic Difficulty Adjustment Based on Physiological Deep Learning
TLDR
Results show that the model using the ABS adaptation was capable of effectively adjusting the overall difficulty based on a player’s physiological state during a game of Tetris.
Biosignal-Based Multimodal Emotion Recognition in a Valence-Arousal Affective Framework Applied to Immersive Video Visualization
  • Joana Pinto, A. Fred, H. Silva
  • Computer Science, Medicine
    2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  • 2019
TLDR
Several biosignals are explored for emotion assessment during immersive video visualization, collecting multimodal data from Electrocardiography, Electrodermal Activity, Blood Volume Pulse and Respiration sensors.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 83 REFERENCES
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
  • R. Calvo, S. D'Mello
  • Psychology, Computer Science
    IEEE Transactions on Affective Computing
  • 2010
TLDR
This survey explicitly explores the multidisciplinary foundation that underlies all AC applications by describing how AC researchers have incorporated psychological theories of emotion and how these theories affect research questions, methods, results, and their interpretations.
Toward Machine Emotional Intelligence: Analysis of Affective Physiological State
TLDR
It is found that the technique of seeding a Fisher Projection with the results of sequential floating forward search improves the performance of the Fisher Projections and provides the highest recognition rates reported to date for classification of affect from physiology: 81 percent recognition accuracy on eight classes of emotion, including neutral.
Real-time classification of evoked emotions using facial feature tracking and physiological responses
We present automated, real-time models built with machine learning algorithms which use videotapes of subjects' faces in conjunction with physiological measurements to predict rated emotion (trained
A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies
TLDR
A novel method for continuously modeling emotion using physiological data is presented, providing a method for quantifying emotional states continuously during a play experience.
Affective Pattern Classification
We develop a method for recognizing the emotional state of a person who is deliberately expressing one of eight emotions. Four physiological signals were measured and six features of each of these
Classification of EEG for Affect Recognition: An Adaptive Approach
TLDR
The results show that affect recognition from EEG signals might be possible and an adaptive algorithm improves the performance of the classification task.
Affective Body Expression Perception and Recognition: A Survey
TLDR
The aim of this survey is to review the literature on affective body expression perception and recognition and to raise open questions on data collecting, labeling, modeling, and setting benchmarks for comparing automatic recognition systems.
Multimodal Emotion Recognition in Response to Videos
TLDR
The results over a population of 24 participants demonstrate that user-independent emotion recognition can outperform individual self-reports for arousal assessments and do not underperform for valence assessments.
Bi-modal emotion recognition from expressive face and body gestures
TLDR
An approach to automatic visual recognition of expressive face and upper-body gestures from video sequences suitable for use in a vision-based affective multi-modal framework and fuse facial expression and affective body gesture information at the feature and at the decision level is presented.
Predicting Facial Indicators of Confusion with Hidden Markov Models
TLDR
A predictive model of learner confusion during task-oriented human-human tutorial dialogue that leverages textual dialogue, task, and facial expression history to predict upcoming confusion within a hidden Markov modeling framework is created.
...
1
2
3
4
5
...