Revealing Psychophysiology and Emotions through Thermal Infrared Imaging

  title={Revealing Psychophysiology and Emotions through Thermal Infrared Imaging},
  author={Arcangelo Merla},
  • A. Merla
  • Published in PhyCS 8 December 2016
  • Psychology
Thermal infrared imaging has been proposed as a tool for the non-invasive and contact-less evaluation of vital signs, psychophysiological responses and states. Several applications have been so far developed in many diversified fields, like social and developmental psychology, psychometrics, human-computer interaction, continuous monitoring of vital signs, stress and, even, deception detection. Thermal infrared imaging has been poorly exploited in the field of human-robot interaction. Therefore… 

Figures from this paper

The thermal dimension of psychophysiological and emotional responses revealed by thermal infrared imaging
  • D. Cardone, A. Merla
  • Psychology
    2014 IEEE International Conference on Image Processing (ICIP)
  • 2014
The state of the art of thermal infrared imaging in psychophysiology and in the assessment of emotional states is discussed to provide insights about its potentialities and limits, with special emphasis to the still open issues for image processing and real-time data analysis.
Thermal expression of intersubjectivity offers new possibilities to human–machine and technologically mediated interactions
The state of the art of thermal IR imaging in psychophysiology and in the assessment of affective states is presented to provide insights about its potentialities and limits for its use in human–artificial agent interaction in order to contribute to a major issue in the field: the perception by an artificial agent of human psychophysiological and affectiveStates.
Thermal infrared imaging reveals that 6-12 month-old babies show different autonomic response to interaction with robot and avatar
Understanding infants’ psychophysiological/emotional responses to AIAs provides important new knowledge regarding how AIAs impact infants' during the first year of life, which is a period of critical importance for human learning, especially emotional, social, and language learning and higher.
Classification of emotional states via transdermal cardiovascular spatiotemporal facial patterns using multispectral face videos
We describe a new method for remote emotional state assessment using multispectral face videos, and present our findings: unique transdermal, cardiovascular and spatiotemporal facial patterns
Behavioral and facial thermal variations in 3-to 4-month-old infants during the Still-Face Paradigm
Thermal data were consistent with behavioral data in showing this effect as related to the infants’ expectations of the nature of the social interactions being violated, and indicate the thermal IR imaging as a reliable technique for the detection of physiological variations not only in the emotional system, as indicated by research to date, but also in the attention system.
The Use of AI for Thermal Emotion Recognition: A Review of Problems and Limitations in Standard Design and Data
Presented at AAAI FSS-20: Artificial Intelligence in Government and Public Sector, Washington, DC, USA
Framework for Stress Detection Using Thermal Signature
This work presents a framework to detect stress based on heart rate variability (HRV) and proposed methods were proposed for extracting thermal signatures such as cardiac pulse, breath rate, sudomotor response, and stress response from various regions.


StressCam: non-contact measurement of users' emotional states through thermal imaging
It is found that user stress is correlated with increased blood flow in the frontal vessel of the forehead, which dissipates convective heat, which can be monitored through thermal imaging.
Thermal Signatures of Emotional Arousal: A Functional Infrared Imaging Study
  • A. Merla, G. Romani
  • Psychology
    2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
  • 2007
The results of this study indicate functional infrared imaging as an alternative, touch less, non invasive method for assessing individual's emotional arousal in psychophysiology.
The Autonomic Signature of Guilt in Children: A Thermal Infrared Imaging Study
The results suggest that the integration of physiological elements should be crucial in research concerning socio-emotional development and fIRI is a powerful tool for inferring early moral emotional signs based on physiological observations of peripheral vasoconstriction, while preserving an ecological and natural context.
Computationa physiology in a thermal image setting
This research aims to realize the notion of sustained health monitoring for ubiquitous ailments and emotional states by incorporating non-contact and non-invasive physiological monitoring of the human autonomic nervous activity.
Classifying Affective States Using Thermal Infrared Imaging of the Human Face
  • B. Nhan, T. Chau
  • Psychology
    IEEE Transactions on Biomedical Engineering
  • 2010
The results of this study suggest that classification of facial thermal infrared imaging data coupled with affect models can be used to provide information about an individual's affective state for potential use as a passive communication pathway.
Imaging Facial Signs of Neurophysiological Responses
An integrated framework for detecting peripheral sympathetic responses through purely imaging means is introduced and the first time that the maxillary area is analyzed, which opens a new research area that leads to unobtrusive screening technologies in neurophysiology and psychophysiology.
Imaging Facial Physiology for the Detection of Deceit
A new methodology to compute the mean periorbital temperature signal is proposed and is capable of coping with the challenges posed by the realistic setting and opens the way for automating lie detection in realistic settings.
A novel method for extracting respiration rate and relative tidal volume from infrared thermography.
Empirical data is provided demonstrating that a noncontact technology, infrared video thermography, can accurately estimate breathing rate and relative tidal volume across a range of breathing patterns.
Pathophysiological expression and analysis of far infrared thermal images
Clinical far infrared (FIR) imaging is a measurement technique applied to images of temperature distribution on the skin surface. It is a noninvasive analysis tool for physiological functions related