• Corpus ID: 772802

Lie Detection-Recovery of the Periorbital Signal through Tandem Tracking and Noise Suppression in Thermal Facial Video

  title={Lie Detection-Recovery of the Periorbital Signal through Tandem Tracking and Noise Suppression in Thermal Facial Video},
  author={Panagiotis Tsiamyrtzis and Jonathan Dowdall and Dvijesh J. Shastri and I. Pavlidis and Mark G. Frank and Paul Ekman},
Previous work has demonstrated the correlation of periorbital perfusion and stress levels in human beings. It has also been suggested that periorbital perfusion can be quantified through processing of thermal video. The idea has been based on the fact that skin temperature is heavily modulated by superficial blood perfusion. Proof of this concept was established for two different types of stress inducing experiments: startle and mockcrime polygraph interrogations. However, the polygraph… 

Figures and Tables from this paper

Thermal Facial Analysis for Deception Detection
This paper uses thermal imaging to monitor the periorbital region's thermal variations and test whether it can offer a discriminative signature for detecting deception, and reports an 87% ability to predict the lie/truth responses based on a within-person methodology and fivefold cross validation.
A field test study of our non-invasive thermal image analyzer for deceptive detection
We have developed a non-invasive thermal image analyzer for deceptive detection (TAD2) where the far-infrared data around the periorbital and nostril areas are simultaneously analyzed. Measured
Detection of Deceit from Thermal Videos on Real Crime Database
The rate of increase in blood flow rate shows that deceit could be detected from the thermal signatures, and a novel experimental protocol is suggested where a real crime of stealing occurs.
Detecting Deception Using Thermal Imaging
Abstract — Thermal imaging is an efficient technology to detect the deception of the person (subject) during the enquiry or interview and it saves time. This method presents a low complexity with
Analysis of Breathing Air Flow Patterns in Thermal Imaging
  • Jin Fei, Ioannis T. Pavlidis
  • Computer Science, Physics
    2006 International Conference of the IEEE Engineering in Medicine and Biology Society
  • 2006
The method opens the way for desktop, unobtrusive monitoring of human respiration and may find widespread applications in clinical studies of chronic ailments and brings up the intriguing possibility of using breathing patterns as a novel biometric.
Harvesting the Thermal Cardiac Pulse Signal
The paper reports experiments on 34 subjects, where it compares the performance of the new pulse measurement method to the one reported previously, and reveals that the new imaging methodology is more accurate and robust than the previous one.
Counting Heartbeats at a Distance
  • Nanfei Sun, Ioannis T. Pavlidis
  • Computer Science, Engineering
    2006 International Conference of the IEEE Engineering in Medicine and Biology Society
  • 2006
A new pulse measurement methodology based on thermal imaging (contact-free) that capitalizes both on the thermal undulation produced by the traveling pulse as well as the periodic expansion of the compliant vessel wall is proposed.
Deception detection using a multimodal approach
This work addresses the automatic identification of deceit by using a multimodal approach and focuses on three modalities namely, language use, physiological response, and thermal sensing, which is the first work to integrate these specific modalities to detect deceit.
Characterization and recognition of mixed emotional expressions in thermal face image
Investigation of facial skin temperature distribution on mixed thermal facial expressions of a created face database shows that facial features in mixed facial expressions can be characterized by positive emotion induced facial features and negative emotion inducing facial features.
Multimodal deception detection
This chapter will overview the state-of-the-art in multimodal deception detection, covering physiological, visual, speech, and linguistic modalities, and methods that make use of lab recordings, as well as methods that rely on reallife data.


Thermal image analysis for polygraph testing.
  • I. Pavlidis, J. Levine
  • Psychology, Medicine
    IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society
  • 2002
The results come to support the previous laboratory findings about the importance of periorbital blood flow in anxious states and can serve as an additional channel for increasing the reliability and accuracy of traditional polygraph examination.
Tracking human faces in infrared video
A method for modeling thermal emission from human skin that can be used for the purpose of segmenting and detecting faces and other exposed skin regions in IR imagery is presented and the segmentation model is applied to the CONDENSATION algorithm for tracking the head regions over time.
Thermal imaging for anxiety detection
  • I. Pavlidis, J. Levine, P. Baukol
  • Psychology
    Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (Cat. No.PR00640)
  • 2000
We propose a revolutionary concept for detecting suspects engaged in illegal and potentially harmful activities in or around critical military or civilian installations. We investigate the use of
Facial flushing and sweating mediated by the sympathetic nervous system.
The cervical sympathetic outflow is the main pathway for thermoregulatory flushing and emotional blushing and that diminution or absence of such vasodilator reactions is a usual component of Horner's syndrome unless the responsible lesion is confined to the first thoracic root.
Human behaviour: Seeing through the face of deception
A high-definition thermal-imaging technique that can detect attempted deceit by recording the thermal patterns from people's faces has potential for application in remote and rapid security screening, without the need for skilled staff or physical contact.
Eye-movement-based memory effect: a reprocessing effect in face perception.
  • R. Althoff, N. Cohen
  • Psychology, Medicine
    Journal of experimental psychology. Learning, memory, and cognition
  • 1999
The authors argue that the eye-movement-based memory effect is an obligatory consequence of previous exposure--a reprocessing effect caused by re-engaging the visual pattern analyzers and face processing machinery of the brain.
Eye Movement-Based Memory Assessment
We introduce here a new indirect (implicit) measure of memory based on eye movement monitoring. Eye movement data collected while participants were viewing images of faces showed that viewers process
CONDENSATION—Conditional Density Propagation for Visual Tracking
  • M. Isard, A. Blake
  • Mathematics, Computer Science
    International Journal of Computer Vision
  • 2004
The Condensation algorithm uses “factored sampling”, previously applied to the interpretation of static images, in which the probability distribution of possible interpretations is represented by a randomly generated set.
Implicit memory: History and current status.
Memory for a recent event can be expressed explicitly, as conscious recollection, or implicitly, as a facilitation of test performance without conscious recollection. A growing number of recent
An algorithm for the machine calculation of complex Fourier series
An efficient method for the calculation of the interactions of a 2' factorial ex- periment was introduced by Yates and is widely known by his name. The generaliza- tion to 3' was given by Box et al.