• Corpus ID: 231573560

Remote Pulse Estimation in the Presence of Face Masks

@article{Speth2021RemotePE,
  title={Remote Pulse Estimation in the Presence of Face Masks},
  author={Jeremy Speth and Nathan Vance and Patrick J. Flynn and K. Bowyer and Adam Czajka},
  journal={ArXiv},
  year={2021},
  volume={abs/2101.04096}
}
Remote photoplethysmography (rPPG), a family of techniques for monitoring blood volume changes, may be especially useful for widespread contactless health monitoring using face video from consumer-grade visible-light cameras. The COVID-19 pandemic has caused the widespread use of protective face masks. We found that occlusions from cloth face masks increased the mean absolute error of heart rate estimation by more than 80\% when deploying methods designed on unmasked faces. We show that… 
View PDF on arXiv
View With Semantic Reader
3 Citations

Figures and Tables from this paper

3 Citations

Performance Evaluation of rPPG Approaches with and without the Region-of-Interest Localization Step
TLDR
Evaluating the performance of selected approaches with and without ROI localization step in rPPG signal extraction indicates that the selection of theROI localization approach does not significantly affect rP PG measurements if combined with a robust algorithm for rPPC signal extraction.
NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial Temporal Representation
TLDR
The deep learning approach presented, called NrPPG-NNET, was developed by applying the knowledge of a previously trained Convolutional Neural Network to the task of predicting HR from video footage alone and achieves competitive results but does not reach the state of the art.
Evaluating the robustness of a contact-less mHealth solution for personal and remote monitoring of blood oxygen saturation
TLDR
Experimental results show that the SpO2 values obtained by the contact-less mHealth solution are not only reliable, since they are comparable with those obtained with a pulse oximeter, but are also insensitive to head motion, thus allowing a natural interaction with the mobile acquisition device.

References

SHOWING 1-10 OF 32 REFERENCES
Remote Photoplethysmography Correspondence Feature for 3D Mask Face Presentation Attack Detection
TLDR
A new liveness feature, called rPPG correspondence feature (CFrPPG) is proposed to precisely identify the heartbeat vestige from the observed noisy rP PG signals to overcome the global interferences.
Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networks
TLDR
This work proposes an rPPG measurement method, which is the first work to use deep spatio-temporal networks for reconstructing precise rP PG signals from raw facial videos, and can achieve superior performance on both HR and HRV levels comparing to the state-of-the-art methods.
Deep learning with time-frequency representation for pulse estimation from facial videos
TLDR
This work has endeavored to develop a novel deep learning approach as the core part for pulse (heart rate) estimation by using a common RGB camera, and developed a pulse database, called the Pulse from Face, and used it to train the CNN.
Self-Adaptive Matrix Completion for Heart Rate Estimation from Face Videos under Realistic Conditions
TLDR
This work introduces a strategy to dynamically select face regions useful for robust HR estimation, inspired by recent advances on matrix completion theory, which significantly outperforms state-of-the-art HR estimation methods in naturalistic conditions.
VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video
TLDR
A large-scale multi-modal HR database, which contains 2,378 visible light videos (VIS) and 752 near-infrared videos of 107 subjects, and a deep HR estimator with the proposed spatial-temporal representation, which achieves promising results on both the public-domain and the VIPL-HR HR estimation databases are introduced.
Improved motion robustness of remote-PPG by using the blood volume pulse signature
TLDR
It is shown that the different absorption spectra of arterial blood and bloodless skin cause the variations to occur along a very specific vector in a normalized RGB-space, which can be determined for a given light spectrum and for given transfer characteristics of the optical filters in the camera.
A Novel Algorithm for Remote Photoplethysmography: Spatial Subspace Rotation
TLDR
The experimental results show that given a well-defined skin mask, 2SR outperforms the popular ICA-based approach and two state-of-the-art algorithms (CHROM and PBV) and confirms the significant improvement of 2SR in peak-to-peak accuracy.
Remote Photoplethysmography: Rarely Considered Factors
TLDR
Short series of experiments were conducted to estimate importance of rolling shutter effect and size of temporal windows, which could significantly influence the estimated error of vital sign evaluation when comparing rPPG methods.
Learning-based heart rate detection from remote photoplethysmography features
TLDR
This paper proposes a learning-based framework to accommodate multiple and temporal feature and yields significant and robust improvement in signal strength of color variations caused by heart beat by using support vector regression on published chrominance-based feature.
RhythmNet: End-to-End Heart Rate Estimation From Face via Spatial-Temporal Representation
TLDR
This paper proposes an end-to-end RhythmNet for remote HR estimation from the face using RyhthmNet, a spatial-temporal representation encoding the HR signals from multiple ROI volumes as its input and feeds into a convolutional network for HR estimation.
...
...