Face2PPG: An Unsupervised Pipeline for Blood Volume Pulse Extraction From Faces

被引:19
作者
Casado, Constantino Alvarez [1 ]
Lopez, Miguel Bordallo [1 ,2 ]
机构
[1] Univ Oulu, Ctr Machine Vis & Signal Anal CMVS, Oulu 90570, Finland
[2] VTT Tech Res Ctr Finland Ltd, Oulu 90571, Finland
基金
芬兰科学院;
关键词
Remote Photoplethysmography; rPPG; Signal Processing; Pulse rate estimation; Biosignals; Face Analysis; REMOTE-PPG; PHOTOPLETHYSMOGRAPHY;
D O I
10.1109/JBHI.2023.3307942
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Photoplethysmography (PPG) signals have become a key technology in many fields, such as medicine, well-being, or sports. Our work proposes a set of pipelines to extract remote PPG signals (rPPG) from the face robustly, reliably, and configurably. We identify and evaluate the possible choices in the critical steps of unsupervised rPPG methodologies. We assess a state-of-the-art processing pipeline in six different datasets, incorporating important corrections in the methodology that ensure reproducible and fair comparisons. In addition, we extend the pipeline by proposing three novel ideas; 1) a new method to stabilize the detected face based on a rigid mesh normalization; 2) a new method to dynamically select the different regions in the face that provide the best raw signals, and 3) a new RGB to rPPG transformation method, called Orthogonal Matrix Image Transformation (OMIT) based on QR decomposition, that increases robustness against compression artifacts. We show that all three changes introduce noticeable improvements in retrieving rPPG signals from faces, obtaining state-of-the-art results compared with unsupervised, non-learning-based methodologies and, in some databases, very close to supervised, learning-based methods. We perform a comparative study to quantify the contribution of each proposed idea. In addition, we depict a series of observations that could help in future implementations.
引用
收藏
页码:5530 / 5541
页数:12
相关论文
共 71 条
  • [71] An evaluation of noise reduction algorithms for particle-based fluid simulations in multi-scale applications
    Zimon, M. J.
    Prosser, R.
    Emerson, D. R.
    Borg, M. K.
    Bray, D. J.
    Grinberg, L.
    Reese, J. M.
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 2016, 325 : 380 - 394