Heart rate estimation using facial video: A review

被引:126
作者
Hassan, M. A. [1 ,2 ]
Malik, A. S. [1 ]
Fofi, D. [2 ]
Saad, N. [1 ]
Karasfi, B. [1 ]
Ali, Y. S. [3 ]
Meriaudeau, F. [1 ]
机构
[1] Univ Teknol PETRONAS, CISIR, Dept Elect & Elect Engn, Bandar Seri Iskandar 32610, Perak, Malaysia
[2] Univ Bourgogne Franche Comte, Arts & Metiers, CNRS, Le2i,UMR 6306, 12 Rue Fonderie, F-71200 Le Creusot, France
[3] Umm Al Qura Univ, Sci & Technol Unit, Mecca 21955, Saudi Arabia
关键词
Heart rate measurement; Photoplethysmography; Ballistocardiography; Non-contact; Facial imaging; NONCONTACT; PPG;
D O I
10.1016/j.bspc.2017.07.004
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Photoplethysmography and Ballistocardiography are two concepts that are used to measure heart rate from human, by using facial videos. Heart rate estimation is essential to determine the physiological and pathological state of a person. This paper presents a critical review of digital camera based heart rate estimating method on facial skin. This review extends the investigation on to the principles and theory behind photoplethysmography and ballistocardiography. The article contains reviews on the significance of the methods and contributions to overcome challenges such as; poor signal strength, illumination variance, and motion variance. The experiments were conducted to validate the state of the art methods on a challenging database that is available publicly. The implemented methods were validated using the database, on 27 subjects for a range of skin tones from pearl white, fair, olive to black. The results were computed using statistical methods such as: mean error, standard deviation, the root mean square error, Pearson correlation coefficient, and Bland-Altman analysis. The results derived from the experiments showed the reliability of the state of the art methods and provided direction to improve for situations involving illumination variance and motion variance. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:346 / 360
页数:15
相关论文
共 48 条
[1]   Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit - A pilot study [J].
Aarts, Lonneke A. M. ;
Jeanne, Vincent ;
Cleary, John P. ;
Lieber, C. ;
Nelson, J. Stuart ;
Oetomo, Sidarto Bambang ;
Verkruysse, Wim .
EARLY HUMAN DEVELOPMENT, 2013, 89 (12) :943-948
[2]  
[Anonymous], 1991, CMUCS91132
[3]   Detecting Pulse from Head Motions in Video [J].
Balakrishnan, Guha ;
Durand, Fredo ;
Guttag, John .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3430-3437
[4]   Heart Rate Turbulence: Standards of Measurement, Physiological Interpretation, and Clinical Use International Society for Holter and Noninvasive Electrophysiology Consensus [J].
Bauer, Axel ;
Malik, Marek ;
Schmidt, Georg ;
Barthel, Petra ;
Bonnemeier, Hendrik ;
Cygankiewicz, Iwona ;
Guzik, Przemyslaw ;
Lombardi, Federico ;
Mueller, Alexander ;
Oto, Ali ;
Schneider, Raphael ;
Watanabe, Mari ;
Wichterle, Dan ;
Zareba, Wojciech .
JOURNAL OF THE AMERICAN COLLEGE OF CARDIOLOGY, 2008, 52 (17) :1353-1365
[5]   Continuous wavelet filtering on webcam photoplethysmographic signals to remotely assess the instantaneous heart rate [J].
Bousefsaf, Frederic ;
Maaoui, Choubeila ;
Pruski, Alain .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2013, 8 (06) :568-574
[6]  
Christinaki E, 2014, 2014 EAI 4TH INTERNATIONAL CONFERENCE ON WIRELESS MOBILE COMMUNICATION AND HEALTHCARE (MOBIHEALTH), P339, DOI 10.1109/MOBIHEALTH.2014.7015980
[7]   INDEPENDENT COMPONENT ANALYSIS, A NEW CONCEPT [J].
COMON, P .
SIGNAL PROCESSING, 1994, 36 (03) :287-314
[8]   Improved motion robustness of remote-PPG by using the blood volume pulse signature [J].
de Haan, G. ;
van Leest, A. .
PHYSIOLOGICAL MEASUREMENT, 2014, 35 (09) :1913-1926
[9]   Robust Pulse Rate From Chrominance-Based rPPG [J].
de Haan, Gerard ;
Jeanne, Vincent .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2013, 60 (10) :2878-2886
[10]  
Ercoli I., 2012, P IEEE INT S MED MEA, P1, DOI [10.1109/MeMeA.2012.6226654, DOI 10.1109/MEMEA.2012.6226654]