Robust and Remote Photoplethysmography Based on Smartphone Imaging of the Human Palm

被引:2
作者
Lian, Chao [1 ,2 ]
Yang, Yiming [1 ,2 ]
Yu, Xiaodong [1 ,2 ]
Sun, Hui [3 ,4 ]
Zhao, Yuliang [1 ,2 ]
Zhang, Guanglie [3 ,4 ]
Li, Wen Jung [3 ,4 ]
机构
[1] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110819, Peoples R China
[2] Hebei Key Lab Micronano Precis Opt Sensing & Measu, Qinhuangdao 066004, Peoples R China
[3] City Univ Hong Kong, Shenzhen Res Inst City USRI, Shenzhen 518000, Peoples R China
[4] City Univ Hong Kong, Dept Mech Engn, CAS CityU Joint Lab Robot Res, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Heart rate; Cameras; Faces; Electrocardiography; Skin; Signal to noise ratio; Image color analysis; Heart rate (HR) measurement; noncontact; photoplethysmography; remote photoplethysmography (rPPG); video surveillance; NONCONTACT;
D O I
10.1109/TIM.2023.3264041
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Arrhythmia is a marked symptom of many cardiovascular diseases (CVDs). Fast and accurate measurement of heart rate (HR) can lead to prompt detection of arrhythmia, which could be potentially life-threatening. However, it remains a challenge to robustly and remotely measure HR due to the typically changing ambient conditions surrounding human subjects. In this study, we propose a method to accurately measure human HR by simply using a smartphone camera. We use three special approaches for HR estimation. First, we fuse the raw data by subtracting the $G$ channel from the $R$ channel to enhance the heartbeat signal from video data. Second, instead of the entire palm, we select a region of interest (ROI) from the palm for HR detection based on signal-to-noise ratio (SNR) maps, which reduces the proportion of the weak signal area. Third, after applying fast Fourier transform (FFT) analyses of the time-series data from the video, we set an interval threshold based on the HR range to accurately determine HR. With a reference HR value measured by electrocardiography (ECG), the detection rate of the proposed method is 95.84% (overall result from 30 test subjects) when used for measurement at an ambient light intensity of 150 lux within a distance of 4.5 m. The method's strong adaptability to changing ambient conditions and ease of implementation makes it applicable to many scenarios, such as homes of the elderly, classrooms, and other public spaces.
引用
收藏
页数:11
相关论文
共 30 条
[1]  
[Anonymous], Lighting
[2]  
Cardiovascular Diseases (CVDs), WHO WTO
[3]  
Cultur A., 2003, GEOGRAPHIE, V81, P19
[4]   Robust Pulse Rate From Chrominance-Based rPPG [J].
de Haan, Gerard ;
Jeanne, Vincent .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2013, 60 (10) :2878-2886
[5]   Optimizing Remote Photoplethysmography Using Adaptive Skin Segmentation for Real-Time Heart Rate Monitoring [J].
Fouad, R. M. ;
Omer, Osama A. ;
Aly, Moustafa H. .
IEEE ACCESS, 2019, 7 :76513-76528
[6]   Improvements in remote video based estimation of heart rate variability using the Welch FFT method [J].
Fukunishi M. ;
Mcduff D. ;
Tsumura N. .
Artificial Life and Robotics, 2018, 23 (01) :15-22
[7]   Timed synchronization of muscle contraction to heartbeat enhances muscle hyperemia [J].
Giuriato, Gaia ;
Ives, Stephen J. ;
Tarperi, Cantor ;
Bortolan, Lorenzo ;
Ruzzante, Federico ;
Pedrinolla, Anna ;
Martignon, Camilla ;
Laginestra, Fabio Giuseppe ;
Cevese, Antonio ;
Schena, Federico ;
Venturelli, Massimo .
JOURNAL OF APPLIED PHYSIOLOGY, 2020, 128 (04) :805-812
[8]  
Google, MEDIAPIPE HANDS
[9]   ETA-rPPGNet: Effective Time-Domain Attention Network for Remote Heart Rate Measurement [J].
Hu, Min ;
Qian, Fei ;
Guo, Dong ;
Wang, Xiaohua ;
He, Lei ;
Ren, Fuji .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70 (70)
[10]   Noncontact Accurate Measurement of Cardiopulmonary Activity Using a Compact Quadrature Doppler Radar Sensor [J].
Hu, Wei ;
Zhao, Zhangyan ;
Wang, Yunfeng ;
Zhang, Haiying ;
Lin, Fujiang .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2014, 61 (03) :725-735