AutoHR: A Strong End-to-End Baseline for Remote Heart Rate Measurement With Neural Searching

被引:115
作者
Yu, Zitong [1 ]
Li, Xiaobai [1 ]
Niu, Xuesong [2 ,3 ]
Shi, Jingang [4 ,5 ]
Zhao, Guoying [6 ]
机构
[1] Univ Oulu, Ctr Machine Vis & Signal Anal CMVS, Oulu 90014, Finland
[2] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Xi An Jiao Tong Univ, Sch Software Engn, Xian 710049, Shaanxi, Peoples R China
[5] Univ Oulu, CMVS, Oulu 90014, Finland
[6] Northwest Univ, Sch Informat & Technol, Xian 710069, Shaanxi, Peoples R China
基金
中国国家自然科学基金; 芬兰科学院;
关键词
RPPG; heart rate; neural architecture search; PULSE-RATE; NONCONTACT;
D O I
10.1109/LSP.2020.3007086
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e.g., remote healthcare). Existing end-to-end rPPG and heart rate (HR) measurement methods from facial videos are vulnerable to the less-constrained scenarios (e.g., with head movement and bad illumination). In this letter, we explore the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong end-to-end baseline (AutoHR) for remote HR measurement with neural architecture search (NAS). The proposed method includes three parts: 1) a powerful searched backbone with novel Temporal Difference Convolution (TDC), intending to capture intrinsic rPPG-aware clues between frames; 2) a hybrid loss function considering constraints from both time and frequency domains; and 3) spatio-temporal data augmentation strategies for better representation learning. Comprehensive experiments are performed on three benchmark datasets, and we achieved superior performance on both intra- and cross-dataset testings.
引用
收藏
页码:1245 / 1249
页数:5
相关论文
共 28 条
[1]  
[Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.263
[2]  
[Anonymous], ABS151203385 CORR
[3]   Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset [J].
Carreira, Joao ;
Zisserman, Andrew .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4724-4733
[4]  
Chen Weixuan, 2018, ECCV
[5]   Video-Based Heart Rate Measurement: Recent Advances and Future Prospects [J].
Chen, Xun ;
Cheng, Juan ;
Song, Rencheng ;
Liu, Yu ;
Ward, Rabab ;
Wang, Z. Jane .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2019, 68 (10) :3600-3615
[6]   Robust Pulse Rate From Chrominance-Based rPPG [J].
de Haan, Gerard ;
Jeanne, Vincent .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2013, 60 (10) :2878-2886
[7]  
Hsu GS, 2017, IEEE IMAGE PROC, P3830, DOI 10.1109/ICIP.2017.8296999
[8]   Remote Heart Rate Measurement From Face Videos Under Realistic Situations [J].
Li, Xiaobai ;
Chen, Jie ;
Zhao, Guoying ;
Pietikainen, Matti .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :4264-4271
[9]  
Liu D, 2019, 2019 54TH INTERNATIONAL UNIVERSITIES POWER ENGINEERING CONFERENCE (UPEC), DOI [10.1109/upec.2019.8893485, 10.1109/itaic.2019.8785709, 10.1109/icems.2019.8921519, 10.1109/ITAIC.2019.8785709]
[10]  
Liu H., 2018, INT C LEARNING REPRE