Motion-Robust Atrial Fibrillation Detection Based on Remote-Photoplethysmography

被引:14
作者
Wu, Bing-Fei [1 ]
Wu, Bing-Jhang [1 ]
Cheng, Shao-En [1 ]
Sun, Yu [2 ]
Chung, Meng-Liang [3 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Inst Elect & Control Engn, Hsinchu 30010, Taiwan
[2] En Chu Kong Hosp, Dept Neurol, New Taipei City 237, Taiwan
[3] FaceHeart Corp, Hsinchu 300196, Taiwan
关键词
Feature extraction; Cameras; Motion segmentation; Heart rate variability; Stroke (medical condition); Faces; Bioinformatics; Atrial fibrillation; deep neural network; remote photoplethysmography;
D O I
10.1109/JBHI.2022.3172705
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Atrial fibrillation (AF) has been proven highly correlated to stroke; more than 43 million people suffer from AF worldwide. However, most of these patients are unaware of their disease. There is no convenient tool by which to conduct a comprehensive screening to identify asymptomatic AF patients. Hence, we provide a non-contact AF detection approach based on remote photoplethysmography (rPPG). We address motion disturbance, the most challenging issue in rPPG technology, with the NR-Net, ATT-Net, and SQ-Mask modules. NR-Net is designed to eliminate motion noise with a CNN model, and ATT-Net and SQ-Mask utilize channel-wise and temporal attention to reduce the influence of poor signal segments. Moreover, we present an AF dataset collected from hospital wards which contains 452 subjects (mean age, 69.3$\pm$13.0 years; women, 46%) and 7,306 30-second segments to verify the proposed algorithm. To our best knowledge, this dataset has the most participants and covers the full age range of possible AF patients. The proposed method yields accuracy, sensitivity, and specificity of 95.69%, 96.76%, and 94.33%, respectively, when discriminating AF from normal sinus rhythm. More than previous studies, other arrhythmias are also taken into consideration, leading to a further investigation of AF vs. Non-AF and AF vs. Other scenarios. For the three scenarios, the proposed approach outperforms the benchmark algorithms. Additionally, the accuracy of the slight motion data improves to 95.82%, 92.39%, and 89.18% for the three scenarios, respectively, while that of full motion data increases by over 3%.
引用
收藏
页码:2705 / 2716
页数:12
相关论文
共 39 条
[1]   OpenFace 2.0: Facial Behavior Analysis Toolkit [J].
Baltrusaitis, Tadas ;
Zadeh, Amir ;
Lim, Yao Chong ;
Morency, Louis-Philippe .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :59-66
[2]  
Calkins H, 2018, EUROPACE, V20, pE1, DOI [10.1093/europace/eux274, 10.1016/j.hrthm.2017.05.012, 10.1093/europace/eux275]
[3]   Diagnostic Performance of a Smartphone-Based Photoplethysmographic Application for Atrial Fibrillation Screening in a Primary Care Setting [J].
Chan, Pak-Hei ;
Wong, Chun-Ka ;
Poh, Yukkee C. ;
Pun, Louise ;
Leung, Wangie Wan-Chiu ;
Wong, Yu-Fai ;
Wong, Michelle Man-Ying ;
Poh, Ming-Zher ;
Chu, Daniel Wai-Sing ;
Siu, Chung-Wah .
JOURNAL OF THE AMERICAN HEART ASSOCIATION, 2016, 5 (07)
[4]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[5]   DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks [J].
Chen, Weixuan ;
McDuff, Daniel .
COMPUTER VISION - ECCV 2018, PT II, 2018, 11206 :356-373
[6]   Detection of atrial fibrillation using contactless facial video monitoring [J].
Couderc, Jean-Philippe ;
Kyal, Survi ;
Mestha, Lalit K. ;
Xu, Beilei ;
Peterson, Derick R. ;
Xia, Xiaojuan ;
Hall, Burr .
HEART RHYTHM, 2015, 12 (01) :195-201
[7]   Robust Pulse Rate From Chrominance-Based rPPG [J].
de Haan, Gerard ;
Jeanne, Vincent .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2013, 60 (10) :2878-2886
[8]   Screening for Atrial Fibrillation A Report of the AF-SCREEN International Collaboration [J].
Freedman, Ben ;
Camm, John ;
Calkins, Hugh ;
Healey, Jeffrey S. ;
Rosenqvist, Marten ;
Wang, Jiguang ;
Albert, Christine M. ;
Anderson, Craig S. ;
Antoniou, Sotiris ;
Benjamin, Emelia J. ;
Boriani, Giuseppe ;
Brachmann, Hannes ;
Brachmann, Johannes ;
Brandes, Axel ;
Chao, Tze-Fan ;
Conen, David ;
Engdahl, Johan ;
Fauchier, Laurent ;
Fitzmaurice, David A. ;
Friberg, Leif ;
Gersh, Bernard J. ;
Gladstone, David J. ;
Glotzer, Taya V. ;
Gwynne, Kylie ;
Hankey, Graeme J. ;
Harbison, Joseph ;
Hillis, Graham S. ;
Hills, Mellanie T. ;
Kamel, Hooman ;
Kirchhof, Paulus ;
Kowey, Peter R. ;
Krieger, Derk ;
Lee, Vivian W. Y. ;
Levin, Lars-Ake ;
Lip, Gregory Y. H. ;
Lobban, Trudie ;
Lowres, Nicole ;
Mairesse, Georges H. ;
Martinez, Carlos ;
Neubeck, Lis ;
Orchard, Jessica ;
Piccini, Jonathan P. ;
Poppe, Katrina ;
Potpara, Tatjana S. ;
Puererfellner, Helmut ;
Rienstra, Michiel ;
Sandhu, Roopinder K. ;
Schnabel, Renate B. ;
Siu, Chung-Wah ;
Steinhubl, Steven .
CIRCULATION, 2017, 135 (19) :1851-+
[9]   A NYQUIST FOLDING ANALOG-TO-INFORMATION RECEIVER [J].
Fudge, Gerald L. ;
Bland, Ross E. ;
Chivers, Mark A. ;
Ravindran, Sujit ;
Haupt, Jarvis ;
Pace, P. E. .
2008 42ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, VOLS 1-4, 2008, :541-+
[10]   Non-contact video-based estimation of heart rate variability spectrogram from hemoglobin composition [J].
Fukunishi M. ;
Kurita K. ;
Yamamoto S. ;
Tsumura N. .
Artificial Life and Robotics, 2017, 22 (04) :457-463