Drowsiness Detection System Based on PERCLOS and Facial Physiological Signal

被引:18
作者
Chang, Robert Chen-Hao [1 ,2 ]
Wang, Chia-Yu [1 ]
Chen, Wei-Ting [1 ]
Chiu, Cheng-Di [3 ]
机构
[1] Natl Chung Hsing Univ, Dept Elect Engn, Taichung 40227, Taiwan
[2] Natl Chi Nan Univ, Dept Elect Engn, Puli 54561, Nantou, Taiwan
[3] China Med Univ Hosp, Neurosurg Dept & Spine Ctr, Taichung 404332, Taiwan
关键词
PERCLOS; drowsiness detection; sympathetic nervous index; parasympathetic nervous index; EEG; HEART-RATE; THETA OSCILLATIONS; NONCONTACT; BEHAVIOR; ALPHA;
D O I
10.3390/s22145380
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Accidents caused by fatigue occur frequently, and numerous scholars have devoted tremendous efforts to investigate methods to reduce accidents caused by fatigued driving. Accordingly, the assessment of the spirit status of the driver through the eyes blinking frequency and the measurement of physiological signals have emerged as effective methods. In this study, a drowsiness detection system is proposed to combine the detection of LF/HF ratio from heart rate variability (HRV) of photoplethysmographic imaging (PPGI) and percentage of eyelid closure over the pupil over time (PERCLOS), and to utilize the advantages of both methods to improve the accuracy and robustness of drowsiness detection. The proposed algorithm performs three functions, including LF/HF ratio from HRV status judgment, eye state detection, and drowsiness judgment. In addition, this study utilized a near-infrared webcam to obtain a facial image to achieve non-contact measurement, alleviate the inconvenience of using a contact wearable device, and for use in a dark environment. Furthermore, we selected the appropriate RGB channel under different light sources to obtain LF/HF ratio from HRV of PPGI. The main drowsiness judgment basis of the proposed drowsiness detection system is the use of algorithm to obtain sympathetic/parasympathetic nervous balance index and percentage of eyelid closure. In the experiment, there are 10 awake samples and 30 sleepy samples. The sensitivity is 88.9%, the specificity is 93.5%, the positive predictive value is 80%, and the system accuracy is 92.5%. In addition, an electroencephalography signal was used as a contrast to validate the reliability of the proposed method.
引用
收藏
页数:21
相关论文
共 40 条
[1]  
ahajournals.org, TASK FORCE EUROPEAN
[2]   POWER SPECTRUM ANALYSIS OF HEART-RATE FLUCTUATION - A QUANTITATIVE PROBE OF BEAT-TO-BEAT CARDIOVASCULAR CONTROL [J].
AKSELROD, S ;
GORDON, D ;
UBEL, FA ;
SHANNON, DC ;
BARGER, AC ;
COHEN, RJ .
SCIENCE, 1981, 213 (4504) :220-222
[3]  
Autonomic Nervous Medicine Association, HLTH ED MANUAL HRV D
[4]   CORRELATIONS AMONG TIME AND FREQUENCY-DOMAIN MEASURES OF HEART PERIOD VARIABILITY 2 WEEKS AFTER ACUTE MYOCARDIAL-INFARCTION [J].
BIGGER, JT ;
FLEISS, JL ;
STEINMAN, RC ;
ROLNITZKY, LM ;
KLEIGER, RE ;
ROTTMAN, JN .
AMERICAN JOURNAL OF CARDIOLOGY, 1992, 69 (09) :891-898
[5]  
Chang C.W, 2014, THESIS NAT CHUNG HSI
[6]  
Chang R.C.-H., 2021, P 2021 IEEE INT C CO
[7]  
Chen C.H, 2004, THESIS SUN YAT SEN U
[8]  
Cho D, 2016, IEEE ENG MED BIO, P3847, DOI 10.1109/EMBC.2016.7591567
[9]   The Voice of Anger: Oscillatory EEG Responses to Emotional Prosody [J].
del Giudice, Renata ;
Blume, Christine ;
Wislowska, Malgorzata ;
Wielek, Tomasz ;
Heib, Dominik P. J. ;
Schabus, Manuel .
PLOS ONE, 2016, 11 (07)
[10]   Heart Rate Variability-Based Driver Drowsiness Detection and Its Validation With EEG [J].
Fujiwara, Koichi ;
Abe, Erika ;
Kamata, Keisuke ;
Nakayama, Chikao ;
Suzuki, Yoko ;
Yamakawa, Toshitaka ;
Hiraoka, Toshihiro ;
Kano, Manabu ;
Sumi, Yukiyoshi ;
Masuda, Fumi ;
Matsuo, Masahiro ;
Kadotani, Hiroshi .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2019, 66 (06) :1769-1778