A novel deep learning-based technique for driver drowsiness detection

被引:3
作者
Mukherjee, Prithwijit [1 ]
Roy, Anisha Halder [1 ]
机构
[1] Univ Calcutta, Inst Radio Phys & Elect, Kolkata, India
关键词
drowsiness detection; EEG; EMG; GSR; hybrid model; pulse rate; respiration rate; TLSTM;
D O I
10.1002/hfm.21056
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Every year, many people lose their lives because of road accidents. It is evident from statistics that drowsiness is one of the main causes of a large number of car accidents. In our research, we wish to solve this major problem by measuring the drowsiness level of the human brain while driving. The study aims to develop a novel technique to detect different alertness levels (i.e., awake, moderately drowsy, and maximally drowsy) of a person while driving. A hybrid model using a stacked autoencoder and hyperbolic tangent Long Short-Term Memory (TLSTM) network with attention mechanism is designed for this purpose. The designed model uses different biopotential signals, such as electroencephalography (EEG), facial electromyography (EMG), and different biomarkers, such as pulse rate, respiration rate galvanic skin response, and head movement to detect a person's alertness level. Here, the stacked autoencoder model is used for automated feature extraction. TLSTM is used to predict a person's alertness level using stacked autoencoder network-extracted features. The proposed model can classify awake, moderately drowsy, and maximally drowsy states of a person with accuracies of 99%, 98.3%, and 98.6%, respectively. The novel contributions of the paper includes (i) incorporation of an attention mechanism into the TLSTM network of the proposed hybrid model to focus on the emphatic states to enhance classification accuracy, and (ii) utilization of EEG, facial EMG, pulse rate, respiration rate, galvanic skin reaction, and head movement pattern to assess a person's alertness level.
引用
收藏
页码:667 / 684
页数:18
相关论文
共 49 条
[1]   Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data [J].
Ahn, Sangtae ;
Nguyen, Thien ;
Jang, Hyojung ;
Kim, Jae G. ;
Jun, Sung C. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
[2]   A Hybrid Approach to Detect Driver Drowsiness Utilizing Physiological Signals to Improve System Performance and Wearability [J].
Awais, Muhammad ;
Badruddin, Nasreen ;
Drieberg, Micheal .
SENSORS, 2017, 17 (09)
[3]   System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures [J].
Bajaj, Jaspreet Singh ;
Kumar, Naveen ;
Kaushal, Rajesh Kumar ;
Gururaj, H. L. ;
Flammini, Francesco ;
Natarajan, Rajesh .
SENSORS, 2023, 23 (03)
[4]  
Balouji E, 2018, INT C HARMON QUAL PO
[5]   Deep learning through LSTM classification and regression for transmission line fault detection, diagnosis and location in large-scale multi-machine power systems [J].
Belagoune, Soufiane ;
Bali, Noureddine ;
Bakdi, Azzeddine ;
Baadji, Bousaadia ;
Atif, Karim .
MEASUREMENT, 2021, 177 (177)
[6]   CNN Based Driver Drowsiness Detection System Using Emotion Analysis [J].
Chand, H. Varun ;
Karthikeyan, J. .
INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2022, 31 (02) :717-728
[7]  
Dai Y., 2021, 7 ANN INT C NETWORK, P991, DOI [10.1109/ICNISC54316.2021.00187, DOI 10.1109/ICNISC54316.2021.00187]
[8]   Detection and prediction of driver drowsiness using artificial neural network models [J].
de Naurois, Charlotte Jacobe ;
Bourdin, Christophe ;
Stratulat, Anca ;
Diaz, Emmanuelle ;
Vercher, Jean-Louis .
ACCIDENT ANALYSIS AND PREVENTION, 2019, 126 :95-104
[9]  
De S, 2023, 2023 INT C AMB INT K, P1, DOI [10.1109/AIKIIE60097.2023.10390223, DOI 10.1109/AIKIIE60097.2023.10390223, 10.1109/aikiie60097.2023.10390223]
[10]   Deep learning with an attention mechanism for continuous biomechanical motion estimation across varied activities [J].
Ding, Guanlin ;
Plummer, Andrew ;
Georgilas, Ioannis .
FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10