Driver drowsiness detection using modified deep learning architecture

被引:8
作者
Kumar, Vijay [1 ]
Sharma, Shivam [1 ]
Ranjeet [1 ]
机构
[1] Natl Inst Technol, Comp Sci & Engn Dept, Hamirpur, Himachal Prades, India
关键词
Image processing; Convolutional neural network; Transfer learning; Road Safety; Driver drowsiness; LSTM; InceptionV3; OF-THE-ART; STATE; RECOGNITION;
D O I
10.1007/s12065-022-00743-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a non-invasive approach to detect driver drowsiness. The facial features are used for detecting the driver's drowsiness. The mouth and eye regions are extracted from the video frame. These extracted regions are applied on hybrid deep learning model for drowsiness detection. A hybrid deep learning model is proposed by incorporating both modified InceptionV3 and long short-term memory (LSTM) network. InceptionV3 is modified by adding global average pooling layer for spatial robustness and dropout technique to prevent overfitting on training data. The proposed hybrid model is compared with convolutional neural network, IncpetionV3, and LSTM over NTHU-DDD dataset. The proposed model performs better than the other model in terms of performance measures. The proposed model is able to detect driver fatigue effectively.
引用
收藏
页码:1907 / 1916
页数:10
相关论文
共 43 条
[1]   Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness [J].
Borghini, Gianluca ;
Astolfi, Laura ;
Vecchiato, Giovanni ;
Mattia, Donatella ;
Babiloni, Fabio .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2014, 44 :58-75
[2]   YOLO-face: a real-time face detector [J].
Chen, Weijun ;
Huang, Hongbo ;
Peng, Shuai ;
Zhou, Changsheng ;
Zhang, Cuiping .
VISUAL COMPUTER, 2021, 37 (04) :805-813
[3]  
Chirra Venkata Rami Reddy, 2019, Revue d'Intelligence Artificielle, V33, P461, DOI [10.18280/ria.330609, 10.18280/ria.330609]
[4]  
Computer Vision Lab National Tsuing Hua University., 2016, DRIVER DROWSINESS DE
[5]  
Distracted Driving-Motor Vehicle Safety-CDC Injury Center, MOTORVEHICLESAFETY D
[6]   Real-Time System for Driver Fatigue Detection Based on a Recurrent Neuronal Network [J].
Ed-Doughmi, Younes ;
Idrissi, Najlae ;
Hbali, Youssef .
JOURNAL OF IMAGING, 2020, 6 (03)
[7]   Driver Fatigue Detection using Recurrent Neural Networks [J].
Ed-Doughmi, Younes ;
Idrissi, Najlae .
PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON NETWORKING, INFORMATION SYSTEMS & SECURITY (NISS19), 2019,
[8]  
Faraji F, 2021, ARXIV210400125
[9]   An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing [J].
Gwak, Jongseong ;
Hirao, Akinari ;
Shino, Motoki .
APPLIED SCIENCES-BASEL, 2020, 10 (08)
[10]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]