Hierarchical deep neural networks to detect driver drowsiness

被引:22
作者
Jamshidi, Samaneh [1 ]
Azmi, Reza [1 ]
Sharghi, Mehran [1 ]
Soryani, Mohsen [2 ]
机构
[1] Alzahra Univ, Fac Engn, Tehran, Iran
[2] Iran Univ Sci & Technol, Sch Comp Engn, Tehran, Iran
关键词
Drowsiness detection; Deep learning; ResNet; LSTM; HEAD POSE; EYE STATE; SYSTEM;
D O I
10.1007/s11042-021-10542-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Driver drowsiness is one of the main reasons for deadly accidents, especially on suburban roads. Researchers have used many methods for analyzing videos and detecting drowsiness, and the most up-to-date methods among them are using deep learning. This paper proposes a hierarchical framework comprising deep networks with split spatial and temporal phases referred to as hierarchical deep drowsiness detection (HDDD) network. The proposed method uses ResNet to detect the driver's face, lighting condition, and whether the driver is wearing glasses or not. This phase also causes a significant increase in eyes and mouth detection percentage in the next stage. Afterward, the LSTM network is used to take advantage of temporal information between the frames. The average accuracy of the drowsiness detection system is reached 87.19 percent.
引用
收藏
页码:16045 / 16058
页数:14
相关论文
共 42 条
[11]   Driver drowsiness detection using hybrid convolutional neural network and long short-term memory [J].
Guo, Jing-Ming ;
Markoni, Herleeyandi .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (20) :29059-29087
[12]   Human and Vehicle Driver Drowsiness Detection by Facial Expression [J].
Hachisuka, Satori .
2013 INTERNATIONAL CONFERENCE ON BIOMETRICS AND KANSEI ENGINEERING (ICBAKE), 2013, :320-326
[13]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[14]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[15]   Yawn analysis with mouth occlusion detection [J].
Ibrahim, Masrullizam Mat ;
Soraghan, John J. ;
Petropoulakis, Lykourgos ;
Di Caterina, Gaetano .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2015, 18 :360-369
[16]   Subjective sleepiness, simulated driving performance and blink duration:: examining individual differences [J].
Ingre, M ;
Åkerstedt, T ;
Peters, B ;
Anund, A ;
Kecklund, G .
JOURNAL OF SLEEP RESEARCH, 2006, 15 (01) :47-53
[17]  
Ishii Y, 2014, 2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS IEEE-ROBIO 2014, P2449, DOI 10.1109/ROBIO.2014.7090707
[18]  
Jones M., 2003, Mitsubishi Electric Research Lab TR-20003-96, V3, P2
[19]  
Kalbkhani H., 2012, Journal of world's electrical engineering and technology, V1, P12
[20]   Driver Behavior Analysis for Safe Driving: A Survey [J].
Kaplan, Sinan ;
Guvensan, Mehmet Amac ;
Yavuz, Ali Gokhan ;
Karalurt, Yasin .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2015, 16 (06) :3017-3032