Hierarchical deep neural networks to detect driver drowsiness

被引:22
作者
Jamshidi, Samaneh [1 ]
Azmi, Reza [1 ]
Sharghi, Mehran [1 ]
Soryani, Mohsen [2 ]
机构
[1] Alzahra Univ, Fac Engn, Tehran, Iran
[2] Iran Univ Sci & Technol, Sch Comp Engn, Tehran, Iran
关键词
Drowsiness detection; Deep learning; ResNet; LSTM; HEAD POSE; EYE STATE; SYSTEM;
D O I
10.1007/s11042-021-10542-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Driver drowsiness is one of the main reasons for deadly accidents, especially on suburban roads. Researchers have used many methods for analyzing videos and detecting drowsiness, and the most up-to-date methods among them are using deep learning. This paper proposes a hierarchical framework comprising deep networks with split spatial and temporal phases referred to as hierarchical deep drowsiness detection (HDDD) network. The proposed method uses ResNet to detect the driver's face, lighting condition, and whether the driver is wearing glasses or not. This phase also causes a significant increase in eyes and mouth detection percentage in the next stage. Afterward, the LSTM network is used to take advantage of temporal information between the frames. The average accuracy of the drowsiness detection system is reached 87.19 percent.
引用
收藏
页码:16045 / 16058
页数:14
相关论文
共 42 条
[1]  
Alioua N, 2014, INT J VEH TECHNOL, V2014
[2]  
[Anonymous], 2015, ARXIV PREPRINT ARXIV
[3]  
Aware, 2014, INT J SCI ENG TECHNO, V3, P203
[4]   Real-time system for monitoring driver vigilance [J].
Bergasa, LM ;
Nuevo, J ;
Sotelo, MA ;
Barea, R ;
Lopez, ME .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2006, 7 (01) :63-77
[5]  
Breuer R., 2017, ARXIV170501842
[6]  
Choi IH, 2014, INT CONF BIG DATA, P241, DOI 10.1109/BIGCOMP.2014.6741444
[7]   A reduced feature set for driver head pose estimation [J].
Diaz-Chito, Katerine ;
Hernandez-Sabate, Aura ;
Lopez, Antonio M. .
APPLIED SOFT COMPUTING, 2016, 45 :98-107
[8]  
Feng RJ, 2009, IEEE INT C NETW SENS, P887
[9]   Real-time vision-based eye state detection for driver alertness monitoring [J].
Gonzalez-Ortega, D. ;
Diaz-Pernas, F. J. ;
Anton-Rodriguez, M. ;
Martinez-Zarzuela, M. ;
Diez-Higuera, J. F. .
PATTERN ANALYSIS AND APPLICATIONS, 2013, 16 (03) :285-306
[10]   Comparison of colour transforms used in lip segmentation algorithms [J].
Gritzman, Ashley D. ;
Rubin, David M. ;
Pantanowitz, Adam .
SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 (04) :947-957