Hierarchical deep neural networks to detect driver drowsiness

被引:22
作者
Jamshidi, Samaneh [1 ]
Azmi, Reza [1 ]
Sharghi, Mehran [1 ]
Soryani, Mohsen [2 ]
机构
[1] Alzahra Univ, Fac Engn, Tehran, Iran
[2] Iran Univ Sci & Technol, Sch Comp Engn, Tehran, Iran
关键词
Drowsiness detection; Deep learning; ResNet; LSTM; HEAD POSE; EYE STATE; SYSTEM;
D O I
10.1007/s11042-021-10542-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Driver drowsiness is one of the main reasons for deadly accidents, especially on suburban roads. Researchers have used many methods for analyzing videos and detecting drowsiness, and the most up-to-date methods among them are using deep learning. This paper proposes a hierarchical framework comprising deep networks with split spatial and temporal phases referred to as hierarchical deep drowsiness detection (HDDD) network. The proposed method uses ResNet to detect the driver's face, lighting condition, and whether the driver is wearing glasses or not. This phase also causes a significant increase in eyes and mouth detection percentage in the next stage. Afterward, the LSTM network is used to take advantage of temporal information between the frames. The average accuracy of the drowsiness detection system is reached 87.19 percent.
引用
收藏
页码:16045 / 16058
页数:14
相关论文
共 50 条
[41]   Research on Driver Drowsiness Detection Method based on Deep Learning [J].
Puwei, Shi ;
Ishii, Kazuo .
JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2024, 10 (04) :313-317
[42]   Driver drowsiness detection using modified deep learning architecture [J].
Vijay Kumar ;
Shivam Sharma .
Evolutionary Intelligence, 2023, 16 :1907-1916
[43]   Unobtrusive drowsiness detection by neural network learning of driver steering [J].
Sayed, R ;
Eskandarian, A .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2001, 215 (D9) :969-975
[44]   Driver drowsiness detection using modified deep learning architecture [J].
Kumar, Vijay ;
Sharma, Shivam ;
Ranjeet .
EVOLUTIONARY INTELLIGENCE, 2023, 16 (06) :1907-1916
[45]   Detecting Driver Drowsiness in Real Time Through Deep Learning Based Object Detection [J].
Shakeel, Muhammad Faique ;
Bajwa, Nabit A. ;
Anwaar, Ahmad Muhammad ;
Sohail, Anabia ;
Khan, Asifullah ;
Haroon-ur-Rashid .
ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2019, PT I, 2019, 11506 :283-296
[46]   A Novel Hybrid Approach for Driver Drowsiness Detection Using a Custom Deep Learning Model [J].
Ramzan, Muhammad ;
Abid, Adnan ;
Fayyaz, Muhammad ;
Alahmadi, Tahani Jaser ;
Nobanee, Haitham ;
Rehman, Amjad .
IEEE ACCESS, 2024, 12 :126866-126884
[47]   Study on Training Convolutional Neural Network to Detect Distraction and Drowsiness [J].
Kim, Whui ;
Choi, Hyun-Kyun ;
Jang, Byung-Tae .
2018 IEEE REGION TEN SYMPOSIUM (TENSYMP), 2018, :260-264
[48]   Driver Drowsiness Detection [J].
Reddy, Tharun Kumar ;
Behera, Laxmidhar .
IEEE SYSTEMS MAN AND CYBERNETICS MAGAZINE, 2022, 8 (01) :16-28
[49]   Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks [J].
Wijnands, Jasper S. ;
Thompson, Jason ;
Nice, Kerry A. ;
Aschwanden, Gideon D. P. A. ;
Stevenson, Mark .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (13) :9731-9743
[50]   Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks [J].
Jasper S. Wijnands ;
Jason Thompson ;
Kerry A. Nice ;
Gideon D. P. A. Aschwanden ;
Mark Stevenson .
Neural Computing and Applications, 2020, 32 :9731-9743