Hierarchical deep neural networks to detect driver drowsiness

被引:0
作者
Samaneh Jamshidi
Reza Azmi
Mehran Sharghi
Mohsen Soryani
机构
[1] Alzahra University,Faculty of Engineering
[2] Iran University of Science and Technology,School of Computer Engineering
来源
Multimedia Tools and Applications | 2021年 / 80卷
关键词
Drowsiness detection; Deep learning; ResNet; LSTM;
D O I
暂无
中图分类号
学科分类号
摘要
Driver drowsiness is one of the main reasons for deadly accidents, especially on suburban roads. Researchers have used many methods for analyzing videos and detecting drowsiness, and the most up-to-date methods among them are using deep learning. This paper proposes a hierarchical framework comprising deep networks with split spatial and temporal phases referred to as hierarchical deep drowsiness detection (HDDD) network. The proposed method uses ResNet to detect the driver’s face, lighting condition, and whether the driver is wearing glasses or not. This phase also causes a significant increase in eyes and mouth detection percentage in the next stage. Afterward, the LSTM network is used to take advantage of temporal information between the frames. The average accuracy of the drowsiness detection system is reached 87.19 percent.
引用
收藏
页码:16045 / 16058
页数:13
相关论文
共 50 条
[41]   Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks [J].
Wijnands, Jasper S. ;
Thompson, Jason ;
Nice, Kerry A. ;
Aschwanden, Gideon D. P. A. ;
Stevenson, Mark .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (13) :9731-9743
[42]   Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks [J].
Jasper S. Wijnands ;
Jason Thompson ;
Kerry A. Nice ;
Gideon D. P. A. Aschwanden ;
Mark Stevenson .
Neural Computing and Applications, 2020, 32 :9731-9743
[43]   Resolution of Singularities Introduced by Hierarchical Structure in Deep Neural Networks [J].
Nitta, Tohru .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (10) :2282-2293
[44]   Pulse Deinterleaving for Multifunction Radars With Hierarchical Deep Neural Networks [J].
Liu, Zhang-Meng .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2021, 57 (06) :3585-3599
[45]   IoT based mobile driver drowsiness detection using deep learning [J].
Safak, Emre ;
Dogru, Ibrahim Alper ;
Barisci, Necaattin ;
Toklu, Sinan .
JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2022, 37 (04) :1869-1881
[46]   A novel deep learning-based technique for driver drowsiness detection [J].
Mukherjee, Prithwijit ;
Roy, Anisha Halder .
HUMAN FACTORS AND ERGONOMICS IN MANUFACTURING & SERVICE INDUSTRIES, 2024, 34 (06) :667-684
[47]   Driver behavior detection and classification using deep convolutional neural networks [J].
Shahverdy, Mohammad ;
Fathy, Mahmood ;
Berangi, Reza ;
Sabokrou, Mohammad .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 149
[48]   Hierarchical Training of Deep Neural Networks Using Early Exiting [J].
Sepehri, Yamin ;
Pad, Pedram ;
Yuzuguler, Ahmet Caner ;
Frossard, Pascal ;
Dunbar, L. Andrea .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (04) :6271-6285
[49]   Real Time Driver Drowsiness Detection Based on Convolution Neural Network [J].
Ahmed, M. A. ;
Hussein, Harith A. ;
Omar, Mohammed Basim ;
Hameed, Qabas A. .
JOURNAL OF ALGEBRAIC STATISTICS, 2022, 13 (02) :2006-2012
[50]   Automatic driver distraction detection using deep convolutional neural networks [J].
Hossain, Md. Uzzol ;
Rahman, Md. Ataur ;
Islam, Md. Manowarul ;
Akhter, Arnisha ;
Uddin, Md. Ashraf ;
Paul, Bikash Kumar .
INTELLIGENT SYSTEMS WITH APPLICATIONS, 2022, 14