Hierarchical deep neural networks to detect driver drowsiness

被引:22
|
作者
Jamshidi, Samaneh [1 ]
Azmi, Reza [1 ]
Sharghi, Mehran [1 ]
Soryani, Mohsen [2 ]
机构
[1] Alzahra Univ, Fac Engn, Tehran, Iran
[2] Iran Univ Sci & Technol, Sch Comp Engn, Tehran, Iran
关键词
Drowsiness detection; Deep learning; ResNet; LSTM; HEAD POSE; EYE STATE; SYSTEM;
D O I
10.1007/s11042-021-10542-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Driver drowsiness is one of the main reasons for deadly accidents, especially on suburban roads. Researchers have used many methods for analyzing videos and detecting drowsiness, and the most up-to-date methods among them are using deep learning. This paper proposes a hierarchical framework comprising deep networks with split spatial and temporal phases referred to as hierarchical deep drowsiness detection (HDDD) network. The proposed method uses ResNet to detect the driver's face, lighting condition, and whether the driver is wearing glasses or not. This phase also causes a significant increase in eyes and mouth detection percentage in the next stage. Afterward, the LSTM network is used to take advantage of temporal information between the frames. The average accuracy of the drowsiness detection system is reached 87.19 percent.
引用
收藏
页码:16045 / 16058
页数:14
相关论文
共 50 条
  • [11] Hierarchical HMMs on Eyes for Driver Drowsiness Detection
    Gong, Wei
    Tan, YiHua
    Tai, Yuan
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 3328 - 3333
  • [12] Robust Drowsiness Detection for Vehicle Driver using Deep Convolutional Neural Network
    Saif, A. F. M. Saifuddin
    Mahayuddin, Zainal Rasyid
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (10) : 343 - 350
  • [13] Using hierarchical statistical analysis and deep neural networks to detect covert timing channels
    Darwish, Omar
    Al-Fuqaha, Ala
    Ben Brahim, Ghassen
    Jenhani, Ilyes
    Vasilakos, Athanasios
    APPLIED SOFT COMPUTING, 2019, 82
  • [14] EEG-Based Driver Drowsiness Estimation Using Convolutional Neural Networks
    Cui, Yuqi
    Wu, Dongrui
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 822 - 832
  • [15] An Investigation to Detect Driver Drowsiness from Eye blink Artifacts Using Deep Learning Models
    Egambaram, Ashvaany
    Badruddin, Nasreen
    2022 IEEE-EMBS CONFERENCE ON BIOMEDICAL ENGINEERING AND SCIENCES, IECBES, 2022, : 23 - 29
  • [16] A smart analysis of driver fatigue and drowsiness detection using convolutional neural networks
    Abid Ali Minhas
    Sohail Jabbar
    Muhammad Farhan
    Muhammad Najam ul Islam
    Multimedia Tools and Applications, 2022, 81 : 26969 - 26986
  • [17] Adapting artificial neural networks to a specific driver enhances detection and prediction of drowsiness
    de Naurois, Charlotte Jacobe
    Bourdin, Christophe
    Bougard, Clement
    Vercher, Jean-Louis
    ACCIDENT ANALYSIS AND PREVENTION, 2018, 121 : 118 - 128
  • [18] A smart analysis of driver fatigue and drowsiness detection using convolutional neural networks
    Minhas, Abid Ali
    Jabbar, Sohail
    Farhan, Muhammad
    ul Islam, Muhammad Najam
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (19) : 26969 - 26986
  • [19] Multi-Level Classification of Driver Drowsiness by Simultaneous Analysis of ECG and Respiration Signals Using Deep Neural Networks
    Ebrahimian, Serajeddin
    Nahvi, Ali
    Tashakori, Masoumeh
    Salmanzadeh, Hamed
    Mohseni, Omid
    Leppanen, Timo
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2022, 19 (17)
  • [20] Applying deep neural networks for multi-level classification of driver drowsiness using Vehicle-based measures
    Arefnezhad, Sadegh
    Samiee, Sajjad
    Eichberger, Arno
    Fruehwirth, Matthias
    Kaufmann, Clemens
    Klotz, Emma
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 162