Hierarchical deep neural networks to detect driver drowsiness

被引:22
|
作者
Jamshidi, Samaneh [1 ]
Azmi, Reza [1 ]
Sharghi, Mehran [1 ]
Soryani, Mohsen [2 ]
机构
[1] Alzahra Univ, Fac Engn, Tehran, Iran
[2] Iran Univ Sci & Technol, Sch Comp Engn, Tehran, Iran
关键词
Drowsiness detection; Deep learning; ResNet; LSTM; HEAD POSE; EYE STATE; SYSTEM;
D O I
10.1007/s11042-021-10542-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Driver drowsiness is one of the main reasons for deadly accidents, especially on suburban roads. Researchers have used many methods for analyzing videos and detecting drowsiness, and the most up-to-date methods among them are using deep learning. This paper proposes a hierarchical framework comprising deep networks with split spatial and temporal phases referred to as hierarchical deep drowsiness detection (HDDD) network. The proposed method uses ResNet to detect the driver's face, lighting condition, and whether the driver is wearing glasses or not. This phase also causes a significant increase in eyes and mouth detection percentage in the next stage. Afterward, the LSTM network is used to take advantage of temporal information between the frames. The average accuracy of the drowsiness detection system is reached 87.19 percent.
引用
收藏
页码:16045 / 16058
页数:14
相关论文
共 50 条
  • [21] Hierarchical nucleation in deep neural networks
    Doimo, Diego
    Glielmo, Aldo
    Ansuini, Alessio
    Laio, Alessandro
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [22] Microcontroller Based Driver Alertness Detection Systems to detect drowsiness
    Adenin, Hasibah
    Zahari, Rahimi
    Lim, Tiong Hoo
    NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615
  • [23] A Driver Drowsiness Detection Scheme Based on 3D Convolutional Neural Networks
    Mao, Hongyun
    Tang, Jingling
    Zhao, Xiaoran
    Tang, Mingwei
    Jiang, Zhongyuan
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (02)
  • [24] Smart Shirt Respiratory Monitoring to Detect Car Driver Drowsiness
    Yuda, Emi
    Yoshida, Yutaka
    Hayano, Junichiro
    INTERNATIONAL JOURNAL OF AFFECTIVE ENGINEERING, 2021, 20 (02): : 57 - 62
  • [25] Using long short term memory and convolutional neural networks for driver drowsiness detection
    Quddus, Azhar
    Zandi, Ali Shahidi
    Prest, Laura
    Comeau, Felix J. E.
    ACCIDENT ANALYSIS AND PREVENTION, 2021, 156
  • [26] HIERARCHICAL PART DETECTION WITH DEEP NEURAL NETWORKS
    Cervantes, Esteve
    Yu, Long Long
    Bagdanov, Andrew D.
    Masana, Marc
    van de Wojer, Joost
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1933 - 1937
  • [27] Hierarchical Weight Averaging for Deep Neural Networks
    Gu, Xiaozhe
    Zhang, Zixun
    Jiang, Yuncheng
    Luo, Tao
    Zhang, Ruimao
    Cui, Shuguang
    Li, Zhen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 12276 - 12287
  • [28] Comprehensive Analysis on Feature Selection, Machine Learning and Deep Learning Algorithms to Detect Driver Drowsiness - An EEG Study
    Ferdous, Talukdar Raian
    Tushar, Md Abdul Kader
    Rafi, Rifath Hasan
    Asif, Nazmus Salehin
    Palash, Torikul Islam
    Arman, Md Adil
    Saha, Debasish Kumar
    Islam, Muhammad Muinul
    2023 10TH INTERNATIONAL CONFERENCE ON BIOMEDICAL AND BIOINFORMATICS ENGINEERING, ICBBE 2023, 2023, : 147 - 153
  • [29] A Deep-Learning Approach to Driver Drowsiness Detection
    Ahmed, Mohammed Imran Basheer
    Alabdulkarem, Halah
    Alomair, Fatimah
    Aldossary, Dana
    Alahmari, Manar
    Alhumaidan, Munira
    Alrassan, Shoog
    Rahman, Atta
    Youldash, Mustafa
    Zaman, Gohar
    SAFETY, 2023, 9 (03)
  • [30] Driver Drowsiness Alert System Using Deep Learning
    Pughazendi, N.
    Thyagarajan, C.
    Sathish, N.
    Harish, Yeluri
    Prakash, Venkata Sai Y.
    Ashish, Gattu
    Khilar, Rashmita
    JOURNAL OF ALGEBRAIC STATISTICS, 2022, 13 (02) : 1978 - 1988