Fatigue Driving Detection Under Low Illumination Using Image Enhancement and Facial State Recognition

被引:0
|
作者
Zhao, Yang [1 ,2 ]
Miao, Jialong [1 ]
Liu, Xuefeng [1 ]
Zhao, Jincheng [3 ]
Xu, Sen [1 ,2 ]
机构
[1] Shenyang Univ Chem Technol, Coll Comp Sci & Technol, Shenyang 110142, Liaoning, Peoples R China
[2] Key Lab Intelligent Technol Chem Proc Ind Liaoning, Shenyang 110142, Liaoning, Peoples R China
[3] Shenyang Univ Chem Technol, Coll Informat Engn, Shenyang 110142, Liaoning, Peoples R China
关键词
image processing; fatigue driving detection; face state recognition; YOLOv5s; lightweight algorithm;
D O I
10.3788/LOP240711
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This study proposes a fatigue driving detection model based on image enhancement and facial state recognition to address the issues of low accuracy, large model size, and reduced performance in low- light environments found in existing models. The YOLOv5s model was enhanced for face detection and key point localization under low illumination, incorporating a self- calibrated illumination module to enhance low- illumination images. The downsampling layer was replaced with the StemBlock module to improve feature expression capability, and the backbone network was replaced with ShuffleNetv2 to reduce the model's parameters and computational complexity. Replacing the C3 module with the cbam inverted bottleneck C3 (CIBC3) reduced noise interference in detection and enhanced the model's global perception ability. Furthermore, the wing loss function was added to the total loss function for facial keypoint regression. A fatigue state recognition network was employed to determine the opening and closing statuses of the eyes and mouth located by the face detection model, and evaluation indicators were used to determine the fatigue state. The experimental results obtained on the DARK FACE dataset demonstrate that, compared to the benchmark YOLOv5s model, the improved model reduced parameters and computational complexity by 62. 12% and 63. 41%, respectively, and improved accuracy by 2. 38 percentage points. The proposed fatigue driving detection model achieved accuracies of 96. 07% and 94. 50% on the YawDD normal lighting and self- built low- lighting datasets, respectively, outperforming other models. The processing time per image was only 27 ms, demonstrating that the proposed model not only ensures detection accuracy in normal and low- light environments but also meets real-time requirements, making it suitable for deployment on edge computing equipment with limited computing power.
引用
收藏
页数:13
相关论文
共 31 条
  • [1] Abtahi S., 2014, P 5 ACM MULTIMEDIA S, P24, DOI DOI 10.1145/2557642.2563678
  • [2] [敖邦乾 Ao Bangqian], 2022, [系统仿真学报, Journal of System Simulation], V34, P323
  • [3] Applying deep neural networks for multi-level classification of driver drowsiness using Vehicle-based measures
    Arefnezhad, Sadegh
    Samiee, Sajjad
    Eichberger, Arno
    Fruehwirth, Matthias
    Kaufmann, Clemens
    Klotz, Emma
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2020, 162
  • [4] Research on tobacco foreign body detection device based on machine vision
    Chao, Mi
    Kai, Chen
    Zhang, Zhiwei
    [J]. TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2020, 42 (15) : 2857 - 2871
  • [5] Chen W., 2021, arXiv
  • [6] Cui X F, 2019, Research on several issues about face keypoints detection
  • [7] Feature fusion strategy and improved GhostNet for accurate recognition of fish feeding behavior
    Du, Zhuangzhuang
    Xu, Xianbao
    Bai, Zhuangzhuang
    Liu, Xiaohang
    Hu, Yang
    Li, Wanchao
    Wang, Cong
    Li, Daoliang
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 214
  • [8] A corn canopy organs detection method based on improved DBi-YOLOv8 network
    Guan, Haiou
    Deng, Haotian
    Ma, Xiaodan
    Zhang, Tao
    Zhang, Yifei
    Zhu, Tianyu
    Zhou, Haichao
    Gu, Zhicheng
    Lu, Yuxin
    [J]. EUROPEAN JOURNAL OF AGRONOMY, 2024, 154
  • [9] LIME: Low-Light Image Enhancement via Illumination Map Estimation
    Guo, Xiaojie
    Li, Yu
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) : 982 - 993
  • [10] A Deep Learning Review of ResNet Architecture for Lung Disease Identification in CXR Image
    Hasanah, Syifa Auliyah
    Pravitasari, Anindya Apriliyanti
    Abdullah, Atje Setiawan
    Yulita, Intan Nurma
    Asnawi, Mohammad Hamid
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (24):