Real-Time Distracted Driving Detection Based on GM-YOLOv8 on Embedded Systems

被引:0
作者
Al-Mahbashi, Mohammed [1 ]
Li, Gang [2 ]
Peng, Yaxue [1 ]
Al-Soswa, Mohammed [3 ]
Debsi, Ali [4 ]
机构
[1] Changan Univ, Sch Elect & Control Engn, Xian 710064, Shaanxi, Peoples R China
[2] Changan Univ, Sch Energy & Elect Engn, Xian 710064, Shaanxi, Peoples R China
[3] Changan Univ, Sch Informat Engn, Xian 710064, Shaanxi, Peoples R China
[4] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Jiangsu, Peoples R China
关键词
Object detection; Yolov8; Driver distraction; Jetson; Embedded systems; Driver monitoring and warning system; BEHAVIOR; POINTS;
D O I
10.1061/JTEPBS.TEENG-8681
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Traffic accidents caused by drivers' actions are worrying since they result in significant losses of life and property. Due to the advancement of deep learning and computer vision technology, driver monitoring and assistance systems (DMASs) have gained widespread use to improve driving safety. Although numerous modern cars come equipped with advanced driver assistance systems (ADAS), most lack such integrated systems. This article introduces a mobile, image-focused DMAS designed for the immediate identification of driver distractions. The developed system uses the YOLOv8 algorithm due to its high accuracy and speed, which has undergone some improvements to increase the accuracy of real-time detection and renamed here GM-YOLOv8n. The system was trained and evaluated on data sets of seven categories, with approximately 6,008 images, by analyzing the face, eye, and mouth areas. In evaluation metrics, the model achieved an average accuracy of 98.90%, and the F1 score reached 98.00%, while the precision reached 97.90% and the recall reached 98.10% to evaluate the model's performance during validation. The system was then implemented on high-performance embedded platforms and standard computers to measure its effectiveness in real-time. Test runs on the Nvidia Jetson Xavier Nx revealed that the system could analyze visual information at a velocity of 43.17 frames per second, confirming its potential for instantaneous detection. This system aims to reduce the number of accidents and protect human life during transportation by detecting the driver's various states and issuing an audio alert. The detection results show the success of the proposed system, which classifies this work with high accuracy.
引用
收藏
页数:18
相关论文
共 59 条
[1]  
Abdul Jamsheed V., 2020, 2020 Third International Conference on Smart Systems and Inventive Technology (ICSSIT), P185, DOI 10.1109/ICSSIT48917.2020.9214233
[2]   Road traffic accidental injuries and deaths: A neglected global health issue [J].
Ahmed, Sirwan K. ;
Mohammed, Mona G. ;
Abdulqadir, Salar O. ;
El-Kader, Rabab G. Abd ;
El-Shall, Nahed A. ;
Chandran, Deepak ;
Rehman, Mohammad E. Ur ;
Dhama, Kuldeep .
HEALTH SCIENCE REPORTS, 2023, 6 (05)
[3]   Faster RCNN based robust vehicle detection algorithm for identifying and classifying vehicles [J].
Alam, Md Khorshed ;
Ahmed, Asif ;
Salih, Rania ;
Al Asmari, Abdullah Faiz Saeed ;
Khan, Mohammad Arsalan ;
Mustafa, Noman ;
Mursaleen, Mohammad ;
Islam, Saiful .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2023, 20 (05)
[4]  
[Anonymous], Distracted Driving | U Drive
[5]   Two-Stream Spatial-Temporal Graph Convolutional Networks for Driver Drowsiness Detection [J].
Bai, Jing ;
Yu, Wentao ;
Xiao, Zhu ;
Havyarimana, Vincent ;
Regan, Amelia C. ;
Jiang, Hongbo ;
Jiao, Licheng .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (12) :13821-13833
[6]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[7]  
CDC (Centers for Disease Control and Prevention), Distracted driving-Transportation safety-Injury center
[8]   Driver Fatigue Detection Based on Facial Key Points and LSTM [J].
Chen, Long ;
Xin, Guojiang ;
Liu, Yuling ;
Huang, Junwei .
SECURITY AND COMMUNICATION NETWORKS, 2021, 2021
[9]   SF-FWA: A Self-Adaptive Fast Fireworks Algorithm for effective large-scale optimization [J].
Chen, Maiyue ;
Tan, Ying .
SWARM AND EVOLUTIONARY COMPUTATION, 2023, 80
[10]  
Cho YJ, 2021, arXiv, DOI DOI 10.48550/ARXIV.2107.09858