Real-time Driver Drowsiness Detection using CNN, MediaPipe, and ML classifiers

被引:0
作者
Joshi, Puskar [1 ]
Adhikari, Manoj [1 ]
Shrestha, Sameep [2 ]
Shaik, Shehenaz [1 ]
机构
[1] E Tennessee State Univ, Dept Comp, Johnson City, TN 37614 USA
[2] George Mason Univ, Dept Comp Sci, Fairfax, VA USA
来源
SOUTHEASTCON 2025 | 2025年
关键词
Drowsiness Detection; Machine Learning; Deep Learning; MediaPipe; Transfer Learning;
D O I
10.1109/SOUTHEASTCON56624.2025.10971270
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Driver Drowsiness is among the primary reasons for road accidents. It poses a potential threat to the drivers, passengers and individuals involved in traffic. To address this critical issue, this paper explores the efficacy of driver drowsiness detection using deep learning (DL) and machine learning (ML) techniques to develop robust systems that enhance road safety. Transfer learning is performed on the robust pretrained Convolutional Neural Network (CNN) models- VGG16 and ResNet50 on image dataset. ResNet50 outperformed VGG16 achieving 95% of validation accuracy when trained with a similar model architecture. As an alternative approach, the study explores the efficacy of traditional classifiers on facial features extracted from the same image dataset used for transfer learning. Feature extraction is performed using MediaPipe Face Land marker model. A total of fifty-two (52) facial numerical features-such as eye blink rate, eye openness, eye squint, and jaw openness-are extracted from driver's images. These features are then trained and evaluated using traditional classifiers such as Random Forest, Gaussian Naive Bayes, Support Vector Classification (SVC), Decision Tree, XgBoost and a Multi-Layer Perceptron (MLP) neural network with and without Principal Component Analysis (PCA). Random Forest achieved test accuracy of 97%, the highest among all the models when trained without performing PCA. The study showcases the influence of data format, model architecture, and hyper parameter tuning on model performance. This work also emphasizes the potential for developing a robust drowsiness detection system by adapting trained models to classify video frames in real time. Such a system holds promises for significantly improving road safety and addressing the critical issue of drowsy driving.
引用
收藏
页码:589 / 594
页数:6
相关论文
共 29 条
[1]   PERCLOS-based technologies for detecting drowsiness: current evidence and future directions [J].
Abe, Takashi .
SLEEP ADVANCES, 2023, 4 (01)
[2]  
Adhikari M., 2025, SoutheastCon
[3]   A Review of Recent Developments in Driver Drowsiness Detection Systems [J].
Albadawi, Yaman ;
Takruri, Maen ;
Awad, Mohammed .
SENSORS, 2022, 22 (05)
[4]  
Alhola Paula, 2007, Neuropsychiatr Dis Treat, V3, P553
[5]  
Babaeian M, 2016, 2016 IEEE GREEN ENERGY AND SYSTEMS CONFERENCE (IGSEC)
[6]   System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures [J].
Bajaj, Jaspreet Singh ;
Kumar, Naveen ;
Kaushal, Rajesh Kumar ;
Gururaj, H. L. ;
Flammini, Francesco ;
Natarajan, Rajesh .
SENSORS, 2023, 23 (03)
[7]   A Framework for Instantaneous Driver Drowsiness Detection Based on Improved HOG Features and Naive Bayesian Classification [J].
Bakheet, Samy ;
Al-Hamadi, Ayoub .
BRAIN SCIENCES, 2021, 11 (02) :1-15
[8]  
Cellini Nicola, 2023, Int J Environ Res Public Health, V20, DOI 10.3390/ijerph20054003
[9]   XGBoost: A Scalable Tree Boosting System [J].
Chen, Tianqi ;
Guestrin, Carlos .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :785-794
[10]  
Choi I.H., 2015, Appl. Math. Inf. Sci, V9, P505, DOI [10.12785/amis/092L25, DOI 10.12785/AMIS/092L25]