Machine learning and deep learning techniques for driver fatigue and drowsiness detection: a review

被引:36
作者
Abd El-Nabi, Samy [1 ,2 ]
El-Shafai, Walid [1 ,3 ]
El-Rabaie, El-Sayed M. [1 ]
Ramadan, Khalil F. [1 ]
Abd El-Samie, Fathi E. [1 ,4 ]
Mohsen, Saeed [2 ,5 ]
机构
[1] Menoufia Univ, Fac Elect Engn, Dept Elect & Elect Commun Engn, Menoufia 32952, Egypt
[2] King Salman Int Univ KSIU, Fac Comp Sci & Engn, Dept Artificial Intelligence Engn, El Tor 46511, S Sinai, Egypt
[3] Prince Sultan Univ, Comp Sci Dept, Secur Engn Lab, Riyadh 11586, Saudi Arabia
[4] Princess Nourah Bint Abdulrahman Univ, Coll Comp & Informat Sci, Dept Informat Technol, POB 84428, Riyadh 11671, Saudi Arabia
[5] Al Madinah Higher Inst Engn & Technol, Dept Elect & Commun Engn, Giza 12947, Egypt
关键词
Drowsiness; Fatigue; Deep learning; Vehicle accidents; Yawning; Eye closure; Head movements; Facial expressions; Machine learning; MONITORING-SYSTEM; EEG; SLEEPINESS; PERFORMANCE; EXTRACTION; ALGORITHM; KNOWLEDGE; ALGEBRA; SCHEME; WHEEL;
D O I
10.1007/s11042-023-15054-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There are several factors for vehicle accidents during driving such as drivers' negligence, drowsiness, and fatigue. These accidents can be avoided, if drivers are warned in time. Moreover, recent developments in computer vision and artificial intelligence (AI) have helped to monitor drivers and alert them in case they are not concentrating on driving. The AI techniques can extract relevant features from expressions of driver's face, such as eye closure, yawning, and head movements to infer the level of sleepiness. In addition, they can acquire biological signals from the driver's body, and indications from the vehicle behavior. This paper provides a comprehensive review of the detection techniques of drowsiness and fatigue of drivers using machine learning (ML) and deep learning (DL). The current techniques for this application are classified into four categories: image- or video-based analysis during the driving, biological signal analysis for drivers, vehicle movement analysis, and hybrid techniques. A review of supervised techniques is presented for detecting fatigue and drowsiness on different datasets, with a comparison of the various techniques in terms of pros and cons. Results are presented in terms of accuracy of detection for each technique. The results are discussed according to the recent problems and challenges in this field. The paper also highlights the applicability and reliability of the different techniques. Furthermore, some suggestions are presented for the future work in the field of driver drowsiness detection (DDD).
引用
收藏
页码:9441 / 9477
页数:37
相关论文
共 150 条
[1]   Driver Fatigue Detection Systems Using Multi-Sensors, Smartphone, and Cloud-Based Computing Platforms: A Comparative Analysis [J].
Abbas, Qaisar ;
Alsheddy, Abdullah .
SENSORS, 2021, 21 (01) :1-38
[2]  
Abtahi S., 2014, P 5 ACM MULT SYST C, P24, DOI DOI 10.1145/2557642.2563678
[3]  
Adebisi OA, 2022, INT J ADV COMPUTER R, P19, DOI DOI 10.1007/978-981-16-8150-9_2
[4]  
Adeniyi JK., 2022, PARADIGMPLUS, V3, P1, DOI [10.55969/paradigmplus.v3n3a1, DOI 10.55969/PARADIGMPLUS.V3N3A1]
[5]  
Ajagbe S. A., 2022, INTELLIGENT HEALTHCA, P299, DOI [10.1007/978-981-16-8150-914, DOI 10.1007/978-981-16-8150-9_14, 10.1007/978-981-16-8150-9_14, DOI 10.1007/978-981-16-8150-914]
[6]  
Ajagbe SA., 2021, INT J ADV COMPUT RES, V11, P51, DOI [DOI 10.19101/IJACR.2021.1152001, 10.19101/ijacr.2021.1152001]
[7]  
Ajagbe SA, 2022, 2022 INT C ELECT COM, DOI [10.1109/ICECET55527.2022.9872568, DOI 10.1109/ICECET55527.2022.9872568]
[8]   A Review of Recent Developments in Driver Drowsiness Detection Systems [J].
Albadawi, Yaman ;
Takruri, Maen ;
Awad, Mohammed .
SENSORS, 2022, 22 (05)
[9]   Fatigue State Detection for Tired Persons in Presence of Driving Periods [J].
Alharbey, Riad ;
Dessouky, Mohamed M. ;
Sedik, Ahmed ;
Siam, Ali, I ;
Elaskily, Mohamed A. .
IEEE ACCESS, 2022, 10 :79403-79418
[10]  
Alioua N, 2011, LECT NOTES COMPUT SC, V6855, P397, DOI 10.1007/978-3-642-23678-5_47