Machine learning and deep learning techniques for driver fatigue and drowsiness detection: a review

被引:36
作者
Abd El-Nabi, Samy [1 ,2 ]
El-Shafai, Walid [1 ,3 ]
El-Rabaie, El-Sayed M. [1 ]
Ramadan, Khalil F. [1 ]
Abd El-Samie, Fathi E. [1 ,4 ]
Mohsen, Saeed [2 ,5 ]
机构
[1] Menoufia Univ, Fac Elect Engn, Dept Elect & Elect Commun Engn, Menoufia 32952, Egypt
[2] King Salman Int Univ KSIU, Fac Comp Sci & Engn, Dept Artificial Intelligence Engn, El Tor 46511, S Sinai, Egypt
[3] Prince Sultan Univ, Comp Sci Dept, Secur Engn Lab, Riyadh 11586, Saudi Arabia
[4] Princess Nourah Bint Abdulrahman Univ, Coll Comp & Informat Sci, Dept Informat Technol, POB 84428, Riyadh 11671, Saudi Arabia
[5] Al Madinah Higher Inst Engn & Technol, Dept Elect & Commun Engn, Giza 12947, Egypt
关键词
Drowsiness; Fatigue; Deep learning; Vehicle accidents; Yawning; Eye closure; Head movements; Facial expressions; Machine learning; MONITORING-SYSTEM; EEG; SLEEPINESS; PERFORMANCE; EXTRACTION; ALGORITHM; KNOWLEDGE; ALGEBRA; SCHEME; WHEEL;
D O I
10.1007/s11042-023-15054-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There are several factors for vehicle accidents during driving such as drivers' negligence, drowsiness, and fatigue. These accidents can be avoided, if drivers are warned in time. Moreover, recent developments in computer vision and artificial intelligence (AI) have helped to monitor drivers and alert them in case they are not concentrating on driving. The AI techniques can extract relevant features from expressions of driver's face, such as eye closure, yawning, and head movements to infer the level of sleepiness. In addition, they can acquire biological signals from the driver's body, and indications from the vehicle behavior. This paper provides a comprehensive review of the detection techniques of drowsiness and fatigue of drivers using machine learning (ML) and deep learning (DL). The current techniques for this application are classified into four categories: image- or video-based analysis during the driving, biological signal analysis for drivers, vehicle movement analysis, and hybrid techniques. A review of supervised techniques is presented for detecting fatigue and drowsiness on different datasets, with a comparison of the various techniques in terms of pros and cons. Results are presented in terms of accuracy of detection for each technique. The results are discussed according to the recent problems and challenges in this field. The paper also highlights the applicability and reliability of the different techniques. Furthermore, some suggestions are presented for the future work in the field of driver drowsiness detection (DDD).
引用
收藏
页码:9441 / 9477
页数:37
相关论文
共 150 条
[11]   Early Identification and Detection of Driver Drowsiness by Hybrid Machine Learning [J].
Altameem, Ayman ;
Kumar, Ankit ;
Poonia, Ramesh Chandra ;
Kumar, Sandeep ;
Saudagar, Abdul Khader Jilani .
IEEE ACCESS, 2021, 9 :162805-162819
[12]  
[Anonymous], 2019, VIDEO IMAGE DATABASE
[13]   Observer Rated Sleepiness and Real Road Driving: An Explorative Study [J].
Anund, Anna ;
Fors, Carina ;
Hallvig, David ;
Akerstedt, Torbjorn ;
Kecklund, Goran .
PLOS ONE, 2013, 8 (05)
[14]   The use of wearable devices in cognitive fatigue: current trends and future intentions [J].
Arachchige, Sachini N. K. Kodithuwakku ;
Burch, Reuben F., V ;
Chander, Harish ;
Turner, Alana J. ;
Knight, Adam C. .
THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2022, 23 (03) :374-386
[15]   Trends and Future Prospects of the Drowsiness Detection and Estimation Technology [J].
Arakawa, Toshiya .
SENSORS, 2021, 21 (23)
[16]   Driver Drowsiness Detection Based on Steering Wheel Data Applying Adaptive Neuro-Fuzzy Feature Selection [J].
Arefnezhad, Sadegh ;
Samiee, Sajjad ;
Eichberger, Arno ;
Nahvi, Ali .
SENSORS, 2019, 19 (04)
[17]  
Ashlin Deepa R., 2023, P INT C COGN INT COM, V2, P679
[18]   A Hybrid Approach to Detect Driver Drowsiness Utilizing Physiological Signals to Improve System Performance and Wearability [J].
Awais, Muhammad ;
Badruddin, Nasreen ;
Drieberg, Micheal .
SENSORS, 2017, 17 (09)
[19]   Contributions to driver fatigue detection based on eye-tracking [J].
Băiașu A.-M. ;
Dumitrescu C. .
1600, North Atlantic University Union NAUN (15) :1-7
[20]  
Bajaj Jaspreet Singh, 2022, ECS Transactions, V107, P4651, DOI 10.1149/10701.4651ecst