Sensor-Based Classification of Primary and Secondary Car Driver Activities Using Convolutional Neural Networks

被引:4
作者
Doniec, Rafal [1 ]
Konior, Justyna [1 ]
Siecinski, Szymon [1 ,2 ]
Piet, Artur [2 ]
Irshad, Muhammad Tausif [2 ,3 ]
Piaseczna, Natalia [1 ]
Hasan, Md Abid [2 ]
Li, Frederic [2 ]
Nisar, Muhammad Adeel [3 ]
Grzegorzek, Marcin [2 ,4 ]
机构
[1] Silesian Tech Univ, Fac Biomed Engn, Dept Biosensors & Proc Biomed Signals, Roosevelta 40, PL-41800 Zabrze, Poland
[2] Univ Lubeck, Inst Med Informat, Ratzeburger Allee 160, D-23562 Lubeck, Germany
[3] Univ Punjab, Dept Informat Technol, Lahore 54000, Pakistan
[4] Univ Econ Katowice, Dept Knowledge Engn, Bogucicka 3, PL-40287 Katowice, Poland
关键词
driving a car; driving behavior; electrooculography; convolutional neural networks; ACTIVITY RECOGNITION; FATIGUE;
D O I
10.3390/s23125551
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
To drive safely, the driver must be aware of the surroundings, pay attention to the road traffic, and be ready to adapt to new circumstances. Most studies on driving safety focus on detecting anomalies in driver behavior and monitoring cognitive capabilities in drivers. In our study, we proposed a classifier for basic activities in driving a car, based on a similar approach that could be applied to the recognition of basic activities in daily life, that is, using electrooculographic (EOG) signals and a one-dimensional convolutional neural network (1D CNN). Our classifier achieved an accuracy of 80% for the 16 primary and secondary activities. The accuracy related to activities in driving, including crossroad, parking, roundabout, and secondary activities, was 97.9%, 96.8%, 97.4%, and 99.5%, respectively. The F1 score for secondary driving actions (0.99) was higher than for primary driving activities (0.93-0.94). Furthermore, using the same algorithm, it was possible to distinguish four activities related to activities of daily life that were secondary activities when driving a car.
引用
收藏
页数:19
相关论文
共 70 条
[1]   Detection and Evaluation of Driver Distraction Using Machine Learning and Fuzzy Logic [J].
Aksjonov, Andrei ;
Nedoma, Pavel ;
Vodovozov, Valery ;
Petlenkov, Eduard ;
Herrmann, Martin .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (06) :2048-2059
[2]   A systematic review on sensor-based driver behaviour studies: coherent taxonomy, motivations, challenges, recommendations, substantial analysis and future directions [J].
Al-Hussein, Ward Ahmed ;
Kiah, Miss Laiha Mat ;
Yee, Por Lip ;
Zaidan, B. B. .
PEERJ COMPUTER SCIENCE, 2021, 7 :1-50
[3]   Distracted driver classification using deep learning [J].
Alotaibi, Munif ;
Alotaibi, Bandar .
SIGNAL IMAGE AND VIDEO PROCESSING, 2020, 14 (03) :617-624
[4]   Driver education: Enhancing knowledge of sleep, fatigue and risky behaviour to improve decision making in young drivers [J].
Alvaro, Pasquale K. ;
Burnett, Nicole M. ;
Kennedy, Gerard A. ;
Min, William Yu Xun ;
McMahon, Marcus ;
Barnes, Maree ;
Jackson, Melinda ;
Howard, Mark E. .
ACCIDENT ANALYSIS AND PREVENTION, 2018, 112 :77-83
[5]   DL Multi-sensor information fusion service selective information scheme for improving the Internet of Things based user responses [J].
AlZubi, A. Ahmad ;
Abugabah, Ahed ;
Al-Maitah, Mohammed ;
AlZobi, Firas Ibrahim .
MEASUREMENT, 2021, 185
[6]   Distracted driving in relation to risky road behaviors and traffic crashes in Bogota, Colombia [J].
Arevalo-Tamara, Andrea ;
Caicedo, Angela ;
Orozco-Fontalvo, Mauricio ;
Useche, Sergio A. .
SAFETY SCIENCE, 2022, 153
[7]  
Ariansyah Dedy, 2023, Procedia Computer Science, P221, DOI 10.1016/j.procs.2022.12.130
[8]  
Banerjee S, 2021, Arxiv, DOI arXiv:2112.12026
[9]   Activity recognition from user-annotated acceleration data [J].
Bao, L ;
Intille, SS .
PERVASIVE COMPUTING, PROCEEDINGS, 2004, 3001 :1-17
[10]   Automated driving safety - The art of conscious risk taking - minimum lateral distances to pedestrians [J].
Boeddeker, Bert ;
von Wendorff, Wilhard ;
Nam Nguyen ;
Diehl, Peter ;
Meertens, Roland ;
Johannson, Rolf .
PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), 2021, :1466-1471