Investigating mental workload caused by NDRTs in highly automated driving with deep learning

被引:4
作者
Hu, Xintao [1 ]
Hu, Jing [1 ]
机构
[1] Hefei Univ Technol, Coll Mech Engn, Hefei 230041, Peoples R China
关键词
Highly automated driving; NDRTs; mental workload; deep learning; BRAIN-COMPUTER-INTERFACE; PERFORMANCE; TASKS;
D O I
10.1080/15389588.2023.2276657
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
ObjectiveThis study aimed to examine the impact of non-driving-related tasks (NDRTs) on drivers in highly automated driving scenarios and sought to develop a deep learning model for classifying mental workload using electroencephalography (EEG) signals.MethodsThe experiment involved recruiting 28 participants who engaged in simulations within a driving simulator while exposed to 4 distinct NDRTs: (1) reading, (2) listening to radio news, (3) watching videos, and (4) texting. EEG data collected during NDRTs were categorized into 3 levels of mental workload, high, medium, and low, based on the NASA Task Load Index (NASA-TLX) scores. Two deep learning methods, namely, long short-term memory (LSTM) and bidirectional long short-term memory (BLSTM), were employed to develop the classification model.ResultsA series of correlation analyses revealed that the channels and frequency bands are linearly correlated with mental workload. The comparative analysis of classification results demonstrates that EEG data featuring significantly correlated frequency bands exhibit superior classification accuracy compared to the raw EEG data.ConclusionsThis research offers a reference for assessing mental workload resulting from NDRTs in the context of highly automated driving. Additionally, it delves into the development of deep learning classifiers for EEG signals with heightened accuracy.
引用
收藏
页码:372 / 380
页数:9
相关论文
共 46 条
[1]   Perspective and coplanar cockpit displays of traffic information: Implications for maneuver choice, flight safety, and mental workload [J].
Alexander, AL ;
Wickens, CD ;
Merwin, DH .
INTERNATIONAL JOURNAL OF AVIATION PSYCHOLOGY, 2005, 15 (01) :1-21
[2]  
Almogbel MA, 2019, INT CONF ADV COMMUN, P1167, DOI [10.23919/icact.2019.8702048, 10.23919/ICACT.2019.8702048]
[3]   Take-over requests in highly automated driving: A crowdsourcing survey on auditory, vibrotactile, and visual displays [J].
Bazilinskyy, P. ;
Petermeijer, S. M. ;
Petrovych, V. ;
Dodou, D. ;
de Winter, J. C. F. .
TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2018, 56 :82-98
[4]   Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness [J].
Borghini, Gianluca ;
Astolfi, Laura ;
Vecchiato, Giovanni ;
Mattia, Donatella ;
Babiloni, Fabio .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2014, 44 :58-75
[5]   Psychophysiological responses to changes in workload during simulated air traffic control [J].
Brookings, JB ;
Wilson, GF ;
Swain, CR .
BIOLOGICAL PSYCHOLOGY, 1996, 42 (03) :361-377
[6]   Deep learning for electroencephalogram (EEG) classification tasks: a review [J].
Craik, Alexander ;
He, Yongtian ;
Contreras-Vidal, Jose L. .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (03)
[7]   EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm [J].
Das Chakladar, Debashis ;
Dey, Shubhashis ;
Roy, Partha Pratim ;
Dogra, Debi Prosad .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 60
[8]   EEG ACTIVATION PATTERNS DURING THE PERFORMANCE OF TASKS INVOLVING DIFFERENT COMPONENTS OF MENTAL CALCULATION [J].
FERNANDEZ, T ;
HARMONY, T ;
RODRIGUEZ, M ;
BERNAL, J ;
SILVA, J ;
REYES, A ;
MAROSI, E .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1995, 94 (03) :175-182
[9]   Electrophysiological, behavioral, and subjective indexes of workload when performing multiple tasks: manipulations of task difficulty and training [J].
Fournier, LR ;
Wilson, GF ;
Swain, CR .
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 1999, 31 (02) :129-145
[10]   Consideration of several mental workload categories: perspectives for elaboration of new ergonomic recommendations concerning shiftwork [J].
Galy, Edith .
THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2018, 19 (04) :483-497