EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm

被引:112
作者
Das Chakladar, Debashis [1 ]
Dey, Shubhashis [2 ]
Roy, Partha Pratim [1 ]
Dogra, Debi Prosad [3 ]
机构
[1] Indian Inst Technol Roorkee, Dept Comp Sci & Engn, Roorkee, Uttarakhand, India
[2] Inst Engn & Managament, Dept Comp Sci & Engn, Kolkata, India
[3] Indian Inst Technol Bhubaneswar, Sch Elect Sci, Bhubaneswar, India
关键词
Electroencephalogram; LSTM; Mental workload; GWO; BCI;
D O I
10.1016/j.bspc.2020.101989
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The mental workload can be estimated by monitoring different mental states from neural activity. The spectral power of EEG and Event-Related Potentials (ERPs) are the two mediums for monitoring the mental states. In this paper, we estimate the workload during the multitasking mental activities of human subjects. The estimation of mental workload is done using the "STEW" dataset [16]. The dataset consists of two tasks, namely "No task" and "simultaneous capacity (SIMKAP)-based multitasking activity". Different workload levels of two tasks have been estimated using the composite framework consists of Grey Wolf Optimizer (GWO) and deep neural network. GWO has been used to select optimized features related to mental activities. Other optimization techniques such as Genetic Algorithm (GA), Particle Swarm Optimization (PSO) are generally slower compared to the convergence rate of GWO. A deep hybrid model based on Bidirectional Long Short-Term Memory (BLSTM) and Long Short-Term Memory (LSTM) has been proposed for the classification of workload levels. The proposed deep model achieves 86.33% and 82.57% classification accuracy for "No task" and "SIMKAP-based multitasking activity," respectively. A judicious distinction between different workload levels at higher accuracy will essentially increase the performance of an operator, which effectively improves the efficiency of the Brain-Computer Interface (BCI) systems. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:10
相关论文
共 29 条
[1]   Towards multilevel mental stress assessment using SVM with ECOC: an EEG approach [J].
Al-shargie, Fares ;
Tang, Tong Boon ;
Badruddin, Nasreen ;
Kiguchi, Masashi .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2018, 56 (01) :125-136
[2]  
Nguyen A, 2015, PROC CVPR IEEE, P427, DOI 10.1109/CVPR.2015.7298640
[3]  
[Anonymous], 2015, ARXIV150508075
[4]  
Bajaj V., 2019, IEEE SENS J
[5]  
Blanco J. A., 2016, IEEE T COGN DEV SYST, V10, P373
[6]   Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness [J].
Borghini, Gianluca ;
Astolfi, Laura ;
Vecchiato, Giovanni ;
Mattia, Donatella ;
Babiloni, Fabio .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2014, 44 :58-75
[7]  
Bratfisch O., 2008, Simkap-simultankapazitat/multi-tasking
[8]   EEG index for control operators' mental fatigue monitoring using interactions between brain regions [J].
Charbonnier, Sylvie ;
Roy, Raphaelle N. ;
Bonnet, Stephane ;
Campagne, Aurelie .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 52 :91-98
[9]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197
[10]  
Fallahi M., 2016, J Ergonomics, V6, P1, DOI [DOI 10.4172/2165-7556, 10.4172/2165-7556, DOI 10.4172/2165-7556.1000181]