Cognitive Workload Estimation Using Variational Autoencoder and Attention-Based Deep Model

被引:14
作者
Chakladar, Debashis Das [1 ]
Datta, Sumalyo [2 ]
Roy, Partha Pratim [1 ]
Prasad, Vinod A. [2 ]
机构
[1] Indian Inst Technol Roorkee, Dept Comp Sci & Engn, Roorkee 247667, India
[2] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
关键词
Convolutional block attention module (CBAM); convolutional neural network (CNN); electroencephalogram (EEG); long short-term memory (LSTM); variational autoen-coder (VAE); CLASSIFICATION;
D O I
10.1109/TCDS.2022.3163020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The estimation of cognitive workload using electroencephalogram (EEG) is an emerging research area. However, due to poor spatial resolution issues, features obtained from EEG signals often lead to poor classification results. As a good generative model, the variational autoencoder (VAE) extracts the noise-free robust features from the latent space that lead to better classification performance. The spatial attention-based method [convolutional block attention module (CBAM)] can improve the spatial resolution of EEG signals. In this article, we propose an effective VAE-CBAM-based deep model for estimating cognitive states from topographical videos. Topographical videos of four different conditions [baseline (BL), low workload (LW), medium workload (MW), and high workload (HW)] of the mental arithmetic task are taken for the experiment. Initially, the VAE extracts localized features from input images (extracted from topographical video), and CBAM infers the spatial-channel-level's attention features from those localized features. Finally, the deep CNN-BLSTM model effectively learns those attention-based spatial features in a timely distributed manner to classify the cognitive state. For four-class and two-class classifications, the proposed model achieves 83.13% and 92.09% classification accuracy, respectively. The proposed model enhances the future research scope of attention-based studies in EEG applications.
引用
收藏
页码:581 / 590
页数:10
相关论文
共 35 条
[1]   Distinguishing mental attention states of humans via an EEG-based passive BCI using machine learning methods [J].
Aci, Cigdem Ivan ;
Kaya, Murat ;
Mishchenko, Yuriy .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 134 :153-166
[2]   QUANTIFICATION OF MENTAL STRESS USING COMPLEXITY ANALYSIS OF EEG SIGNALS [J].
Ahammed, Kawser ;
Ahmed, Mosabber Uddin .
BIOMEDICAL ENGINEERING-APPLICATIONS BASIS COMMUNICATIONS, 2020, 32 (02)
[3]   Using Electroencephalography to Measure Cognitive Load [J].
Antonenko, Pavlo ;
Paas, Fred ;
Grabner, Roland ;
van Gog, Tamara .
EDUCATIONAL PSYCHOLOGY REVIEW, 2010, 22 (04) :425-438
[4]  
Ba JMY, 2015, Arxiv, DOI arXiv:1412.7755
[5]   EEG-Based Adaptive Driver-Vehicle Interface Using Variational Autoencoder and PI-TSVM [J].
Bi, Luzheng ;
Zhang, Jingwei ;
Lian, Jinling .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (10) :2025-2033
[6]   SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning [J].
Chen, Long ;
Zhang, Hanwang ;
Xiao, Jun ;
Nie, Liqiang ;
Shao, Jian ;
Liu, Wei ;
Chua, Tat-Seng .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6298-6306
[7]   EEG Classification of Motor Imagery Using a Novel Deep Learning Framework [J].
Dai, Mengxi ;
Zheng, Dezhi ;
Na, Rui ;
Wang, Shuai ;
Zhang, Shuailei .
SENSORS, 2019, 19 (03)
[8]   EEG-Based Cognitive State Classification and Analysis of Brain Dynamics Using Deep Ensemble Model and Graphical Brain Network [J].
Das Chakladar, Debashis ;
Roy, Partha Pratim ;
Iwamura, Masakazu .
IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (04) :1507-1519
[9]   EEG-Based Cognitive State Assessment Using Deep Ensemble Model and Filter Bank Common Spatial Pattern [J].
Das Chakladar, Debashis ;
Dey, Shubhashis ;
Roy, Partha Pratim ;
Iwamura, Masakazu .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :4107-4114
[10]   EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm [J].
Das Chakladar, Debashis ;
Dey, Shubhashis ;
Roy, Partha Pratim ;
Dogra, Debi Prosad .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 60