An improved model using convolutional sliding window-attention network for motor imagery EEG classification

被引:12
作者
Huang, Yuxuan [1 ]
Zheng, Jianxu [2 ,3 ]
Xu, Binxing [1 ]
Li, Xuhang [1 ]
Liu, Yu [1 ]
Wang, Zijian [1 ]
Feng, Hua [2 ,3 ]
Cao, Shiqi [4 ]
机构
[1] Donghua Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] Army Med Univ, Mil Med Univ 3, Southwest Hosp, Dept Neurosurg, Chongqing, Peoples R China
[3] Army Med Univ, Mil Med Univ 3, Southwest Hosp, State Key Lab Trauma Burn & Combined Injury, Chongqing, Peoples R China
[4] Chinese Peoples Liberat Army Gen Hosp, Med Ctr 6, TCM Clin Unit, Dept Orthopaed, Beijing, Peoples R China
基金
中央高校基本科研业务费专项资金资助;
关键词
EEG; motor imagery; brain computer interface; deep learning; CNN; attention;
D O I
10.3389/fnins.2023.1204385
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Introduction: The classification model of motor imagery-based electroencephalogram (MI-EEG) is a new human-computer interface pattern and a new neural rehabilitation assessment method for diseases such as Parkinson's and stroke. However, existing MI-EEG models often suffer from insufficient richness of spatiotemporal feature extraction, learning ability, and dynamic selection ability.Methods: To solve these problems, this work proposed a convolutional sliding window-attention network (CSANet) model composed of novel spatiotemporal convolution, sliding window, and two-stage attention blocks.Results: The model outperformed existing state-of-the-art (SOTA) models in within-and between-individual classification tasks on commonly used MI-EEG datasets BCI-2a and Physionet MI-EEG, with classification accuracies improved by 4.22 and 2.02%, respectively.Discussion: The experimental results also demonstrated that the proposed type token, sliding window, and local and global multi-head self-attention mechanisms can significantly improve the model's ability to construct, learn, and adaptively select multi-scale spatiotemporal features in MI-EEG signals, and accurately identify electroencephalogram signals in the unilateral motor area. This work provided a novel and accurate classification model for MI-EEG brain-computer interface tasks and proposed a feasible neural rehabilitation assessment scheme based on the model, which could promote the further development and application of MI-EEG methods in neural rehabilitation.
引用
收藏
页数:17
相关论文
共 50 条
[31]   EEG temporal information-based 1-D convolutional neural network for motor imagery classification [J].
Chu, Chaoqin ;
Xiao, Qinkun ;
Chang, Leran ;
Shen, Jianing ;
Zhang, Na ;
Du, Yu ;
Xing, Heng ;
Gao, Hui .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (29) :45747-45767
[32]   EEG temporal information-based 1-D convolutional neural network for motor imagery classification [J].
Chaoqin Chu ;
Qinkun Xiao ;
Leran Chang ;
Jianing Shen ;
Na Zhang ;
Yu Du ;
Heng Xing ;
Hui Gao .
Multimedia Tools and Applications, 2023, 82 :45747-45767
[33]   SincMSNet: a Sinc filter convolutional neural network for EEG motor imagery classification [J].
Liu, Ke ;
Yang, Mingzhao ;
Xing, Xin ;
Yu, Zhuliang ;
Wu, Wei .
JOURNAL OF NEURAL ENGINEERING, 2023, 20 (05)
[34]   Attention based Inception model for robust EEG motor imagery classification [J].
Amin, Syed Umar ;
Altaheri, Hamdi ;
Muhammad, Ghulam ;
Alsulaiman, Mansour ;
Abdul, Wadood .
2021 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC 2021), 2021,
[35]   Electroencephalogram-Based Motor Imagery Signals Classification Using a Multi-Branch Convolutional Neural Network Model with Attention Blocks [J].
Altuwaijri, Ghadir Ali ;
Muhammad, Ghulam .
BIOENGINEERING-BASEL, 2022, 9 (07)
[36]   Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model [J].
Yu, Shiqi ;
Wang, Zedong ;
Wang, Fei ;
Chen, Kai ;
Yao, Dezhong ;
Xu, Peng ;
Zhang, Yong ;
Wang, Hesong ;
Zhang, Tao .
CEREBRAL CORTEX, 2024, 34 (02)
[37]   Classification of Motor Imagery EEG Signals Based on Deep Autoencoder and Convolutional Neural Network Approach [J].
Hwaidi, Jamal F. ;
Chen, Thomas M. .
IEEE ACCESS, 2022, 10 :48071-48081
[38]   Motor imagery EEG classification algorithm based on improved lightweight feature fusion network [J].
Yu, Zihang ;
Chen, Wanzhong ;
Zhang, Tao .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 75
[39]   A New Convolutional Neural Network for Motor Imagery Classification [J].
Zhang, Ruilong ;
Gong, Qun ;
Zhao, Xinyi .
PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, :8428-8432
[40]   Recurrent convolutional neural network model based on temporal and spatial feature for motor imagery classification [J].
Lee, Seung-Bo ;
Kim, Hakseung ;
Jeong, Ji-Hoon ;
Wang, In-Nea ;
Lee, Seong-Whan ;
Kim, Dong-Joo .
2019 7TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2019, :152-155