TDLNet: Transfer Data Learning Network for Cross-Subject Classification Based on Multiclass Upper Limb Motor Imagery EEG

被引:8
作者
Bi, Jingfeng [1 ]
Chu, Ming [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Automat, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Brain-computer interface; deep learning; electroencephalogram; motor imagery; CONVOLUTIONAL NEURAL-NETWORKS; INTERFACE; SELECTION;
D O I
10.1109/TNSRE.2023.3323509
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The limited number of brain-computer interface based on motor imagery (MI-BCI) instruction sets for different movements of single limbs makes it difficult to meet practical application requirements. Therefore, designing a single-limb, multi-category motor imagery (MI) paradigm and effectively decoding it is one of the important research directions in the future development of MI-BCI. Furthermore, one of the major challenges in MI-BCI is the difficulty of classifying brain activity across different individuals. In this article, the transfer data learning network (TDLNet) is proposed to achieve the cross-subject intention recognition for multiclass upper limb motor imagery. In TDLNet, the Transfer Data Module (TDM) is used to process cross-subject electroencephalogram (EEG) signals in groups and then fuse cross-subject channel features through two one-dimensional convolutions. The Residual Attention Mechanism Module (RAMM) assigns weights to each EEG signal channel and dynamically focuses on the EEG signal channels most relevant to a specific task. Additionally, a feature visualization algorithm based on occlusion signal frequency is proposed to qualitatively analyze the proposed TDLNet. The experimental results show that TDLNet achieves the best classification results on two datasets compared to CNN-based reference methods and transfer learning method. In the 6-class scenario, TDLNet obtained an accuracy of 65%+/- 0.05 on the UML6 dataset and 63%+/- 0.06 on the GRAZ dataset. The visualization results demonstrate that the proposed framework can produce distinct classifier patterns for multiple categories of upper limb motor imagery through signals of different frequencies.
引用
收藏
页码:3958 / 3967
页数:10
相关论文
共 43 条
[31]   Deep Learning With Convolutional Neural Networks for EEG Decoding and Visualization [J].
Schirrmeister, Robin Tibor ;
Springenberg, Jost Tobias ;
Fiederer, Lukas Dominique Josef ;
Glasstetter, Martin ;
Eggensperger, Katharina ;
Tangermann, Michael ;
Hutter, Frank ;
Burgard, Wolfram ;
Ball, Tonio .
HUMAN BRAIN MAPPING, 2017, 38 (11) :5391-5420
[32]   Decoding Multi-Class Motor Imagery and Motor Execution Tasks Using Riemannian Geometry Algorithms on Large EEG Datasets [J].
Shuqfa, Zaid ;
Belkacem, Abdelkader Nasreddine ;
Lakas, Abderrahmane .
SENSORS, 2023, 23 (11)
[33]   Improving the Separability of Motor Imagery EEG Signals Using a Cross Correlation-Based Least Square Support Vector Machine for Brain-Computer Interface [J].
Siuly, Siuly ;
Li, Yan .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2012, 20 (04) :526-538
[34]   A novel deep learning approach for classification of EEG motor imagery signals [J].
Tabar, Yousef Rezaei ;
Halici, Ugur .
JOURNAL OF NEURAL ENGINEERING, 2017, 14 (01)
[35]   Brainstorm: A User-Friendly Application for MEG/EEG Analysis [J].
Tadel, Francois ;
Baillet, Sylvain ;
Mosher, John C. ;
Pantazis, Dimitrios ;
Leahy, Richard M. .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2011, 2011
[36]   Spiking Neural Networks applied to the classification of motor tasks in EEG signals [J].
Virgilio G, Carlos D. ;
Sossa A, Juan H. ;
Antelis, Javier M. ;
Falcon, Luis E. .
NEURAL NETWORKS, 2020, 122 :130-143
[37]   Discriminative Feature Extraction via Multivariate Linear Regression for SSVEP-Based BCI [J].
Wang, Haiqiang ;
Zhang, Yu ;
Waytowich, Nicholas R. ;
Krusienski, Dean J. ;
Zhou, Guoxu ;
Jin, Jing ;
Wang, Xingyu ;
Cichocki, Andrzej .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2016, 24 (05) :532-541
[38]   EEG-Based Motor Imagery Recognition Framework via Multisubject Dynamic Transfer and Iterative Self-Training [J].
Wang, He ;
Chen, Peiyin ;
Zhang, Meng ;
Zhang, Jianbo ;
Sun, Xinlin ;
Li, Mengyu ;
Yang, Xiong ;
Gao, Zhongke .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) :10698-10712
[39]   A Parallel Multiscale Filter Bank Convolutional Neural Networks for Motor Imagery EEG Classification [J].
Wu, Hao ;
Niu, Yi ;
Li, Fu ;
Li, Yuchen ;
Fu, Boxun ;
Shi, Guangming ;
Dong, Minghao .
FRONTIERS IN NEUROSCIENCE, 2019, 13
[40]   The unilateral upper limb classification from fMRI-weighted EEG signals using convolutional neural network [J].
Yang, Banghua ;
Ma, Jun ;
Qiu, Wenzheng ;
Zhang, Jian ;
Wang, Xiaofan .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 78