TDLNet: Transfer Data Learning Network for Cross-Subject Classification Based on Multiclass Upper Limb Motor Imagery EEG

被引:8
作者
Bi, Jingfeng [1 ]
Chu, Ming [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Automat, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
Brain-computer interface; deep learning; electroencephalogram; motor imagery; CONVOLUTIONAL NEURAL-NETWORKS; INTERFACE; SELECTION;
D O I
10.1109/TNSRE.2023.3323509
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The limited number of brain-computer interface based on motor imagery (MI-BCI) instruction sets for different movements of single limbs makes it difficult to meet practical application requirements. Therefore, designing a single-limb, multi-category motor imagery (MI) paradigm and effectively decoding it is one of the important research directions in the future development of MI-BCI. Furthermore, one of the major challenges in MI-BCI is the difficulty of classifying brain activity across different individuals. In this article, the transfer data learning network (TDLNet) is proposed to achieve the cross-subject intention recognition for multiclass upper limb motor imagery. In TDLNet, the Transfer Data Module (TDM) is used to process cross-subject electroencephalogram (EEG) signals in groups and then fuse cross-subject channel features through two one-dimensional convolutions. The Residual Attention Mechanism Module (RAMM) assigns weights to each EEG signal channel and dynamically focuses on the EEG signal channels most relevant to a specific task. Additionally, a feature visualization algorithm based on occlusion signal frequency is proposed to qualitatively analyze the proposed TDLNet. The experimental results show that TDLNet achieves the best classification results on two datasets compared to CNN-based reference methods and transfer learning method. In the 6-class scenario, TDLNet obtained an accuracy of 65%+/- 0.05 on the UML6 dataset and 63%+/- 0.06 on the GRAZ dataset. The visualization results demonstrate that the proposed framework can produce distinct classifier patterns for multiple categories of upper limb motor imagery through signals of different frequencies.
引用
收藏
页码:3958 / 3967
页数:10
相关论文
共 43 条
[1]   Brain-Computer Interface for Neurorehabilitation of Upper Limb After Stroke [J].
Ang, Kai Keng ;
Guan, Cuntai .
PROCEEDINGS OF THE IEEE, 2015, 103 (06) :944-953
[2]   Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers [J].
Atkinson, John ;
Campos, Daniel .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 47 :35-41
[3]   A Single-Channel Consumer-Grade EEG Device for Brain-Computer Interface: Enhancing Detection of SSVEP and Its Amplitude Modulation [J].
Autthasan, Phairot ;
Du, Xiangqian ;
Arnin, Jetsada ;
Lamyai, Sirakorn ;
Perera, Maneesha ;
Itthipuripat, Sirawaj ;
Yagi, Tohru ;
Manoonpong, Poramate ;
Wilaiprasitporn, Theerawit .
IEEE SENSORS JOURNAL, 2020, 20 (06) :3366-3378
[4]   Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces [J].
Cecotti, Hubert ;
Graeser, Axel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (03) :433-445
[5]   Decoding EEG Rhythms During Action Observation, Motor Imagery, and Execution for Standing and Sitting [J].
Chaisaen, Rattanaphon ;
Autthasan, Phairot ;
Mingchinda, Nopparada ;
Leelaarporn, Pitshaporn ;
Kunaseth, Narin ;
Tammajarung, Suppakorn ;
Manoonpong, Poramate ;
Mukhopadhyay, Subhas Chandra ;
Wilaiprasitporn, Theerawit .
IEEE SENSORS JOURNAL, 2020, 20 (22) :13776-13786
[6]   Brain-computer interfaces for communication and rehabilitation [J].
Chaudhary, Ujwal ;
Birbaumer, Niels ;
Ramos-Murguialday, Ander .
NATURE REVIEWS NEUROLOGY, 2016, 12 (09) :513-525
[7]   EEG-Based Mental Workload Neurometric to Evaluate the Impact of Different Traffic and Road Conditions in Real Driving Settings [J].
Di Flumeri, Gianluca ;
Borghini, Gianluca ;
Arico, Pietro ;
Sciaraffa, Nicolina ;
Lanzi, Paola ;
Pozzi, Simone ;
Vignali, Valeria ;
Lantieri, Claudio ;
Bichicchi, Arianna ;
Simone, Andrea ;
Babiloni, Fabio .
FRONTIERS IN HUMAN NEUROSCIENCE, 2018, 12
[8]   EEG Source Imaging Enhances the Decoding of Complex Right-Hand Motor Imagery Tasks [J].
Edelman, Bradley J. ;
Baxter, Bryan ;
He, Bin .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2016, 63 (01) :4-14
[9]   Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI [J].
Fahimi, Fatemeh ;
Zhang, Zhuo ;
Goh, Wooi Boon ;
Lee, Tih-Shi ;
Ang, Kai Keng ;
Guan, Cuntai .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (02)
[10]   Multiple channel detection of steady-state visual evoked potentials for brain-computer interfaces [J].
Friman, Ola ;
Volosyak, Ivan ;
Graeser, Axel .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2007, 54 (04) :742-750