Multiattention Adaptation Network for Motor Imagery Recognition

被引:34
作者
Chen, Peiyin [1 ]
Gao, Zhongke [1 ]
Yin, Miaomiao [2 ]
Wu, Jialing [3 ]
Ma, Kai [4 ]
Grebogi, Celso [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Tianjin Huanhu Hosp, Dept Rehabil, Tianjin 300350, Peoples R China
[3] Tianjin Huanhu Hosp, Tianjin Neurosurg Inst, Dept Neurorehabil & Neurol, Tianjin Key Lab Cerebral Vasc & Neurodegenerat Di, Tianjin 300350, Peoples R China
[4] Tencent, Jarvis Lab, Shenzhen 518057, Guangdong, Peoples R China
[5] Univ Aberdeen, Kings Coll, Inst Complex Syst & Math Biol, Aberdeen AB24 3UE, Scotland
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2022年 / 52卷 / 08期
基金
中国国家自然科学基金;
关键词
Electroencephalography; Feature extraction; Training; Task analysis; Transfer learning; Signal resolution; Deep learning; Brain-computer interface (BCI); electroencephalogram (EEG); motor imagery (MI); multiple attentions mechanism; transfer learning; EEG; SELECTION; HAND;
D O I
10.1109/TSMC.2021.3114145
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Brain-computer interface (BCI) based on motor imagery electroencephalogram (EEG) has been widely used in various applications. Despite the previous efforts, the remained major challenges are effective feature extraction and the time-consuming calibration procedure. To address these issues, a novel multiattention adaptation network integrating the multiple attention mechanism and transfer learning is proposed to classify the EEG signals. First, the multiattention layer is introduced to automatically capture the dominant brain regions relevant to mental tasks without incorporating any prior knowledge about the physiology. Then, a multiattention convolutional neural network is employed to extract deep representation from raw EEG signals. Especially, a domain discriminator is applied to deep representation to reduce the differences between sessions for target subjects. The extensive experiments are conducted on three public EEG datasets (Dataset IIa and IIb of BCI Competition IV, and High Gamma dataset), achieving the competitive performance with average classification accuracy of 81.48%, 82.54%, and 93.97%, respectively. All the results outperform the state-of-the-art algorithms demonstrate the effectiveness and robustness of the proposed method. Importantly, we confirm that it is easier and more appropriate to transfer the information from local brain regions than from the whole brain. This enhances the transfer ability of deep features and, hence, it improves the performance of BCI systems.
引用
收藏
页码:5127 / 5139
页数:13
相关论文
共 55 条
  • [1] Filter bank common spatial pattern algorithm on BCI competition IV Datasets 2a and 2b
    Ang, Kai Keng
    Chin, Zheng Yang
    Wang, Chuanchu
    Guan, Cuntai
    Zhang, Haihong
    [J]. FRONTIERS IN NEUROSCIENCE, 2012, 6
  • [2] [Anonymous], 2018, Journal of Neural Engineering, DOI DOI 10.1088/1741-2552/AACE8CHTTPS://IOPSCIENCE.IOP.ORG/ARTICLE/10.1088/1741-2552/AACE8C/META
  • [3] A theory of learning from different domains
    Ben-David, Shai
    Blitzer, John
    Crammer, Koby
    Kulesza, Alex
    Pereira, Fernando
    Vaughan, Jennifer Wortman
    [J]. MACHINE LEARNING, 2010, 79 (1-2) : 151 - 175
  • [4] Large-Scale Machine Learning with Stochastic Gradient Descent
    Bottou, Leon
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 177 - 186
  • [5] Brunner C., 2008, I KNOWL DISC LAB BRA
  • [6] Unsupervised Domain Adaptation With Adversarial Residual Transform Networks
    Cai, Guanyu
    Wang, Yuqin
    He, Lianghua
    Zhou, MengChu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (08) : 3073 - 3086
  • [7] Caruana R, 2001, ADV NEUR IN, V13, P402
  • [8] Common Spatial Patterns Based on the Quantized Minimum Error Entropy Criterion
    Chen, Badong
    Li, Yuanhao
    Dong, Jiyao
    Lu, Na
    Qin, Jing
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (11): : 4557 - 4568
  • [9] Donahue J, 2014, PR MACH LEARN RES, V32
  • [10] FENG JK, 2019, COMPUT INTEL NEUROSC, P1