Multiattention Adaptation Network for Motor Imagery Recognition

被引:34
作者
Chen, Peiyin [1 ]
Gao, Zhongke [1 ]
Yin, Miaomiao [2 ]
Wu, Jialing [3 ]
Ma, Kai [4 ]
Grebogi, Celso [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Tianjin Huanhu Hosp, Dept Rehabil, Tianjin 300350, Peoples R China
[3] Tianjin Huanhu Hosp, Tianjin Neurosurg Inst, Dept Neurorehabil & Neurol, Tianjin Key Lab Cerebral Vasc & Neurodegenerat Di, Tianjin 300350, Peoples R China
[4] Tencent, Jarvis Lab, Shenzhen 518057, Guangdong, Peoples R China
[5] Univ Aberdeen, Kings Coll, Inst Complex Syst & Math Biol, Aberdeen AB24 3UE, Scotland
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2022年 / 52卷 / 08期
基金
中国国家自然科学基金;
关键词
Electroencephalography; Feature extraction; Training; Task analysis; Transfer learning; Signal resolution; Deep learning; Brain-computer interface (BCI); electroencephalogram (EEG); motor imagery (MI); multiple attentions mechanism; transfer learning; EEG; SELECTION; HAND;
D O I
10.1109/TSMC.2021.3114145
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Brain-computer interface (BCI) based on motor imagery electroencephalogram (EEG) has been widely used in various applications. Despite the previous efforts, the remained major challenges are effective feature extraction and the time-consuming calibration procedure. To address these issues, a novel multiattention adaptation network integrating the multiple attention mechanism and transfer learning is proposed to classify the EEG signals. First, the multiattention layer is introduced to automatically capture the dominant brain regions relevant to mental tasks without incorporating any prior knowledge about the physiology. Then, a multiattention convolutional neural network is employed to extract deep representation from raw EEG signals. Especially, a domain discriminator is applied to deep representation to reduce the differences between sessions for target subjects. The extensive experiments are conducted on three public EEG datasets (Dataset IIa and IIb of BCI Competition IV, and High Gamma dataset), achieving the competitive performance with average classification accuracy of 81.48%, 82.54%, and 93.97%, respectively. All the results outperform the state-of-the-art algorithms demonstrate the effectiveness and robustness of the proposed method. Importantly, we confirm that it is easier and more appropriate to transfer the information from local brain regions than from the whole brain. This enhances the transfer ability of deep features and, hence, it improves the performance of BCI systems.
引用
收藏
页码:5127 / 5139
页数:13
相关论文
共 55 条
  • [21] On the Utility of Power Spectral Techniques With Feature Selection Techniques for Effective Mental Task Classification in Noninvasive BCI
    Gupta, Akshansh
    Agrawal, Ramesh Kumar
    Kirar, Jyoti Singh
    Andreu-Perez, Javier
    Ding, Wei-Ping
    Lin, Chin-Teng
    Prasad, Mukesh
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (05): : 3080 - 3092
  • [22] Cross-Subject EEG Signal Recognition Using Deep Domain Adaptation Network
    Hang, Wenlong
    Feng, Wei
    Du, Ruoyu
    Liang, Shuang
    Chen, Yan
    Wang, Qiong
    Liu, Xuejun
    [J]. IEEE ACCESS, 2019, 7 : 128273 - 128282
  • [23] Hassanien A. E., 2015, INTEL SYST REF LIBR, P31, DOI DOI 10.1007/978-3-319-10978-7
  • [24] Common Bayesian Network for Classification of EEG-Based Multiclass Motor Imagery BCI
    He, Lianghua
    Hu, Die
    Wan, Meng
    Wen, Ying
    von Deneen, Karen M.
    Zhou, MengChu
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2016, 46 (06): : 843 - 854
  • [25] A Wireless BCI and BMI System for Wearable Robots
    He, Wei
    Zhao, Yue
    Tang, Haoyue
    Sun, Changyin
    Fu, Wei
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2016, 46 (07): : 936 - 946
  • [26] Domain Adaptation with Source Selection for Motor-Imagery based BCI
    Jeon, Eunjin
    Ko, Wonjun
    Suk, Heung-Il
    [J]. 2019 7TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2019, : 134 - 137
  • [27] A Broadband Metamaterial Polarization Converter Based on Split Ring Resonators
    Jiang, Xiaonan
    Zhong, Pinyuan
    Zhang, Qingfeng
    Rashid, Amir Khurrum
    [J]. 2019 CROSS STRAIT QUAD-REGIONAL RADIO SCIENCE AND WIRELESS TECHNOLOGY CONFERENCE (CSQRWC), 2019,
  • [28] Support vector channel selection in BCI
    Lal, TN
    Schröder, M
    Hinterberger, T
    Weston, J
    Bogdan, M
    Birbaumer, N
    Schölkopf, B
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2004, 51 (06) : 1003 - 1010
  • [29] Leeb R., 2008, I KNOWL DISC LAB BRA
  • [30] Li Y, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P1561