Cross-Channel Specific-Mutual Feature Transfer Learning for Motor Imagery EEG Signals Decoding

被引:8
作者
Li, Donglin [1 ]
Wang, Jianhui [1 ]
Xu, Jiacan [2 ]
Fang, Xiaoke [1 ]
Ji, Ying [3 ]
机构
[1] Northeastern Univ, Dept Informat Sci & Engn, Shenyang 110000, Peoples R China
[2] Shenyang Jianzhu Univ, Coll Engn Training & Innovat, Shenyang 110000, Peoples R China
[3] Shenyang Ligong Univ, Coll Informat Sci & Engn, Shenyang 110000, Peoples R China
基金
中国国家自然科学基金;
关键词
Brain-computer interface (BCI); convolutional neural network (CNN); motor imagery (MI); training tricks; transfer learning; CONVOLUTIONAL NEURAL-NETWORKS; BRAIN-COMPUTER INTERFACES; DOMAIN ADAPTATION; CLASSIFICATION; SYSTEM;
D O I
10.1109/TNNLS.2023.3269512
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, with the rapid development of deep learning, various deep learning frameworks have been widely used in brain-computer interface (BCI) research for decoding motor imagery (MI) electroencephalogram (EEG) signals to understand brain activity accurately. The electrodes, however, record the mixed activities of neurons. If different features are directly embedded in the same feature space, the specific and mutual features of different neuron regions are not considered, which will reduce the expression ability of the feature itself. We propose a cross-channel specific-mutual feature transfer learning (CCSM-FT) network model to solve this problem. The multibranch network extracts the specific and mutual features of brain's multiregion signals. Effective training tricks are used to maximize the distinction between the two kinds of features. Suitable training tricks can also improve the effectiveness of the algorithm compared with novel models. Finally, we transfer two kinds of features to explore the potential of mutual and specific features to enhance the expressive power of the feature and use the auxiliary set to improve identification performance. The experimental results show that the network has a better classification effect in the BCI Competition IV-2a and the HGD datasets.
引用
收藏
页码:13472 / 13482
页数:11
相关论文
共 52 条
  • [1] Filter bank common spatial pattern algorithm on BCI competition IV Datasets 2a and 2b
    Ang, Kai Keng
    Chin, Zheng Yang
    Wang, Chuanchu
    Guan, Cuntai
    Zhang, Haihong
    [J]. FRONTIERS IN NEUROSCIENCE, 2012, 6
  • [2] Brain effective connectivity during motor-imagery and execution following stroke and rehabilitation
    Bajaj, Sahil
    Butler, Andrew J.
    Drake, Daniel
    Dhamala, Mukesh
    [J]. NEUROIMAGE-CLINICAL, 2015, 8 : 572 - 582
  • [3] Spatio-Spectral Feature Representation for Motor Imagery Classification Using Convolutional Neural Networks
    Bang, Ji-Seon
    Lee, Min-Ho
    Fazli, Siamac
    Guan, Cuntai
    Lee, Seong-Whan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (07) : 3038 - 3049
  • [4] The Berlin brain-computer interface: non-medical uses of BCI technology
    Blankertz, Benjamin
    Tangermann, Michael
    Vidaurre, Carmen
    Fazli, Siamac
    Sannelli, Claudia
    Haufe, Stefan
    Maeder, Cecilia
    Ramsey, Lenny
    Sturm, Irene
    Curio, Gabriel
    Mueller, Klaus-Robert
    [J]. FRONTIERS IN NEUROSCIENCE, 2010, 4
  • [5] Brain-computer interfaces for communication and rehabilitation
    Chaudhary, Ujwal
    Birbaumer, Niels
    Ramos-Murguialday, Ander
    [J]. NATURE REVIEWS NEUROLOGY, 2016, 12 (09) : 513 - 525
  • [6] Deep Temporal-Spatial Feature Learning for Motor Imagery-Based Brain-Computer Interfaces
    Chen, Junjian
    Yu, Zhuliang
    Gu, Zhenghui
    Li, Yuanqing
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (11) : 2356 - 2366
  • [7] Three-Layer Weighted Fuzzy Support Vector Regression for Emotional Intention Understanding in Human Robot Interaction
    Chen, Luefeng
    Zhou, Mengtian
    Wu, Min
    She, Jinhua
    Liu, Zhentao
    Dong, Fangyan
    Hirota, Kaoru
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (05) : 2524 - 2538
  • [8] EEG-Based Cross-Subject Driver Drowsiness Recognition With an Interpretable Convolutional Neural Network
    Cui, Jian
    Lan, Zirui
    Sourina, Olga
    Muller-Wittig, Wolfgang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7921 - 7933
  • [9] Dai PY, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P677
  • [10] Design of a Multimodal EEG-based Hybrid BCI System with Visual Servo Module
    Duan, Feng
    Lin, Dongxue
    Li, Wenyu
    Zhang, Zhao
    [J]. IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, 2015, 7 (04) : 332 - 341