Transfer Learning With Optimal Transportation and Frequency Mixup for EEG-Based Motor Imagery Recognition

被引:22
作者
Chen, Peiyin [1 ]
Wang, He [1 ]
Sun, Xinlin [1 ]
Li, Haoyu [1 ]
Grebogi, Celso [2 ]
Gao, Zhongke [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Aberdeen, Kings Coll, Inst Complex Syst & Math Biol, Aberdeen AB24 3UE, Scotland
基金
中国国家自然科学基金;
关键词
Electroencephalography; Brain modeling; Transfer learning; Frequency-domain analysis; Transportation; Adaptation models; Feature extraction; Electroencephalogram (EEG); brain-computer interface (BCI); transfer learning; optimal transportation; BRAIN-COMPUTER-INTERFACE; DOMAIN ADAPTATION; NETWORKS; PATTERNS;
D O I
10.1109/TNSRE.2022.3211881
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Electroencephalography-based Brain Computer Interfaces (BCIs) invariably have a degenerate performance due to the considerable individual variability. To address this problem, we develop a novel domain adaptation method with optimal transport and frequency mixup for cross-subject transfer learning in motor imagery BCIs. Specifically, the preprocessed EEG signals from source and target domain are mapped into latent space with an embedding module, where the representation distributions and label distributions across domains have a large discrepancy. We assume that there exists a non-linear coupling matrix between both domains, which can be utilized to estimate the distance of joint distributions for different domains. Depending on the optimal transport, the Wasserstein distance between source and target domains is minimized, yielding the alignment of joint distributions. Moreover, a new mixup strategy is also introduced to generalize the model, where the inputs trials are mixed in frequency domain rather than in raw space. The extensive experiments on three evaluation benchmarks are conducted to validate the proposed framework. All the results demonstrate that our method achieves a superior performance than previous state-of-the-art domain adaptation approaches.
引用
收藏
页码:2866 / 2875
页数:10
相关论文
共 58 条
[21]  
Jiang X., 2019, BIOMED CIRC SYST C, P1
[22]   A large electroencephalographic motor imagery dataset for electroencephalographic brain computer interfaces [J].
Kaya, Murat ;
Binli, Mustafa Kemal ;
Ozbay, Erkan ;
Yanar, Hilmi ;
Mishchenko, Yuriy .
SCIENTIFIC DATA, 2018, 5
[23]  
Kim JH, 2020, PR MACH LEARN RES, V119
[24]   A Survey on Deep Learning-Based Short/Zero-Calibration Approaches for EEG-Based Brain-Computer Interfaces [J].
Ko, Wonjun ;
Jeon, Eunjin ;
Jeong, Seungwoo ;
Phyo, Jaeun ;
Suk, Heung-Il .
FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
[25]   Thinker invariance: enabling deep neural networks for BCI across more people [J].
Kostas, Demetres ;
Rudzicz, Frank .
JOURNAL OF NEURAL ENGINEERING, 2020, 17 (05)
[26]  
Krell MM, 2017, IEEE ENG MED BIO, P471, DOI 10.1109/EMBC.2017.8036864
[27]   Data augmentation for deep-learning-based electroencephalography [J].
Lashgari, Elnaz ;
Liang, Dehua ;
Maoz, Uri .
JOURNAL OF NEUROSCIENCE METHODS, 2020, 346
[28]   EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces [J].
Lawhern, Vernon J. ;
Solon, Amelia J. ;
Waytowich, Nicholas R. ;
Gordon, Stephen M. ;
Hung, Chou P. ;
Lance, Brent J. .
JOURNAL OF NEURAL ENGINEERING, 2018, 15 (05)
[29]   A Study on the Content of Mental and Physical Stability Game in Virtual Reality through EEG Detection [J].
Lee, Jongwon ;
Lee, Dayeon ;
Jeong, Incheol ;
Cho, Jinsoo .
12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, :693-696
[30]  
Leeb R., 2008, BCI Competition 2008Graz Data Set B, V16, P1