Transfer Learning With Optimal Transportation and Frequency Mixup for EEG-Based Motor Imagery Recognition

被引:22
作者
Chen, Peiyin [1 ]
Wang, He [1 ]
Sun, Xinlin [1 ]
Li, Haoyu [1 ]
Grebogi, Celso [2 ]
Gao, Zhongke [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Aberdeen, Kings Coll, Inst Complex Syst & Math Biol, Aberdeen AB24 3UE, Scotland
基金
中国国家自然科学基金;
关键词
Electroencephalography; Brain modeling; Transfer learning; Frequency-domain analysis; Transportation; Adaptation models; Feature extraction; Electroencephalogram (EEG); brain-computer interface (BCI); transfer learning; optimal transportation; BRAIN-COMPUTER-INTERFACE; DOMAIN ADAPTATION; NETWORKS; PATTERNS;
D O I
10.1109/TNSRE.2022.3211881
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Electroencephalography-based Brain Computer Interfaces (BCIs) invariably have a degenerate performance due to the considerable individual variability. To address this problem, we develop a novel domain adaptation method with optimal transport and frequency mixup for cross-subject transfer learning in motor imagery BCIs. Specifically, the preprocessed EEG signals from source and target domain are mapped into latent space with an embedding module, where the representation distributions and label distributions across domains have a large discrepancy. We assume that there exists a non-linear coupling matrix between both domains, which can be utilized to estimate the distance of joint distributions for different domains. Depending on the optimal transport, the Wasserstein distance between source and target domains is minimized, yielding the alignment of joint distributions. Moreover, a new mixup strategy is also introduced to generalize the model, where the inputs trials are mixed in frequency domain rather than in raw space. The extensive experiments on three evaluation benchmarks are conducted to validate the proposed framework. All the results demonstrate that our method achieves a superior performance than previous state-of-the-art domain adaptation approaches.
引用
收藏
页码:2866 / 2875
页数:10
相关论文
共 58 条
[31]  
Lei Y., 2022, Biomedical Signal Processing and Control, V72, P103370, DOI [DOI 10.1016/J.BSPC.2021.103370, 10.1016/j.bspc.2021.103370]
[32]  
Li Y, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P1561
[33]  
Long MS, 2017, PR MACH LEARN RES, V70
[34]  
Long MS, 2018, ADV NEUR IN, V31
[35]   Transfer Feature Learning with Joint Distribution Adaptation [J].
Long, Mingsheng ;
Wang, Jianmin ;
Ding, Guiguang ;
Sun, Jiaguang ;
Yu, Philip S. .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2200-2207
[36]  
Luo Y, 2018, IEEE ENG MED BIO, P2535, DOI 10.1109/EMBC.2018.8512865
[37]  
Mikolajczyk Agnieszka, 2018, 2018 International Interdisciplinary PhD Workshop (IIPhDW), P117, DOI 10.1109/IIPHDW.2018.8388338
[38]  
Mu WR, 2020, IEEE ENG MED BIO, P5913, DOI 10.1109/EMBC44109.2020.9176055
[39]   Improving Cross-State and Cross-Subject Visual ERP-Based BCI With Temporal Modeling and Adversarial Training [J].
Ni, Ziyi ;
Xu, Jiaming ;
Wu, Yuwei ;
Li, Mengfan ;
Xu, Guizhi ;
Xu, Bo .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2022, 30 :369-379
[40]   Domain Adaptation via Transfer Component Analysis [J].
Pan, Sinno Jialin ;
Tsang, Ivor W. ;
Kwok, James T. ;
Yang, Qiang .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (02) :199-210