Transfer Learning With Optimal Transportation and Frequency Mixup for EEG-Based Motor Imagery Recognition

被引:22
作者
Chen, Peiyin [1 ]
Wang, He [1 ]
Sun, Xinlin [1 ]
Li, Haoyu [1 ]
Grebogi, Celso [2 ]
Gao, Zhongke [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Univ Aberdeen, Kings Coll, Inst Complex Syst & Math Biol, Aberdeen AB24 3UE, Scotland
基金
中国国家自然科学基金;
关键词
Electroencephalography; Brain modeling; Transfer learning; Frequency-domain analysis; Transportation; Adaptation models; Feature extraction; Electroencephalogram (EEG); brain-computer interface (BCI); transfer learning; optimal transportation; BRAIN-COMPUTER-INTERFACE; DOMAIN ADAPTATION; NETWORKS; PATTERNS;
D O I
10.1109/TNSRE.2022.3211881
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Electroencephalography-based Brain Computer Interfaces (BCIs) invariably have a degenerate performance due to the considerable individual variability. To address this problem, we develop a novel domain adaptation method with optimal transport and frequency mixup for cross-subject transfer learning in motor imagery BCIs. Specifically, the preprocessed EEG signals from source and target domain are mapped into latent space with an embedding module, where the representation distributions and label distributions across domains have a large discrepancy. We assume that there exists a non-linear coupling matrix between both domains, which can be utilized to estimate the distance of joint distributions for different domains. Depending on the optimal transport, the Wasserstein distance between source and target domains is minimized, yielding the alignment of joint distributions. Moreover, a new mixup strategy is also introduced to generalize the model, where the inputs trials are mixed in frequency domain rather than in raw space. The extensive experiments on three evaluation benchmarks are conducted to validate the proposed framework. All the results demonstrate that our method achieves a superior performance than previous state-of-the-art domain adaptation approaches.
引用
收藏
页码:2866 / 2875
页数:10
相关论文
共 58 条
[1]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[2]   Wearable Brain-Computer Interface Instrumentation for Robot-Based Rehabilitation by Augmented Reality [J].
Arpaia, Pasquale ;
Duraccio, Luigi ;
Moccaldi, Nicola ;
Rossi, Silvia .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (09) :6362-6371
[3]   Motor Imagery Hand Movement Direction Decoding Using Brain Computer Interface to Aid Stroke Recovery and Rehabilitation [J].
Benzy, V. K. ;
Vinod, A. P. ;
Subasree, R. ;
Alladi, Suvarna ;
Raghavendra, K. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (12) :3051-3062
[4]  
Brunner C., 2008, BCI Competition 2008Graz Data Set A, P136
[5]   Multiattention Adaptation Network for Motor Imagery Recognition [J].
Chen, Peiyin ;
Gao, Zhongke ;
Yin, Miaomiao ;
Wu, Jialing ;
Ma, Kai ;
Grebogi, Celso .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (08) :5127-5139
[6]  
Courty N, 2017, Arxiv, DOI arXiv:1705.08848
[7]   DeepJDOT: Deep Joint Distribution Optimal Transport for Unsupervised Domain Adaptation [J].
Damodaran, Bharath Bhushan ;
Kellenberger, Benjamin ;
Flamary, Remi ;
Tuia, Devis ;
Courty, Nicolas .
COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 :467-483
[8]  
Donahue J, 2014, PR MACH LEARN RES, V32
[9]  
Edlinger G., 2010, CLIN NEUROPHYSIOL, V121, pS126
[10]   Feature Extraction Method Based on Filter Banks and Riemannian Tangent Space in Motor-Imagery BCI [J].
Fang, Hua ;
Jin, Jing ;
Daly, Ian ;
Wang, Xingyu .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (06) :2504-2514