Selective Cross-Subject Transfer Learning Based on Riemannian Tangent Space for Motor Imagery Brain-Computer Interface

被引:15
作者
Xu, Yilu [1 ]
Huang, Xin [2 ]
Lan, Quan [3 ]
机构
[1] Jiangxi Agr Univ, Sch Software, Nanchang, Jiangxi, Peoples R China
[2] Jiangxi Normal Univ, Software Coll, Nanchang, Jiangxi, Peoples R China
[3] Xiamen Univ, Affiliated Hosp 1, Dept Neurol, Xiamen, Peoples R China
基金
中国国家自然科学基金;
关键词
transfer learning; cross-subject; source selection; Riemannian tangent space; motor imagery; COMMON SPATIAL-PATTERNS; CLASSIFICATION; EEG;
D O I
10.3389/fnins.2021.779231
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
A motor imagery (MI) brain-computer interface (BCI) plays an important role in the neurological rehabilitation training for stroke patients. Electroencephalogram (EEG)-based MI BCI has high temporal resolution, which is convenient for real-time BCI control. Therefore, we focus on EEG-based MI BCI in this paper. The identification of MI EEG signals is always quite challenging. Due to high inter-session/subject variability, each subject should spend long and tedious calibration time in collecting amounts of labeled samples for a subject-specific model. To cope with this problem, we present a supervised selective cross-subject transfer learning (sSCSTL) approach which simultaneously makes use of the labeled samples from target and source subjects based on Riemannian tangent space. Since the covariance matrices representing the multi-channel EEG signals belong to the smooth Riemannian manifold, we perform the Riemannian alignment to make the covariance matrices from different subjects close to each other. Then, all aligned covariance matrices are converted into the Riemannian tangent space features to train a classifier in the Euclidean space. To investigate the role of unlabeled samples, we further propose semi-supervised and unsupervised versions which utilize the total samples and unlabeled samples from target subject, respectively. Sequential forward floating search (SFFS) method is executed for source selection. All our proposed algorithms transfer the labeled samples from most suitable source subjects into the feature space of target subject. Experimental results on two publicly available MI datasets demonstrated that our algorithms outperformed several state-of-the-art algorithms using small number of the labeled samples from target subject, especially for good target subjects.
引用
收藏
页数:14
相关论文
共 32 条
[1]   Dynamic time warping-based transfer learning for improving common spatial patterns in brain-computer interface [J].
Azab, Ahmed M. ;
Ahmadi, Hamed ;
Mihaylova, Lyudmila ;
Arvaneh, Mahnaz .
JOURNAL OF NEURAL ENGINEERING, 2020, 17 (01)
[2]   Classification of covariance matrices using a Riemannian-based kernel for BCI applications [J].
Barachant, Alexandre ;
Bonnet, Stephane ;
Congedo, Marco ;
Jutten, Christian .
NEUROCOMPUTING, 2013, 112 :172-178
[3]   Multiclass Brain-Computer Interface Classification by Riemannian Geometry [J].
Barachant, Alexandre ;
Bonnet, Stephane ;
Congedo, Marco ;
Jutten, Christian .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (04) :920-928
[4]   The non-invasive Berlin Brain-Computer Interface:: Fast acquisition of effective performance in untrained subjects [J].
Blankertz, Benjamin ;
Dornhege, Guido ;
Krauledat, Matthias ;
Mueller, Klaus-Robert ;
Curio, Gabriel .
NEUROIMAGE, 2007, 37 (02) :539-550
[5]   The Berlin Brain-Computer Interface: Progress Beyond Communication and Control [J].
Blankertz, Benjamin ;
Acqualagna, Laura ;
Dahne, Sven ;
Haufe, Stefan ;
-Kraft, Matthias Schultze ;
Sturm, Irene ;
Uscumlic, Marija ;
Wenzel, Markus A. ;
Curio, Gabriel ;
Muller, Klaus -Robert .
FRONTIERS IN NEUROSCIENCE, 2016, 10
[6]   Single-trial analysis and classification of ERP components - A tutorial [J].
Blankertz, Benjamin ;
Lemm, Steven ;
Treder, Matthias ;
Haufe, Stefan ;
Mueller, Klaus-Robert .
NEUROIMAGE, 2011, 56 (02) :814-825
[7]   Regularized common spatial patterns with subject-to-subject transfer of EEG signals [J].
Cheng, Minmin ;
Lu, Zuhong ;
Wang, Haixian .
COGNITIVE NEURODYNAMICS, 2017, 11 (02) :173-181
[8]   EEG datasets for motor imagery brain-computer interface [J].
Cho, Hohyun ;
Ahn, Minkyu ;
Ahn, Sangtae ;
Kwon, Moonyoung ;
Jun, Sung Chan .
GIGASCIENCE, 2017, 6 (07) :1-8
[9]  
Fletcher PT, 2004, LECT NOTES COMPUT SC, V3117, P87
[10]  
He B, 2015, P IEEE, V103, P907, DOI [10.1109/JPROC.2015.2407272, 10.1109/jproc.2015.2407272]