Priming cross-session motor imagery classification with a universal deep domain adaptation framework

被引:9
作者
Zhang, Xin [1 ]
Miao, Zhengqing [2 ]
Menon, Carlo [3 ]
Zheng, Yelong [2 ]
Zhao, Meirong [2 ]
Ming, Dong [4 ,5 ]
机构
[1] Chinese Acad Med Sci & Peking Union Med Coll, Inst Biomed Engn, Tianjin 300192, Peoples R China
[2] Tianjin Univ, Sch Precis Instrument & Optoelect Engn, Dept Instruments Sci & Technol, Lab Optoelect Detect & Image Proc, Tianjin 300072, Peoples R China
[3] Swiss Fed Inst Technol, Biomed & Mobile Hlth Technol Lab, Lengghalde 5, CH-8008 Zurich, Switzerland
[4] Tianjin Univ, Sch Precis Instruments & Optoelect Engn, Dept Biomed Engn, Lab Neural Engn & Rehabil, Tianjin 300072, Peoples R China
[5] Tianjin Univ, Acad Med Engn & Translat Med, Tianjin Int Joint Res Ctr Neural Engn, Tianjin 300072, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Domain adaptation; Deep learning; Brain-computer interface (BCI); Electroencephalogram (EEG); Motor imagery (MI); COMMON SPATIAL-PATTERN; SUPPORT;
D O I
10.1016/j.neucom.2023.126659
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalogram (EEG) based motor imagery (MI) brain-computer interfaces (BCI) are widely used in applications related to rehabilitation and external device control. However, due to the non-stationary and low signal-to-noise ratio characteristics of EEG, classifying motor imagery tasks of the same participant from different recording sessions is generally challenging. Whether the classification accuracy of cross-session MI can be improved from the perspective of domain adaptation is a question worth verifying. In this paper, we propose a Siamese deep domain adaptation (SDDA) framework for cross-session MI classification based on mathematical models in domain adaptation theory. The SDDA framework primarily consists of three components: a novel preprocessing method based on domain-invariant features, a maximum mean discrepancy (MMD) loss for aligning source and target domain embedding features, and an improved cosine-based center loss designed to suppress the influence of noise and outliers on the neural network. The SDDA framework has been validated with two classic and popular convolutional neural networks (EEGNet and ConvNet) from BCI research field in two MI EEG public datasets (BCI Competition IV IIA, IIB). Compared with the vanilla EEGNet and ConvNet, the SDDA framework improves the MI classification accuracy by 10.49%, 7.60% respectively in IIA dataset, and 4.59%, 3.35% in IIB dataset. The SDDA not only significantly improves the classification performance of the vanilla networks but also surpasses state-of-the-art transfer learning methods, making it a superior and user-friendly approach for MI classification.
引用
收藏
页数:13
相关论文
共 53 条
[1]   Deep learning for motor imagery EEG-based classification: A review [J].
Al-Saegh, Ali ;
Dawwd, Shefa A. ;
Abdul-Jabbar, Jassim M. .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 63
[2]  
Allison BZ, 2010, HUM-COMPUT INT-SPRIN, P35, DOI 10.1007/978-1-84996-272-8_3
[3]   Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion [J].
Amin, Syed Umar ;
Alsulaiman, Mansour ;
Muhammad, Ghulam ;
Mekhtiche, Mohamed Amine ;
Hossain, M. Shamim .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 101 :542-554
[4]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[5]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[6]   Filtering techniques for channel selection in motor imagery EEG applications: a survey [J].
Baig, Muhammad Zeeshan ;
Aslaml, Nauman ;
Shum, Hubert P. H. .
ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (02) :1207-1232
[7]   Testing that distributions are close [J].
Batu, T ;
Fortnow, L ;
Rubinfeld, R ;
Smith, WD ;
White, P .
41ST ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 2000, :259-269
[8]  
Ben-David S., 2006, ADV NEURAL INFORM PR, V19
[9]   A theory of learning from different domains [J].
Ben-David, Shai ;
Blitzer, John ;
Crammer, Koby ;
Kulesza, Alex ;
Pereira, Fernando ;
Vaughan, Jennifer Wortman .
MACHINE LEARNING, 2010, 79 (1-2) :151-175
[10]   A COEFFICIENT OF AGREEMENT FOR NOMINAL SCALES [J].
COHEN, J .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20 (01) :37-46