Priming cross-session motor imagery classification with a universal deep domain adaptation framework

被引:9
作者
Zhang, Xin [1 ]
Miao, Zhengqing [2 ]
Menon, Carlo [3 ]
Zheng, Yelong [2 ]
Zhao, Meirong [2 ]
Ming, Dong [4 ,5 ]
机构
[1] Chinese Acad Med Sci & Peking Union Med Coll, Inst Biomed Engn, Tianjin 300192, Peoples R China
[2] Tianjin Univ, Sch Precis Instrument & Optoelect Engn, Dept Instruments Sci & Technol, Lab Optoelect Detect & Image Proc, Tianjin 300072, Peoples R China
[3] Swiss Fed Inst Technol, Biomed & Mobile Hlth Technol Lab, Lengghalde 5, CH-8008 Zurich, Switzerland
[4] Tianjin Univ, Sch Precis Instruments & Optoelect Engn, Dept Biomed Engn, Lab Neural Engn & Rehabil, Tianjin 300072, Peoples R China
[5] Tianjin Univ, Acad Med Engn & Translat Med, Tianjin Int Joint Res Ctr Neural Engn, Tianjin 300072, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Domain adaptation; Deep learning; Brain-computer interface (BCI); Electroencephalogram (EEG); Motor imagery (MI); COMMON SPATIAL-PATTERN; SUPPORT;
D O I
10.1016/j.neucom.2023.126659
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalogram (EEG) based motor imagery (MI) brain-computer interfaces (BCI) are widely used in applications related to rehabilitation and external device control. However, due to the non-stationary and low signal-to-noise ratio characteristics of EEG, classifying motor imagery tasks of the same participant from different recording sessions is generally challenging. Whether the classification accuracy of cross-session MI can be improved from the perspective of domain adaptation is a question worth verifying. In this paper, we propose a Siamese deep domain adaptation (SDDA) framework for cross-session MI classification based on mathematical models in domain adaptation theory. The SDDA framework primarily consists of three components: a novel preprocessing method based on domain-invariant features, a maximum mean discrepancy (MMD) loss for aligning source and target domain embedding features, and an improved cosine-based center loss designed to suppress the influence of noise and outliers on the neural network. The SDDA framework has been validated with two classic and popular convolutional neural networks (EEGNet and ConvNet) from BCI research field in two MI EEG public datasets (BCI Competition IV IIA, IIB). Compared with the vanilla EEGNet and ConvNet, the SDDA framework improves the MI classification accuracy by 10.49%, 7.60% respectively in IIA dataset, and 4.59%, 3.35% in IIB dataset. The SDDA not only significantly improves the classification performance of the vanilla networks but also surpasses state-of-the-art transfer learning methods, making it a superior and user-friendly approach for MI classification.
引用
收藏
页数:13
相关论文
共 53 条
[41]   MEASURING THE VC-DIMENSION OF A LEARNING-MACHINE [J].
VAPNIK, V ;
LEVIN, E ;
LECUN, Y .
NEURAL COMPUTATION, 1994, 6 (05) :851-876
[42]   Machine-Learning-Based Coadaptive Calibration for Brain-Computer Interfaces [J].
Vidaurre, Carmen ;
Sannelli, Claudia ;
Mueller, Klaus-Robert ;
Blankertz, Benjamin .
NEURAL COMPUTATION, 2011, 23 (03) :791-816
[43]   CosFace: Large Margin Cosine Loss for Deep Face Recognition [J].
Wang, Hao ;
Wang, Yitong ;
Zhou, Zheng ;
Ji, Xing ;
Gong, Dihong ;
Zhou, Jingchao ;
Li, Zhifeng ;
Liu, Wei .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :5265-5274
[44]   A Discriminative Feature Learning Approach for Deep Face Recognition [J].
Wen, Yandong ;
Zhang, Kaipeng ;
Li, Zhifeng ;
Qiao, Yu .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :499-515
[45]  
Wolpaw JR, 2007, ASSETS'07: PROCEEDINGS OF THE NINTH INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, P1
[46]   Brain-computer interface technology: A review of the first international meeting [J].
Wolpaw, JR ;
Birbaumer, N ;
Heetderks, WJ ;
McFarland, DJ ;
Peckham, PH ;
Schalk, G ;
Donchin, E ;
Quatrano, LA ;
Robinson, CJ ;
Vaughan, TM .
IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (02) :164-173
[47]  
Yosinski J, 2014, ADV NEUR IN, V27
[48]   Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network [J].
Zhang, Kaishuo ;
Robinson, Neethu ;
Lee, Seong-Whan ;
Guan, Cuntai .
NEURAL NETWORKS, 2021, 136 :1-10
[49]   A Width-Growth Model With Subnetwork Nodes and Refinement Structure for Representation Learning and Image Classification [J].
Zhang, Wandong ;
Wu, Q. M. Jonathan ;
Yang, Yimin ;
Akilan, Thangarajah ;
Zhang, Hui .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (03) :1562-1572
[50]   Multimodel Feature Reinforcement Framework Using Moore-Penrose Inverse for Big Data Analysis [J].
Zhang, Wandong ;
Wu, Q. M. Jonathan ;
Yang, Yimin ;
Akilan, Thangarajah .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (11) :5008-5021