Transferring a deep learning model from healthy subjects to stroke patients in a motor imagery brain-computer interface

被引:7
作者
Nagarajan, Aarthy [1 ]
Robinson, Neethu [1 ]
Ang, Kai Keng [1 ,2 ]
Chua, Karen Sui Geok [3 ]
Chew, Effie [4 ]
Guan, Cuntai [1 ]
机构
[1] Nanyang Technol Univ, Sch Comp Sci & Engn, 50 Nanyang Ave, Singapore 639798, Singapore
[2] ASTAR, Inst Infocomm Res, 1 Fusionopolis Way, Singapore 138632, Singapore
[3] Tan Tock Seng Hosp, Dept Rehabil Med, 11 Jln Tan Tock Seng, Singapore 308433, Singapore
[4] Natl Univ Hlth Syst, 1E Kent Ridge Rd, Singapore 119228, Singapore
关键词
MI-BCI for stroke rehabilitation; transfer learning; healthy-to-stroke transfer; explainable AI; NEURAL-NETWORKS; CLASSIFICATION; VARIABILITY; PATTERNS;
D O I
10.1088/1741-2552/ad152f
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Motor imagery (MI) brain-computer interfaces (BCIs) based on electroencephalogram (EEG) have been developed primarily for stroke rehabilitation, however, due to limited stroke data, current deep learning methods for cross-subject classification rely on healthy data. This study aims to assess the feasibility of applying MI-BCI models pre-trained using data from healthy individuals to detect MI in stroke patients. Approach. We introduce a new transfer learning approach where features from two-class MI data of healthy individuals are used to detect MI in stroke patients. We compare the results of the proposed method with those obtained from analyses within stroke data. Experiments were conducted using Deep ConvNet and state-of-the-art subject-specific machine learning MI classifiers, evaluated on OpenBMI two-class MI-EEG data from healthy subjects and two-class MI versus rest data from stroke patients. Main results. Results of our study indicate that through domain adaptation of a model pre-trained using healthy subjects' data, an average MI detection accuracy of 71.15% ( +/- 12.46% ) can be achieved across 71 stroke patients. We demonstrate that the accuracy of the pre-trained model increased by 18.15% after transfer learning (p < 0.001). Additionally, the proposed transfer learning method outperforms the subject-specific results achieved by Deep ConvNet and FBCSP, with significant enhancements of 7.64% (p < 0.001) and 5.55% (p < 0.001) in performance, respectively. Notably, the healthy-to-stroke transfer learning approach achieved similar performance to stroke-to-stroke transfer learning, with no significant difference (p > 0.05). Explainable AI analyses using transfer models determined channel relevance patterns that indicate contributions from the bilateral motor, frontal, and parietal regions of the cortex towards MI detection in stroke patients. Significance. Transfer learning from healthy to stroke can enhance the clinical use of BCI algorithms by overcoming the challenge of insufficient clinical data for optimal training.
引用
收藏
页数:29
相关论文
共 81 条
[1]   A comprehensive review of EEG-based brain-computer interface paradigms [J].
Abiri, Reza ;
Borhani, Soheil ;
Sellers, Eric W. ;
Jiang, Yang ;
Zhao, Xiaopeng .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (01)
[2]   Facilitating Effects of Transcranial Direct Current Stimulation on Motor Imagery Brain-Computer Interface With Robotic Feedback for Stroke Rehabilitation [J].
Ang, Kai Keng ;
Guan, Cuntai ;
Phua, Kok Soon ;
Wang, Chuanchu ;
Zhao, Ling ;
Teo, Wei Peng ;
Chen, Changwu ;
Ng, Yee Sien ;
Chew, Effie .
ARCHIVES OF PHYSICAL MEDICINE AND REHABILITATION, 2015, 96 (03) :S79-S87
[3]  
Ang Kai Keng, 2014, Front Neuroeng, V7, P30, DOI 10.3389/fneng.2014.00030
[4]   Mutual information-based selection of optimal spatial-temporal patterns for single-trial EEG-based BCIs [J].
Ang, Kai Keng ;
Chin, Zheng Yang ;
Zhang, Haihong ;
Guan, Cuntai .
PATTERN RECOGNITION, 2012, 45 (06) :2137-2144
[5]   A Large Clinical Study on the Ability of Stroke Patients to Use an EEG-Based Motor Imagery Brain-Computer Interface [J].
Ang, Kai Keng ;
Guan, Cuntai ;
Chua, Karen Sui Geok ;
Ang, Beng Ti ;
Kuah, Christopher Wee Keong ;
Wang, Chuanchu ;
Phua, Kok Soon ;
Chin, Zheng Yang ;
Zhang, Haihong .
CLINICAL EEG AND NEUROSCIENCE, 2011, 42 (04) :253-258
[6]  
Ang KK, 2010, IEEE ENG MED BIO, P5549, DOI 10.1109/IEMBS.2010.5626782
[7]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[8]   A clinical evaluation on the spatial patterns of non-invasive motor imagery-based brain-computer interface in stroke [J].
Ang, Kai Keng ;
Guan, Cuntai ;
Chua, Karen Sui Geok ;
Ang, Beng Ti ;
Kuah, Christopher ;
Wang, Chuanchu ;
Phua, Kok Soon ;
Chin, Zheng Yang ;
Zhang, Haihong .
2008 30TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-8, 2008, :4174-+
[9]   Weighted Transfer Learning for Improving Motor Imagery-Based Brain-Computer Interface [J].
Azab, Ahmed M. ;
Mihaylova, Lyudmila ;
Ang, Kai Keng ;
Arvaneh, Mahnaz .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (07) :1352-1359
[10]   Transfer Learning Approach in Classification of BCI Motor Imagery Signal [J].
Begiello, Filip ;
Tokovarov, Mikhail ;
Plechawska-Wojcik, Malgorzata .
COMPUTER INFORMATION SYSTEMS AND INDUSTRIAL MANAGEMENT, CISIM 2020, 2020, 12133 :3-14