Enhancing Deep-Learning Classification for Remote Motor Imagery Rehabilitation Using Multi-Subject Transfer Learning in IoT Environment

被引:0
作者
Khabti, Joharah [1 ,2 ]
Alahmadi, Saad [1 ,2 ]
Soudani, Adel [1 ,2 ]
机构
[1] King Saud Univ, Coll Comp & Informat Sci CCIS, Riyadh 11543, Saudi Arabia
[2] King Salman Ctr Disabil Res, Riyadh 11614, Saudi Arabia
关键词
brain-computer interface (BCI); motor imagery (MI); electroencephalogram (EEG); deep learning (DL); transfer learning (TL); internet of things (IoT); edge computing; CONVOLUTIONAL NEURAL-NETWORK; PRIVACY; AGGREGATION; INTERFACE;
D O I
10.3390/s24248127
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
One of the most promising applications for electroencephalogram (EEG)-based brain-computer interfaces (BCIs) is motor rehabilitation through motor imagery (MI) tasks. However, current MI training requires physical attendance, while remote MI training can be applied anywhere, facilitating flexible rehabilitation. Providing remote MI training raises challenges to ensuring an accurate recognition of MI tasks by healthcare providers, in addition to managing computation and communication costs. The MI tasks are recognized through EEG signal processing and classification, which can drain sensor energy due to the complexity of the data and the presence of redundant information, often influenced by subject-dependent factors. To address these challenges, we propose in this paper a multi-subject transfer-learning approach for an efficient MI training framework in remote rehabilitation within an IoT environment. For efficient implementation, we propose an IoT architecture that includes cloud/edge computing as a solution to enhance the system's efficiency and reduce the use of network resources. Furthermore, deep-learning classification with and without channel selection is applied in the cloud, while multi-subject transfer-learning classification is utilized at the edge node. Various transfer-learning strategies, including different epochs, freezing layers, and data divisions, were employed to improve accuracy and efficiency. To validate this framework, we used the BCI IV 2a dataset, focusing on subjects 7, 8, and 9 as targets. The results demonstrated that our approach significantly enhanced the average accuracy in both multi-subject and single-subject transfer-learning classification. In three-subject transfer-learning classification, the FCNNA model achieved up to 79.77% accuracy without channel selection and 76.90% with channel selection. For two-subject and single-subject transfer learning, the application of transfer learning improved the average accuracy by up to 6.55% and 12.19%, respectively, compared to classification without transfer learning. This framework offers a promising solution for remote MI rehabilitation, providing both accurate task recognition and efficient resource usage.
引用
收藏
页数:30
相关论文
共 52 条
[1]   Edge Computing for Smart Health: Context-Aware Approaches, Opportunities, and Challenges [J].
Abdellatif, Alaa Awad ;
Mohamed, Amr ;
Chiasserini, Carla Fabiana ;
Tlili, Mounira ;
Erbad, Aiman .
IEEE NETWORK, 2019, 33 (03) :196-203
[2]   Edge-based compression and classification for smart healthcare systems: Concept, implementation and evaluation [J].
Abdellatif, Alaa Awad ;
Emam, Ahmed ;
Chiasserini, Carla-Fabiana ;
Mohamed, Amr ;
Jaoua, Ali ;
Ward, Rabab .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 117 :1-14
[3]   An intelligent Edge-IoT platform for monitoring livestock and crops in a dairy farming scenario [J].
Alonso, Ricardo S. ;
Sitton-Candanedo, Ines ;
Garcia, Oscar ;
Prieto, Javier ;
Rodriguez-Gonzalez, Sara .
AD HOC NETWORKS, 2020, 98
[4]   SSVEP-EEG Signal Classification based on Emotiv EPOC BCI and Raspberry Pi [J].
Asanza, Victor ;
Aviles-Mendoza, Karla ;
Trivino-Gonzalez, Hector ;
Rosales-Uribe, Felix ;
Torres-Brunes, Jamil ;
Loayza, Francis R. ;
Pelaez, Enrique ;
Cajo, Ricardo ;
Tinoco-Egas, Raquel .
IFAC PAPERSONLINE, 2021, 54 (15) :388-393
[5]   Investigation of EEG-Based Biometric Identification Using State-of-the-Art Neural Architectures on a Real-Time Raspberry Pi-Based System [J].
Benomar, Mohamed ;
Cao, Steven ;
Vishwanath, Manoj ;
Vo, Khuong ;
Cao, Hung .
SENSORS, 2022, 22 (23)
[6]  
Brunner C., 2008, Graz University of Technology, V16, P1
[7]   Data Transmission Efficiency in Bluetooth Low Energy Versions [J].
Bulic, Patricio ;
Kojek, Gasper ;
Biasizzo, Anton .
SENSORS, 2019, 19 (17)
[8]   A Raspberry Pi-Based Traumatic Brain Injury Detection System for Single-Channel Electroencephalogram [J].
Dhillon, Navjodh Singh ;
Sutandi, Agustinus ;
Vishwanath, Manoj ;
Lim, Miranda M. ;
Cao, Hung ;
Si, Dong .
SENSORS, 2021, 21 (08)
[9]   A shared robot control system combining augmented reality and motor imagery brain-computer interfaces with eye tracking [J].
Dillen, Arnau ;
Omidi, Mohsen ;
Ghaffari, Fakhreddine ;
Vanderborght, Bram ;
Roelands, Bart ;
Romain, Olivier ;
Nowe, Ann ;
De Pauw, Kevin .
JOURNAL OF NEURAL ENGINEERING, 2024, 21 (05)
[10]   Convolutional neural network and riemannian geometry hybrid approach for motor imagery classification [J].
Gao, Chang ;
Liu, Wenchao ;
Yang, Xian .
NEUROCOMPUTING, 2022, 507 :180-190