Using Humanoid Robots to Obtain High-Quality Motor Imagery Electroencephalogram Data for Better Brain-Computer Interaction

被引:3
作者
Cheng, Shiwei [1 ,2 ]
Wang, Jialing [2 ]
Tian, Jieming [2 ]
Zhu, Anjie [2 ]
Fan, Jing [2 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Design, Shanghai 200240, Peoples R China
[2] Zhejiang Univ Technol, Sch Comp Sci, Hangzhou 310023, Peoples R China
关键词
Electroencephalogram (EEG); human-robot interaction; rehabilitation; VIRTUAL-REALITY; STROKE RECOVERY; EEG; INTERFACE; DESYNCHRONIZATION; EXCITABILITY; FES;
D O I
10.1109/TCDS.2023.3289845
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The electroencephalogram (EEG) signal from motor imagery (MI) is used to drive brain-computer interaction (BCI). However, users usually are not adept at performing MI, which leads to low-quality EEG signals and decreases the performance of BCI applications. The humanoid robot stimulation approach can guide users in performing MI more proficiently by increasing the cortico-spinal excitability and improving the discrimination of event-related desynchronization patterns during MI tasks. Compared to the traditional stimulation modes, our proposed humanoid robot stimulation mode can activate higher quality MI EEG signals. We use convolutional neural network and long short-term memory algorithm for the extraction of EEG features and classification. The results showed that the CNN-LSTM can achieve the highest classification accuracy (93.7% +/- 1.7%) in the humanoid robot stimulation mode, and it outperformed all other classifier-stimulation mode combinations. This demonstrates the effectiveness and feasibility of using a humanoid robot in real-scene MI-BCI applications, such as service robots or rehabilitation system for person with motor disabilities.
引用
收藏
页码:706 / 719
页数:14
相关论文
共 73 条
[1]   The Importance of Visual Feedback Design in BCIs; from Embodiment to Motor Imagery Learning [J].
Alimardani, Maryam ;
Nishio, Shuichi ;
Ishiguro, Hiroshi .
PLOS ONE, 2016, 11 (09)
[2]   Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion [J].
Amin, Syed Umar ;
Alsulaiman, Mansour ;
Muhammad, Ghulam ;
Mekhtiche, Mohamed Amine ;
Hossain, M. Shamim .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 101 :542-554
[3]   Motor Imagery Hand Movement Direction Decoding Using Brain Computer Interface to Aid Stroke Recovery and Rehabilitation [J].
Benzy, V. K. ;
Vinod, A. P. ;
Subasree, R. ;
Alladi, Suvarna ;
Raghavendra, K. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (12) :3051-3062
[4]   Improvements in event-related desynchronization and classification performance of motor imagery using instructive dynamic guidance and complex tasks [J].
Bian, Yan ;
Qi, Hongzhi ;
Zhao, Li ;
Ming, Dong ;
Guo, Tong ;
Fu, Xing .
COMPUTERS IN BIOLOGY AND MEDICINE, 2018, 96 :266-273
[5]  
Birch J, 1997, OPHTHAL PHYSL OPT, V17, P403, DOI 10.1111/j.1475-1313.1997.tb00072.x
[6]   Practical research-based guidance for motor imagery practice in neurorehabilitation [J].
Bovend'Eerdt, Thamar J. H. ;
Dawes, Helen ;
Sackley, Catherine ;
Wade, Derick T. .
DISABILITY AND REHABILITATION, 2012, 34 (25) :2192-2200
[7]   Chronic stroke recovery after combined BCI training and physiotherapy: A case report [J].
Caria, Andrea ;
Weber, Cornelia ;
Broetz, Doris ;
Ramos, Ander ;
Ticini, Luca F. ;
Gharabaghi, Alireza ;
Braun, Christoph ;
Birbaumer, Niels .
PSYCHOPHYSIOLOGY, 2011, 48 (04) :578-582
[8]  
Castro A. A., 2014, 5 ISSNIP IEEE BIOSIG, P1
[9]   Toward Brain-Actuated Humanoid Robots: Asynchronous Direct Control Using an EEG-Based BCI [J].
Chae, Yongwook ;
Jeong, Jaeseung ;
Jo, Sungho .
IEEE TRANSACTIONS ON ROBOTICS, 2012, 28 (05) :1131-1144
[10]   Motion Imagery-BCI Based on EEG and Eye Movement Data Fusion [J].
Cheng, Shiwei ;
Wang, Jialing ;
Zhang, Lekai ;
Wei, Qianjing .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (12) :2783-2793