Improving Motor Imagery of Gait on a Brain-Computer Interface by Means of Virtual Reality: A Case of Study

被引:19
作者
Ferrero, L. [1 ]
Ortiz, M. [1 ]
Quiles, V. [1 ]
Ianez, E. [1 ]
Azorin, J. M. [1 ]
机构
[1] Miguel Hernandez Univ Elche, Brain Machine Interface Syst Lab, Elche 03202, Spain
关键词
Visualization; Task analysis; Training; Exoskeletons; Electroencephalography; Brain-computer interfaces; Feature extraction; Brain– computer interface; EEG; motor imagery; common spatial patterns; virtual reality;
D O I
10.1109/ACCESS.2021.3068929
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Motor imagery (MI) is one of the most common paradigms used in brain-computer interfaces (BCIs). This mental process is defined as the imagination of movement without any motion. In some lower-limb exoskeletons controlled by BCIs, users have to perform MI continuously in order to move the exoskeleton. This makes it difficult to design a closed-loop control BCI, as it cannot be assured that the analyzed activity is not related to motion instead of imagery. A possible solution would be the employment of virtual reality (VR). During VR training phase, subjects could focus on MI avoiding any distraction. This could help the subject to create a robust model of the BCI classifier that would be used later to control the exoskeleton. This paper analyzes if gait MI can be improved when VR feedback is provided to subjects instead of visual feedback by a screen. Additionally, both types of visual feedback are analyzed while subjects are seated or standing up. From the analysis, visual feedback by VR was related to higher performances in the majority of cases, not being relevant the differences between standing and being seated. The paper also presents a case of study for the closed-loop control of the BCI in a virtual reality environment. Subjects had to perform gait MI or to be in a relaxation state and based on the output of the BCI, the immersive first person view remained static or started to move. Experiments showed an accuracy of issued commands of 91.0 +/- 6.7, being a very satisfactory result.
引用
收藏
页码:49121 / 49130
页数:10
相关论文
共 40 条
[1]  
Abbas W, 2018, IEEE ENG MED BIO, P215, DOI 10.1109/EMBC.2018.8512238
[2]   Filter bank common spatial pattern algorithm on BCI competition IV Datasets 2a and 2b [J].
Ang, Kai Keng ;
Chin, Zheng Yang ;
Wang, Chuanchu ;
Guan, Cuntai ;
Zhang, Haihong .
FRONTIERS IN NEUROSCIENCE, 2012, 6
[3]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[4]   Motor imagery of gait: a quantitative approach [J].
Bakker, M. ;
de Lange, F. P. ;
Stevens, J. A. ;
Toni, I. ;
Bloem, B. R. .
EXPERIMENTAL BRAIN RESEARCH, 2007, 179 (03) :497-504
[5]   Comparison of Brain Activation during Motor Imagery and Motor Movement Using fNIRS [J].
Batula, Alyssa M. ;
Mark, Jesse A. ;
Kim, Youngmoo E. ;
Ayaz, Hasan .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2017, 2017
[6]   Improving performance in motor imagery BCI-based control applications via virtually embodied feedback [J].
Choi, Jin Woo ;
Huh, Sejoon ;
Jo, Sungho .
COMPUTERS IN BIOLOGY AND MEDICINE, 2020, 127
[7]   Developing a Motor Imagery-Based Real-Time Asynchronous Hybrid BCI Controller for a Lower-Limb Exoskeleton [J].
Choi, Junhyuk ;
Kim, Keun Tae ;
Jeong, Ji Hyeok ;
Kim, Laehyun ;
Lee, Song Joo ;
Kim, Hyungmin .
SENSORS, 2020, 20 (24) :1-15
[8]   Brain-computer interface controlled robotic gait orthosis [J].
Do, An H. ;
Wang, Po T. ;
King, Christine E. ;
Chun, Sophia N. ;
Nenadic, Zoran .
JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2013, 10
[9]   What Turns Assistive into Restorative Brain-Machine Interfaces? [J].
Gharabaghi, Alireza .
FRONTIERS IN NEUROSCIENCE, 2016, 10
[10]  
Gordleeva SY, 2017, SOVREM TEHNOL MED, V9, P31, DOI 10.17691/stm2017.9.3.04