Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking

被引:3
|
作者
Quiles, Vicente [1 ,2 ]
Ferrero, Laura [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ]
Ortiz, Mario [1 ,2 ,3 ]
Gil-Agudo, Angel [4 ]
Azorin, Jose M. [1 ,2 ,3 ,5 ]
机构
[1] Univ Miguel Hernandez Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Univ Miguel Hernandez Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] European Univ Brain & Technol NeurotechEU, European Union, Solna, Sweden
[4] Biomech Unit Natl Parapleg Hosp, Toledo, Spain
[5] ValGRAI Valencian Grad Sch, Res Network Artificial Intelligence, Valencia, Spain
关键词
BMI; stopping intention; exoskeleton; EEG; transfer-learning; closed-loop;
D O I
10.3389/fnins.2023.1154480
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
IntroductionBrain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarity of the signal of EEG-based interfaces are challenges that classical processing techniques do not solve, showing certain shortcomings in the real-time domain. Recent advances in deep-learning techniques open a window of opportunity to solve some of these problems. In this work, an interface able to detect the evoked potential that occurs when a person intends to stop due to the appearance of an unexpected obstacle has been developed. Material and methodsFirst, the interface was tested on a treadmill with five subjects, in which the user stopped when an obstacle appeared (simulated by a laser). The analysis is based on two consecutive convolutional networks: the first one to discern the intention to stop against normal walking and the second one to correct false detections of the previous one. Results and discussionThe results were superior when using the methodology of the two consecutive networks vs. only the first one in a cross-validation pseudo-online analysis. The false positives per min (FP/min) decreased from 31.8 to 3.9 FP/min and the number of repetitions in which there were no false positives and true positives (TP) improved from 34.9% to 60.3% NOFP/TP. This methodology was tested in a closed-loop experiment with an exoskeleton, in which the brain-machine interface (BMI) detected an obstacle and sent the command to the exoskeleton to stop. This methodology was tested with three healthy subjects, and the online results were 3.8 FP/min and 49.3% NOFP/TP. To make this model feasible for non-able bodied patients with a reduced and manageable time frame, transfer-learning techniques were applied and validated in the previous tests, and were then applied to patients. The results for two incomplete Spinal Cord Injury (iSCI) patients were 37.9% NOFP/TP and 7.7 FP/min.
引用
收藏
页数:13
相关论文
共 15 条
  • [1] Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study
    Ferrero, Laura
    Soriano-Segura, Paula
    Navarro, Jacobo
    Jones, Oscar
    Ortiz, Mario
    Ianez, Eduardo
    Azorin, Jose M.
    Contreras-Vidal, Jose L.
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2024, 21 (01)
  • [2] A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control
    Tang, Zhichuan
    Sun, Shouqian
    Zhang, Sanyuan
    Chen, Yumiao
    Li, Chao
    Chen, Shi
    SENSORS, 2016, 16 (12)
  • [3] Using a brain-machine interface to control a hybrid upper limb exoskeleton during rehabilitation of patients with neurological conditions
    Enrique Hortal
    Daniel Planelles
    Francisco Resquin
    José M. Climent
    José M. Azorín
    José L. Pons
    Journal of NeuroEngineering and Rehabilitation, 12
  • [4] Using a brain-machine interface to control a hybrid upper limb exoskeleton during rehabilitation of patients with neurological conditions
    Hortal, Enrique
    Planelles, Daniel
    Resquin, Francisco
    Climent, Jose M.
    Azorin, Jose M.
    Pons, Jose L.
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2015, 12
  • [5] Feature-Selection-Based Transfer Learning for Intracortical Brain-Machine Interface Decoding
    Zhang, Peng
    Li, Wei
    Ma, Xuan
    He, Jiping
    Huang, Jian
    Li, Qiang
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 60 - 73
  • [6] IMPROVING THE CONVOLUTIONAL NEURAL NETWORK PERFORMANCE THROUGH TRANSFER LEARNING FOR BRAIN-MACHINE INTERFACE SYSTEMS
    Petoku, Eneo
    Takahashi, Ryota
    Capi, Genci
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2022, 18 (05): : 1587 - 1600
  • [7] Brain-Machine Interface and Visual Compressive Sensing-Based Teleoperation Control of an Exoskeleton Robot
    Qiu, Shiyuan
    Li, Zhijun
    He, Wei
    Zhang, Longbin
    Yang, Chenguang
    Su, Chun-Yi
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2017, 25 (01) : 58 - 69
  • [8] Synchronization of Slow Cortical Rhythms During Motor Imagery-Based Brain-Machine Interface Control
    Barios, Juan A.
    Ezquerro, Santiago
    Bertomeu-Motos, Arturo
    Nann, Marius
    Badesa, Fco Javier
    Fernandez, Eduardo
    Soekadar, Surjo R.
    Garcia-Aracil, Nicolas
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2019, 29 (05)
  • [9] Brain–machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study
    Laura Ferrero
    Paula Soriano-Segura
    Jacobo Navarro
    Oscar Jones
    Mario Ortiz
    Eduardo Iáñez
    José M. Azorín
    José L. Contreras-Vidal
    Journal of NeuroEngineering and Rehabilitation, 21
  • [10] Design of a brain-machine interface for reducing false activations of a lower-limb exoskeleton based on error related potential
    Soriano-Segura, P.
    Ortiz, M.
    Ianez, E.
    Azorin, J. M.
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 255