Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study

被引:5
|
作者
Ferrero, Laura [1 ,2 ,3 ,4 ,6 ]
Soriano-Segura, Paula [1 ,2 ,3 ]
Navarro, Jacobo [4 ,5 ,6 ]
Jones, Oscar [4 ,6 ]
Ortiz, Mario [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ,3 ]
Azorin, Jose M. [1 ,2 ,3 ,7 ,8 ]
Contreras-Vidal, Jose L. [4 ,6 ]
机构
[1] Miguel Hernandez Univ Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Miguel Hernandez Univ Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] Miguel Hernandez Univ Elche, Int Affiliate NSF IUCRC BRAIN Site, Elche, Spain
[4] Univ Houston, NSF IUCRC BRAIN, Houston, TX 77204 USA
[5] Tecnol Monterrey, Int Affiliate NSF IUCRC BRAIN Site, Monterrey, Mexico
[6] Univ Houston, Noninvas Brain Machine Interface Syst, Houston, TX 77204 USA
[7] Valencian Grad Sch, Valencia, Spain
[8] Res Network Artificial Intelligence ValgrAI, Valencia, Spain
关键词
Brain-machine interface; EEG; Exoskeleton; Deep learning; Transfer learning; IMAGERY; BCI;
D O I
10.1186/s12984-024-01342-9
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background This research focused on the development of a motor imagery (MI) based brain-machine interface (BMI) using deep learning algorithms to control a lower-limb robotic exoskeleton. The study aimed to overcome the limitations of traditional BMI approaches by leveraging the advantages of deep learning, such as automated feature extraction and transfer learning. The experimental protocol to evaluate the BMI was designed as asynchronous, allowing subjects to perform mental tasks at their own will.Methods A total of five healthy able-bodied subjects were enrolled in this study to participate in a series of experimental sessions. The brain signals from two of these sessions were used to develop a generic deep learning model through transfer learning. Subsequently, this model was fine-tuned during the remaining sessions and subjected to evaluation. Three distinct deep learning approaches were compared: one that did not undergo fine-tuning, another that fine-tuned all layers of the model, and a third one that fine-tuned only the last three layers. The evaluation phase involved the exclusive closed-loop control of the exoskeleton device by the participants' neural activity using the second deep learning approach for the decoding.Results The three deep learning approaches were assessed in comparison to an approach based on spatial features that was trained for each subject and experimental session, demonstrating their superior performance. Interestingly, the deep learning approach without fine-tuning achieved comparable performance to the features-based approach, indicating that a generic model trained on data from different individuals and previous sessions can yield similar efficacy. Among the three deep learning approaches compared, fine-tuning all layer weights demonstrated the highest performance.Conclusion This research represents an initial stride toward future calibration-free methods. Despite the efforts to diminish calibration time by leveraging data from other subjects, complete elimination proved unattainable. The study's discoveries hold notable significance for advancing calibration-free approaches, offering the promise of minimizing the need for training trials. Furthermore, the experimental evaluation protocol employed in this study aimed to replicate real-life scenarios, granting participants a higher degree of autonomy in decision-making regarding actions such as walking or stopping gait.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] A Supplementary System for a Brain-Machine Interface Based on Jaw Artifacts for the Bidimensional Control of a Robotic Arm
    Costa, Alvaro
    Hortal, Enrique
    Ianez, Eduardo
    Azorin, Jose M.
    PLOS ONE, 2014, 9 (11):
  • [22] Decoding neural activity preceding balance loss during standing with a lower-limb exoskeleton using an interpretable deep learning model
    Sujatha Ravindran, Akshay
    Malaya, Christopher A.
    John, Isaac
    Francisco, Gerard E.
    Layne, Charles
    Contreras-Vidal, Jose L.
    JOURNAL OF NEURAL ENGINEERING, 2022, 19 (03)
  • [23] Control of an Ambulatory Exoskeleton with a Brain-Machine Interface for Spinal Cord Injury Gait Rehabilitation
    Lopez-Larraz, Eduardo
    Trincado-Alonso, Fernando
    Rajasekaran, Vijaykumar
    Perez-Nombela, Soraya
    del-Ama, Antonio J.
    Aranda, Joan
    Minguez, Javier
    Gil-Agudo, Angel
    Montesano, Luis
    FRONTIERS IN NEUROSCIENCE, 2016, 10
  • [24] Optimal phase-based gait guidance control on a lower-limb exoskeleton
    Laubscher, Curt A.
    Goo, Anthony C.
    Sawicki, Jerzy T.
    CONTROL ENGINEERING PRACTICE, 2023, 139
  • [25] End-to-End High-Level Control of Lower-Limb Exoskeleton for Human Performance Augmentation Based on Deep Reinforcement Learning
    Zheng, Ranran
    Yu, Zhiyuan
    Liu, Hongwei
    Chen, Jing
    Zhao, Zhe
    Jia, Longfei
    IEEE ACCESS, 2023, 11 : 102340 - 102351
  • [26] Continuous Teleoperation of a Robotic Manipulator via Brain-Machine Interface with Shared Control
    Tortora, Stefano
    Gottardi, Alberto
    Menegatti, Emanuele
    Tonin, Luca
    2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
  • [27] Improved Spike-Based Brain-Machine Interface Using Bayesian Adaptive Kernel Smoother and Deep Learning
    Ahmadi, Nur
    Adiono, Trio
    Purwarianti, Ayu
    Constandinou, Timothy G.
    Bouganis, Christos-Savvas
    IEEE ACCESS, 2022, 10 : 29341 - 29356
  • [28] Deep-Learning-Based Emergency Stop Prediction for Robotic Lower-Limb Rehabilitation Training Systems
    Cha, Baekdong
    Lee, Kyung-Hwan
    Ryu, Jeha
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 1120 - 1128
  • [29] A Method for Arm Motions Classification and A Lower-limb Exoskeleton Control Based on sEMG signals
    Zhang, Lu-Feng
    Ma, Yue
    Wang, Can
    Yan, Zefeng
    Wu, Xinyu
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), 2019, : 118 - 123
  • [30] Robotic arm control using hybrid brain-machine interface and augmented reality feedback
    Wang, Yanxin
    Zeng, Hong
    Song, Aiguo
    Xu, Baoguo
    Li, Huijun
    Zhu, Lifeng
    Wen, Pengcheng
    Liu, Jia
    2017 8TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2017, : 411 - 414