Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study

被引:5
|
作者
Ferrero, Laura [1 ,2 ,3 ,4 ,6 ]
Soriano-Segura, Paula [1 ,2 ,3 ]
Navarro, Jacobo [4 ,5 ,6 ]
Jones, Oscar [4 ,6 ]
Ortiz, Mario [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ,3 ]
Azorin, Jose M. [1 ,2 ,3 ,7 ,8 ]
Contreras-Vidal, Jose L. [4 ,6 ]
机构
[1] Miguel Hernandez Univ Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Miguel Hernandez Univ Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] Miguel Hernandez Univ Elche, Int Affiliate NSF IUCRC BRAIN Site, Elche, Spain
[4] Univ Houston, NSF IUCRC BRAIN, Houston, TX 77204 USA
[5] Tecnol Monterrey, Int Affiliate NSF IUCRC BRAIN Site, Monterrey, Mexico
[6] Univ Houston, Noninvas Brain Machine Interface Syst, Houston, TX 77204 USA
[7] Valencian Grad Sch, Valencia, Spain
[8] Res Network Artificial Intelligence ValgrAI, Valencia, Spain
关键词
Brain-machine interface; EEG; Exoskeleton; Deep learning; Transfer learning; IMAGERY; BCI;
D O I
10.1186/s12984-024-01342-9
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background This research focused on the development of a motor imagery (MI) based brain-machine interface (BMI) using deep learning algorithms to control a lower-limb robotic exoskeleton. The study aimed to overcome the limitations of traditional BMI approaches by leveraging the advantages of deep learning, such as automated feature extraction and transfer learning. The experimental protocol to evaluate the BMI was designed as asynchronous, allowing subjects to perform mental tasks at their own will.Methods A total of five healthy able-bodied subjects were enrolled in this study to participate in a series of experimental sessions. The brain signals from two of these sessions were used to develop a generic deep learning model through transfer learning. Subsequently, this model was fine-tuned during the remaining sessions and subjected to evaluation. Three distinct deep learning approaches were compared: one that did not undergo fine-tuning, another that fine-tuned all layers of the model, and a third one that fine-tuned only the last three layers. The evaluation phase involved the exclusive closed-loop control of the exoskeleton device by the participants' neural activity using the second deep learning approach for the decoding.Results The three deep learning approaches were assessed in comparison to an approach based on spatial features that was trained for each subject and experimental session, demonstrating their superior performance. Interestingly, the deep learning approach without fine-tuning achieved comparable performance to the features-based approach, indicating that a generic model trained on data from different individuals and previous sessions can yield similar efficacy. Among the three deep learning approaches compared, fine-tuning all layer weights demonstrated the highest performance.Conclusion This research represents an initial stride toward future calibration-free methods. Despite the efforts to diminish calibration time by leveraging data from other subjects, complete elimination proved unattainable. The study's discoveries hold notable significance for advancing calibration-free approaches, offering the promise of minimizing the need for training trials. Furthermore, the experimental evaluation protocol employed in this study aimed to replicate real-life scenarios, granting participants a higher degree of autonomy in decision-making regarding actions such as walking or stopping gait.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Feature-Selection-Based Transfer Learning for Intracortical Brain-Machine Interface Decoding
    Zhang, Peng
    Li, Wei
    Ma, Xuan
    He, Jiping
    Huang, Jian
    Li, Qiang
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 60 - 73
  • [42] Kinematic and neurophysiological consequences of an assisted-force-feedback brain-machine interface training: a case study
    Silvoni, Stefano
    Cavinato, Marianna
    Volpato, Chiara
    Cisotto, Giulia
    Genna, Clara
    Agostini, Michela
    Turolla, Andrea
    Ramos-Murguialday, Ander
    Piccione, Francesco
    FRONTIERS IN NEUROLOGY, 2013, 4
  • [43] A deep learning-based comprehensive robotic system for lower limb rehabilitation
    Mukherjee, Prithwijit
    Roy, Anisha Halder
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 100
  • [44] The auxiliary controller design based on model-free control in the brain-machine interface
    Pan, Hongguang
    Mi, Wenyu
    Wang, Mei
    Sun, Jinggao
    PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, : 3578 - 3583
  • [45] Deep-Learning-Based Automatic Selection of Fewest Channels for Brain-Machine Interfaces
    Kim, Hyun-Seok
    Ahn, Min-Hee
    Min, Byoung-Kyong
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (09) : 8668 - 8680
  • [46] Shared control architecture based on RFID to control a robot arm using a spontaneous brain-machine interface
    Ubeda, Andres
    Ianez, Eduardo
    Azorin, Jose M.
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2013, 61 (08) : 768 - 774
  • [47] Reinforcement Learning Based Fast Self-Recalibrating Decoder for Intracortical Brain-Machine Interface
    Zhang, Peng
    Chao, Lianying
    Chen, Yuting
    Ma, Xuan
    Wang, Weihua
    He, Jiping
    Huang, Jian
    Li, Qiang
    SENSORS, 2020, 20 (19) : 1 - 19
  • [48] Lower limb rehabilitation exoskeleton using brain-computer interface based on multiband filtering with classifier fusion
    Lin, Chih-Jer
    Sie, Ting-Yi
    ASIAN JOURNAL OF CONTROL, 2025, 27 (01) : 144 - 168
  • [49] Demonstration of a Semi-Autonomous Hybrid Brain-Machine Interface Using Human Intracranial EEG, Eye Tracking, and Computer Vision to Control a Robotic Upper Limb Prosthetic
    McMullen, David P.
    Hotson, Guy
    Katyal, Kapil D.
    Wester, Brock A.
    Fifer, Matthew S.
    McGee, Timothy G.
    Harris, Andrew
    Johannes, Matthew S.
    Vogelstein, R. Jacob
    Ravitz, Alan D.
    Anderson, William S.
    Thakor, Nitish V.
    Crone, Nathan E.
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2014, 22 (04) : 784 - 796
  • [50] Deep Learning-Based Markerless Hand Tracking for Freely Moving Non-Human Primates in Brain-Machine Interface Applications
    Liu, Yuhang
    Wang, Miao
    Hou, Shuaibiao
    Wang, Xiao
    Shi, Bing
    ELECTRONICS, 2025, 14 (05):