A Brain-Inspired Decision-Making method for upper limb exoskeleton based on Multi-Brain-Region structure and multimodal information fusion

被引:2
作者
Wang, Wendong [1 ,4 ]
Ren, Huizhao [1 ]
Su, Shibin [2 ]
Zhang, Peng [3 ]
Zhang, Junbo [1 ]
机构
[1] Northwestern Polytech Univ, Sch Mech Engn, Xian, Peoples R China
[2] CSSC Huangpu Wenchong Shipbuliding Co Ltd, Tech Dept, Guangzhou, Peoples R China
[3] Northwestern Polytech Univ, Training Ctr Engn Pract, Xian, Peoples R China
[4] Northwestern Polytech Univ, Chongqing Innovat Ctr, Chongqing, Peoples R China
关键词
Upper limb exoskeleton; sEMG; Multimodal information fusion; Spiking neural network; Echo state network;
D O I
10.1016/j.measurement.2024.115728
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
For the challenges faced by upper limb exoskeleton in meeting human motion intention, this article proposes a novel brain-inspired decision-making model based on multi-brain-region information transmission mechanism and multimodal information fusion method to provide accurate prediction of motion trajectory. Firstly, a multimodal information perception and fusion method is proposed. Based on surface electromyographic (sEMG) signals and angle signals collected by sensors. Then a random forest algorithm is applied to screen the key features of sEMG signal for trajectory prediction. A multimodal information hierarchical fusion method based on dual-period mechanism is designed to solve the problem of fusion defect of information with different frequency. Finally, a multi-brain-region decision-making model based on hybrid hierarchical liquid state machine (HHLSM) is established to predict motion trajectory for the exoskeleton to meet human motion intention. Experiments show that the established model has a high computational efficiency and improves the effectiveness of exoskeleton assistance. The brain-inspired decision-making model based on HHLSM established in this paper is of great significance for further research on brain-inspired control and improving the human-robot interaction effect of upper limb exoskeleton.
引用
收藏
页数:9
相关论文
共 31 条
[1]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[2]   Movement prediction from real-world images using a liquid state machine [J].
Burgsteiner, Harald ;
Kroell, Mark ;
Leopold, Alexander ;
Steinbauer, Gerald .
APPLIED INTELLIGENCE, 2007, 26 (02) :99-109
[3]   RobHand: A Hand Exoskeleton With Real-Time EMG-Driven Embedded Control. Quantifying Hand Gesture Recognition Delays for Bilateral Rehabilitation [J].
Cisnal, Ana ;
Perez-Turiel, Javier ;
Fraile, Juan-Carlos ;
Sierra, David ;
de la Fuente, Eusebio .
IEEE ACCESS, 2021, 9 :137809-137823
[4]   Unsupervised learning of digit recognition using spike-timing-dependent plasticity [J].
Diehl, Peter U. ;
Cook, Matthew .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2015, 9
[5]  
Esposito A., 2020, Smart Innovation, Systems and Technologies, V151, DOI [10.1007/978-981-13-8950-4_35, DOI 10.1007/978-981-13-8950-4_35]
[6]   Real-Time Evaluation of the Signal Processing of sEMG Used in Limb Exoskeleton Rehabilitation System [J].
Gao, Baofeng ;
Wei, Chao ;
Ma, Hongdao ;
Yang, Shu ;
Ma, Xu ;
Zhang, Songyuan .
APPLIED BIONICS AND BIOMECHANICS, 2018, 2018
[7]   A 4-DOF Upper Limb Exoskeleton for Physical Assistance: Design, Modeling, Control and Performance Evaluation [J].
Gull, Muhammad Ahsan ;
Thoegersen, Mikkel ;
Bengtson, Stefan Hein ;
Mohammadi, Mostafa ;
Andreasen Struijk, Lotte N. S. ;
Moeslund, Thomas B. ;
Bak, Thomas ;
Bai, Shaoping .
APPLIED SCIENCES-BASEL, 2021, 11 (13)
[8]   BindsNET: A Machine Learning-Oriented Spiking Neural Networks Library in Python']Python [J].
Hazan, Hananel ;
Saunders, Daniel J. ;
Khan, Hassaan ;
Patel, Devdhar ;
Sanghavi, Darpan T. ;
Siegelmann, Hava T. ;
Kozma, Robert .
FRONTIERS IN NEUROINFORMATICS, 2018, 12
[9]   Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication [J].
Jaeger, H ;
Haas, H .
SCIENCE, 2004, 304 (5667) :78-80
[10]   Self-Identification of Cable-Driven Exoskeleton Based on Asynchronous Iterative Method [J].
Ji, Yuhan ;
Chen, Weihai ;
Zhang, Jianbin ;
Li, Zhongyi ;
Fang, Zaojun ;
Yang, Guilin .
JOURNAL OF MECHANISMS AND ROBOTICS-TRANSACTIONS OF THE ASME, 2022, 14 (02)