A Brain-Inspired Decision-Making method for upper limb exoskeleton based on Multi-Brain-Region structure and multimodal information fusion

被引:2
作者
Wang, Wendong [1 ,4 ]
Ren, Huizhao [1 ]
Su, Shibin [2 ]
Zhang, Peng [3 ]
Zhang, Junbo [1 ]
机构
[1] Northwestern Polytech Univ, Sch Mech Engn, Xian, Peoples R China
[2] CSSC Huangpu Wenchong Shipbuliding Co Ltd, Tech Dept, Guangzhou, Peoples R China
[3] Northwestern Polytech Univ, Training Ctr Engn Pract, Xian, Peoples R China
[4] Northwestern Polytech Univ, Chongqing Innovat Ctr, Chongqing, Peoples R China
关键词
Upper limb exoskeleton; sEMG; Multimodal information fusion; Spiking neural network; Echo state network;
D O I
10.1016/j.measurement.2024.115728
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
For the challenges faced by upper limb exoskeleton in meeting human motion intention, this article proposes a novel brain-inspired decision-making model based on multi-brain-region information transmission mechanism and multimodal information fusion method to provide accurate prediction of motion trajectory. Firstly, a multimodal information perception and fusion method is proposed. Based on surface electromyographic (sEMG) signals and angle signals collected by sensors. Then a random forest algorithm is applied to screen the key features of sEMG signal for trajectory prediction. A multimodal information hierarchical fusion method based on dual-period mechanism is designed to solve the problem of fusion defect of information with different frequency. Finally, a multi-brain-region decision-making model based on hybrid hierarchical liquid state machine (HHLSM) is established to predict motion trajectory for the exoskeleton to meet human motion intention. Experiments show that the established model has a high computational efficiency and improves the effectiveness of exoskeleton assistance. The brain-inspired decision-making model based on HHLSM established in this paper is of great significance for further research on brain-inspired control and improving the human-robot interaction effect of upper limb exoskeleton.
引用
收藏
页数:9
相关论文
共 31 条
[21]   Microphone Mechanomyography Sensors for Movement Analysis and Identification [J].
Paszkiewicz, Filip P. ;
Wilson, Samuel ;
Oddsson, Magnus ;
McGregor, Alison H. ;
Alexandersson, Asgeir ;
Huo, Weiguang ;
Vaidyanathan, Ravi .
2022 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2022), 2022, :118-125
[22]   Exoskeleton Application to Military Manual Handling Tasks [J].
Proud, Jasmine K. ;
Lai, Daniel T. H. ;
Mudie, Kurt L. ;
Carstairs, Greg L. ;
Billing, Daniel C. ;
Garofolini, Alessandro ;
Begg, Rezaul K. .
HUMAN FACTORS, 2022, 64 (03) :527-554
[23]   Towards spike-based machine intelligence with neuromorphic computing [J].
Roy, Kaushik ;
Jaiswal, Akhilesh ;
Panda, Priyadarshini .
NATURE, 2019, 575 (7784) :607-617
[24]   Artificial Intelligence-Based Wearable Robotic Exoskeletons for Upper Limb Rehabilitation: A Review [J].
Velez-Guerrero, Manuel Andres ;
Callejas-Cuervo, Mauro ;
Mazzoleni, Stefano .
SENSORS, 2021, 21 (06) :1-30
[25]   Adaptive Knee Joint Exoskeleton Based on Biological Geometries [J].
Wang, Donghai ;
Lee, Kok-Meng ;
Guo, Jiajie ;
Yang, Can-Jun .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2014, 19 (04) :1268-1278
[26]   Motion intensity modeling and trajectory control of upper limb rehabilitation exoskeleton robot based on multi-modal information [J].
Wang, WenDong ;
Zhang, JunBo ;
Wang, Xin ;
Yuan, XiaoQing ;
Zhang, Peng .
COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (03) :2091-2103
[27]   A novel fatigue detection method for rehabilitation training of upper limb exoskeleton robot using multi-information fusion [J].
Wang, Wendong ;
Li, Hanhao ;
Kong, Dezhi ;
Xiao, Menghan ;
Zhang, Peng .
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (06)
[28]  
Wang Y., 2022, Ieee-Asme Transactions on Mechatronics
[29]   Disturbance Observer-Based Terminal Sliding Mode Control of a 5-DOF Upper-Limb Exoskeleton Robot [J].
Yang, Peng ;
Ma, Xiao ;
Wang, Jie ;
Zhang, Gaowei ;
Zhang, Yan ;
Chen, Lingling .
IEEE ACCESS, 2019, 7 :62833-62839
[30]   An intention-based online bilateral training system for upper limb motor rehabilitation [J].
Yang, Ziyi ;
Guo, Shuxiang ;
Liu, Yi ;
Hirata, Hideyuki ;
Tamiya, Takashi .
MICROSYSTEM TECHNOLOGIES-MICRO-AND NANOSYSTEMS-INFORMATION STORAGE AND PROCESSING SYSTEMS, 2021, 27 (01) :211-222