Continuous and simultaneous estimation of lower limb multi-joint angles from sEMG signals based on stacked convolutional and LSTM models

被引:60
作者
Lu, Yanzheng [1 ]
Wang, Hong [1 ]
Zhou, Bin [1 ]
Wei, Chunfeng [1 ]
Xu, Shiqiang [1 ]
机构
[1] Northeastern Univ, Sch Mech Engn & Automat, Shenyang 110819, Peoples R China
关键词
Regression analysis; EMG; Joint angle estimation; Deep learning; Human-exoskeleton interaction; Kinematic model; EMG SIGNALS; NETWORK; CLASSIFICATION; RECOGNITION; PREDICTION; MOVEMENTS; WALKING; MOTION; ROBOT; LEG;
D O I
10.1016/j.eswa.2022.117340
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The smooth and natural interaction between human and lower limb exoskeleton is important. However, one of the challenges is that obtaining the joint rotation angles in time and accurately is difficult. In this paper, we propose the stacked convolutional and long-short term memory networks (Conv-LSTM) to estimate the hip, knee, and ankle joint angles from sEMG signals in locomotion modes including walk, run, stair descent, stair ascent, stand-to-sit, sit-to-stand, and jump. The joint angles are calculated from the kinematic models using the Euler angle signals measured by IMUs. The sEMG and joint angles are segmented according to the gait cycles measured by footswitch signals. Time-frequency analysis of sEMG signals is carried out using continuous wavelet transform. The Conv-LSTM model can extract the spatiotemporal information from the input to establish the mapping from sEMG sequences to multi-joint angle sequences. The evaluation effects of coefficient of determination (R-2), root mean squared error, and Dynamic Time Warping on estimation performance are compared. The time domain (TD) features of sEMG perform better on joint angle estimation than the frequency domain and time-frequency domain features (p < 0.05). The Conv-LSTM model with TD features as input outperforms the BP and state-of-the-art machine learning algorithms (kernel ridge, random forest, and support vector regression) on multi-joint angle estimation (R-2: 0.9334, 0.9110, 0.9236, 0.9238, 0.8999, 0.9430, 0.9351, p < 0.05). The estimation results are simulated in V-REP for exoskeleton control.
引用
收藏
页数:20
相关论文
共 59 条
[1]   A Nonlinear Dynamics-Based Estimator for Functional Electrical Stimulation: Preliminary Results From Lower-Leg Extension Experiments [J].
Allen, Marcus ;
Zhong, Qiang ;
Kirsch, Nicholas ;
Dani, Ashwin ;
Clark, William W. ;
Sharma, Nitin .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (12) :2365-2374
[2]   Human lower extremity joint moment prediction: A wavelet neural network approach [J].
Ardestani, Marzieh Mostafavizadeh ;
Zhang, Xuan ;
Wang, Ling ;
Lian, Qin ;
Liu, Yaxiong ;
He, Jiankang ;
Li, Dichen ;
Jin, Zhongmin .
EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (09) :4422-4433
[3]   A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaboration [J].
Bi, Luzheng ;
Feleke, Aberham Genetu ;
Guan, Cuntai .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2019, 51 :113-127
[4]   Inverted pendulum model for turn-planning for biped robot [J].
Chang, Lin ;
Piao, Songhao ;
Leng, Xiaokun ;
He, Zhicheng ;
Zhu, Zheng .
PHYSICAL COMMUNICATION, 2020, 42
[5]   Surface EMG based continuous estimation of human lower limb joint angles by using deep belief networks [J].
Chen, Jiangcheng ;
Zhang, Xiaodong ;
Cheng, Yu ;
Xi, Ning .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2018, 40 :335-342
[6]   Control of fast-reaching movements by muscle synergy combinations [J].
d'Avella, Andrea ;
Portone, Alessandro ;
Fernandez, Laure ;
Lacquaniti, Francesco .
JOURNAL OF NEUROSCIENCE, 2006, 26 (30) :7791-7810
[7]   Finger Joint Angle Estimation Based on Motoneuron Discharge Activities [J].
Dai, Chenyun ;
Hu, Xiaogang .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (03) :760-767
[8]   From deep learning to transfer learning for the prediction of skeletal muscle forces [J].
Dao, Tien Tuan .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2019, 57 (05) :1049-1058
[9]   Closing the Wearable Gap-Part VI: Human Gait Recognition Using Deep Learning Methodologies [J].
Davarzani, Samaneh ;
Saucier, David ;
Peranich, Preston ;
Carroll, Will ;
Turner, Alana ;
Parker, Erin ;
Middleton, Carver ;
Phuoc Nguyen ;
Robertson, Preston ;
Smith, Brian ;
Ball, John ;
Burch, Reuben ;
Chander, Harish ;
Knight, Adam ;
Prabhu, Raj ;
Luczak, Tony .
ELECTRONICS, 2020, 9 (05)
[10]   Influence of EMG-signal processing and experimental set-up on prediction of gait events by neural network [J].
Di Nardo, Francesco ;
Morbidoni, Christian ;
Cucchiarelli, Alessandro ;
Fioretti, Sandro .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 63