A Novel Gait Phase Recognition Method Based on DPF-LSTM-CNN Using Wearable Inertial Sensors

被引:3
|
作者
Liu, Kun [1 ]
Liu, Yong [1 ]
Ji, Shuo [1 ]
Gao, Chi [1 ]
Zhang, Shizhong [1 ]
Fu, Jun [1 ]
机构
[1] Jilin Univ, Sch Mech & Aerosp Engn, Changchun 130025, Peoples R China
关键词
gait phase recognition; wearable inertial sensors; LSTM-CNN; data pre-filtering; EXOSKELETON; WALKING;
D O I
10.3390/s23135905
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Gait phase recognition is of great importance in the development of rehabilitation devices. The advantages of Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN) are combined (LSTM-CNN) in this paper, then a gait phase recognition method based on LSTM-CNN neural network model is proposed. In the LSTM-CNN model, the LSTM layer is used to process temporal sequences and the CNN layer is used to extract features A wireless sensor system including six inertial measurement units (IMU) fixed on the six positions of the lower limbs was developed. The difference in the gait recognition performance of the LSTM-CNN model was estimated using different groups of input data collected by seven different IMU grouping methods. Four phases in a complete gait were considered in this paper including the supporting phase with the right hill strike (SU-RHS), left leg swimming phase (SW-L), the supporting phase with the left hill strike (SU-LHS), and right leg swimming phase (SW-R). The results show that the best performance of the model in gait recognition appeared based on the group of data from all the six IMUs, with the recognition precision and macro-F1 unto 95.03% and 95.29%, respectively. At the same time, the best phase recognition accuracy for SU-RHS and SW-R appeared and up to 96.49% and 95.64%, respectively. The results also showed the best phase recognition accuracy (97.22%) for SW-L was acquired based on the group of data from four IMUs located at the left and right thighs and shanks. Comparably, the best phase recognition accuracy (97.86%) for SU-LHS was acquired based on the group of data from four IMUs located at left and right shanks and feet. Ulteriorly, a novel gait recognition method based on Data Pre-Filtering Long Short-Term Memory and Convolutional Neural Network (DPF-LSTM-CNN) model was proposed and its performance for gait phase recognition was evaluated. The experiment results showed that the recognition accuracy reached 97.21%, which was the highest compared to Deep convolutional neural networks (DCNN) and CNN-LSTM.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Gait Recognition With Wearable Sensors Using Modified Residual Block-Based Lightweight CNN
    Hasan, Md Al Mehedi
    Al Abir, Fuad
    Al Siam, Md
    Shin, Jungpil
    IEEE ACCESS, 2022, 10 : 42577 - 42588
  • [2] Wearable Gait Recognition Systems Based on MEMS Pressure and Inertial Sensors: A Review
    Li, Wenchao
    Lu, Wenqian
    Sha, Xiaopeng
    Xing, Hualin
    Lou, Jiazhi
    Sun, Hui
    Zhao, Yuliang
    IEEE SENSORS JOURNAL, 2022, 22 (02) : 1092 - 1104
  • [3] A Novel Gait Pattern Recognition Method Based on LSTM-CNN for Lower Limb Exoskeleton
    Chao-feng Chen
    Zhi-jiang Du
    Long He
    Yong-jun Shi
    Jia-qi Wang
    Wei Dong
    Journal of Bionic Engineering, 2021, 18 : 1059 - 1072
  • [4] A Novel Gait Pattern Recognition Method Based on LSTM-CNN for Lower Limb Exoskeleton
    Chen, Chao-feng
    Du, Zhi-jiang
    He, Long
    Shi, Yong-jun
    Wang, Jia-qi
    Dong, Wei
    JOURNAL OF BIONIC ENGINEERING, 2021, 18 (05) : 1059 - 1072
  • [5] A CNN-LSTM neural network for recognition of puffing in smoking episodes using wearable sensors
    Volkan Y. Senyurek
    Masudul H. Imtiaz
    Prajakta Belsare
    Stephen Tiffany
    Edward Sazonov
    Biomedical Engineering Letters, 2020, 10 : 195 - 203
  • [6] A CNN-LSTM neural network for recognition of puffing in smoking episodes using wearable sensors
    Senyurek, Volkan Y.
    Imtiaz, Masudul H.
    Belsare, Prajakta
    Tiffany, Stephen
    Sazonov, Edward
    BIOMEDICAL ENGINEERING LETTERS, 2020, 10 (02) : 195 - 203
  • [7] A Lightweight Attention-Based CNN Model for Efficient Gait Recognition with Wearable IMU Sensors
    Huang, Haohua
    Zhou, Pan
    Li, Ye
    Sun, Fangmin
    SENSORS, 2021, 21 (08)
  • [8] Objective Measures of Ataxic Gait Using Wearable Inertial Sensors
    El-Gohary, M.
    Horak, L.
    Gomez, C.
    MOVEMENT DISORDERS, 2018, 33 : S292 - S292
  • [9] Multimodal Gait Analysis based on Wearable Inertial and Microphone Sensors
    Wang, Cheng
    Wang, Xiangdong
    Long, Zhou
    Yuan, Jing
    Qian, Yueling
    Li, Jintao
    2017 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTED, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI), 2017,
  • [10] Novel Deep Learning Network for Gait Recognition Using Multimodal Inertial Sensors
    Shi, Ling-Feng
    Liu, Zhong-Ye
    Zhou, Ke-Jun
    Shi, Yifan
    Jing, Xiao
    SENSORS, 2023, 23 (02)