A CNN-Based Method for Intent Recognition Using Inertial Measurement Units and Intelligent Lower Limb Prosthesis

被引:113
|
作者
Su, Ben-Yue [1 ]
Wang, Jie [1 ]
Liu, Shuang-Qing [2 ]
Sheng, Min [2 ]
Jiang, Jing [3 ]
Xiang, Kui [4 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing 246133, Peoples R China
[2] Anqing Normal Univ, Sch Math & Computat Sci, Anqing 246133, Peoples R China
[3] Jiangsu Univ, Sch Comp Sci & Telecommun Engn, Zhenjiang 212013, Jiangsu, Peoples R China
[4] Wuhan Univ Technol, Sch Automat, Wuhan 430070, Hubei, Peoples R China
关键词
Intent recognition; lower limb prosthesis; inertial measurement unit (IMU); convolutional neural networks (CNN); swing phase; AMPUTEES; WALKING; CLASSIFICATION;
D O I
10.1109/TNSRE.2019.2909585
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Powered intelligent lower limb prosthesis can actuate the knee and ankle joints, allowing transfemoral amputees to perform seamless transitions between locomotion states with the help of an intent recognition system. However, prior intent recognition studies often installed multiple sensors on the prosthesis, and they employed machine learning techniques to analyze time-series datawith empirical features. We alternativelypropose a novel method for training an intent recognition system that provides natural transitions between level walk, stair ascent/descent, and ramp ascent/descent. Since the transition between two neighboring states is driven by motion intent, we aim to explore the mapping between the motion state of a healthy leg and an amputee'smotion intent before the upcoming transition of the prosthesis. We use inertial measurement units (IMUs) and put them on the healthy leg of lower limb amputees for monitoring its locomotion state. We analyze IMU data within the early swing phase of the healthy leg, and feed data into a convolutional neural network (CNN) to learn the feature mapping without expert participation. The proposed method can predict the motion intent of both unilateral amputees and the able-bodied, and help to adaptivelycalibrate the control strategy for actuating powered intelligentprosthesis in advance. The experimental results show that the recognition accuracy can reach a high level (94.15% for the able-bodied, 89.23% for amputees) on 13 classes ofmotion intent, containing five steady states on different terrains as well as eight transitional states among the steady states.
引用
收藏
页码:1032 / 1042
页数:11
相关论文
共 50 条
  • [31] Communication behavior recognition using CNN-based signal analysis
    Meng, Hao
    Lei, Yingke
    Teng, Fei
    Wang, Jin
    Liu, Changming
    Lou, Caiyi
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [32] Performance Evaluation of Lower Limb Ambulatory Measurement Using Reduced Inertial Measurement Units And 3R Gait Model
    Hu, Xinyao
    Yao, Cheng
    Soh, Gim Song
    PROCEEDINGS OF THE IEEE/RAS-EMBS INTERNATIONAL CONFERENCE ON REHABILITATION ROBOTICS (ICORR 2015), 2015, : 549 - 554
  • [33] RETRACTED: Research on the Improved CNN Deep Learning Method for Motion Intention Recognition of Dynamic Lower Limb Prosthesis (Retracted Article)
    Wang, Qiulin
    JOURNAL OF HEALTHCARE ENGINEERING, 2021, 2021
  • [34] Real-Time Kinematics Measurement of Human Lower-Limb Underwater Motions Based on Inertial Units
    Wu, Xianda
    Zhou, Zhihao
    Wang, Qining
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [35] An Intelligent Travel Application Using CNN-Based Deep Learning Technologies
    Lee, Kyungmin
    Shin, Mincheol
    Kim, Yongho
    Jeong, Hae-Duck J.
    INNOVATIVE MOBILE AND INTERNET SERVICES IN UBIQUITOUS COMPUTING, IMIS 2021, 2022, 279 : 221 - 231
  • [36] One-Dimensional CNN-Based Intelligent Recognition of Vibrations in Pipeline Monitoring With DAS
    Wu, Huijuan
    Chen, Jiping
    Liu, Xiangrong
    Xiao, Yao
    Wang, Mengjiao
    Zheng, Yi
    Rao, Yunjiang
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2019, 37 (17) : 4359 - 4366
  • [37] A Feasibility Study of Depth Image Based Intent Recognition for Lower Limb Prostheses
    Varol, Huseyin Atakan
    Massalin, Yerzhan
    2016 38TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2016, : 5055 - 5058
  • [38] Intent Pattern Recognition of Lower-limb Motion Based on Mechanical Sensors
    Zuojun Liu
    Wei Lin
    Yanli Geng
    Peng Yang
    IEEE/CAAJournalofAutomaticaSinica, 2017, 4 (04) : 651 - 660
  • [39] Intent Pattern Recognition of Lower-limb Motion Based on Mechanical Sensors
    Liu, Zuojun
    Lin, Wei
    Geng, Yanli
    Yang, Peng
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2017, 4 (04) : 651 - 660
  • [40] Improving CNN-based solutions for emotion recognition using evolutionary algorithms
    Mohammadrezaei, Parsa
    Aminan, Mohammad
    Soltanian, Mohammad
    Borna, Keivan
    RESULTS IN APPLIED MATHEMATICS, 2023, 18