3D Knee and Hip Angle Estimation With Reduced Wearable IMUs via Transfer Learning During Yoga, Golf, Swimming, Badminton, and Dance

被引:3
作者
Li, Jinxuan [1 ]
Zhu, Kezhe [1 ]
Li, Dongxuan [1 ]
Kang, Peiqi [1 ]
Shull, Peter B. [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, State Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; prosthesis; activity recog-nition; reduced sensor set; transformer; ACTIVITY RECOGNITION; RISK-FACTORS; TRAJECTORIES; MOVEMENT; POSITION; WALKING; INJURY;
D O I
10.1109/TNSRE.2024.3349639
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Wearable lower-limb joint angle estimation using a reduced inertial measurement unit (IMU) sensor set could enable quick, economical sports injury risk assessment and motion capture; however the vast majority of existing research requires a full IMU set attached to every related body segment and is implemented in only a single movement, typically walking. We thus implemented 3-dimensional knee and hip angle estimation with a reduced IMU sensor set during yoga, golf, swimming (simulated lower body swimming in a seated posture), badminton, and dance movements. Additionally, current deep-learning models undergo an accuracy drop when tested with new and unseen activities, which necessitates collecting large amounts of data for the new activity. However, collecting large datasets for every new activity is time-consuming and expensive. Thus, a transfer learning (TL) approach with long short-term memory neural networks was proposed to enhance the model's generalization ability towards new activities while minimizing the need for a large new-activity dataset. This approach could transfer the generic knowledge acquired from training the model in the source-activity domain to the target-activity domain. The maximum improvement in estimation accuracy (RMSE) achieved by TL is 23.6 degrees for knee flexion/extension and 22.2 degrees for hip flexion/extension compared to without TL. These results extend the application of motion capture with reduced sensor configurations to a broader range of activities relevant to injury prevention and sports training. Moreover, they enhance the capacity of data-driven models in scenarios where acquiring a substantial amount of training data is challenging.
引用
收藏
页码:325 / 338
页数:14
相关论文
共 61 条
  • [1] Ahn Y., 2016, PROC IEEE 18 INT C E, P1
  • [2] A Deep Transfer Learning Approach to Reducing the Effect of Electrode Shift in EMG Pattern Recognition-Based Control
    Ameri, Ali
    Akhaee, Mohammad Ali
    Scheme, Erik
    Englehart, Kevin
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (02) : 370 - 379
  • [3] Physical Human Activity Recognition Using Wearable Sensors
    Attal, Ferhat
    Mohammed, Samer
    Dedabrishvili, Mariam
    Chamroukhi, Faicel
    Oukhellou, Latifa
    Amirat, Yacine
    [J]. SENSORS, 2015, 15 (12) : 31314 - 31338
  • [4] Risk Factors for Knee Injury in Golf: A Systematic Review
    Baker, Matthew L.
    Epari, Devakar R.
    Lorenzetti, Silvio
    Sayers, Mark
    Boutellier, Urs
    Taylor, William R.
    [J]. SPORTS MEDICINE, 2017, 47 (12) : 2621 - 2639
  • [5] Semwal VB, 2017, Arxiv, DOI arXiv:1710.06548
  • [6] Golf Swing Biomechanics: A Systematic Review and Methodological Recommendations for Kinematics
    Bourgain, Maxime
    Rouch, Philippe
    Rouillon, Olivier
    Thoreux, Patricia
    Sauret, Christophe
    [J]. SPORTS, 2022, 10 (06)
  • [7] POSITION AND ORIENTATION IN-SPACE OF BONES DURING MOVEMENT - ANATOMICAL FRAME DEFINITION AND DETERMINATION
    CAPPOZZO, A
    CATANI, F
    DELLA CROCE, U
    LEARDINI, A
    [J]. CLINICAL BIOMECHANICS, 1995, 10 (04) : 171 - 178
  • [8] Motion analysis of front crawl swimming applying CAST technique by means of automatic tracking
    Ceccon, Stefano
    Ceseracciu, Elena
    Sawacha, Zimi
    Gatta, Giorgio
    Cortesi, Matteo
    Cobelli, Claudio
    Fantozzi, Silvia
    [J]. JOURNAL OF SPORTS SCIENCES, 2013, 31 (03) : 276 - 287
  • [9] An Optimized-LSTM and RGB-D Sensor-Based Human Gait Trajectory Generator for Bipedal Robot Walking
    Challa, Sravan Kumar
    Kumar, Akhilesh
    Semwal, Vijay Bhaskar
    Dua, Nidhi
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (24) : 24352 - 24363
  • [10] Transfer learning for activity recognition: a survey
    Cook, Diane
    Feuz, Kyle D.
    Krishnan, Narayanan C.
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2013, 36 (03) : 537 - 556