MocapMe: DeepLabCut-Enhanced Neural Network for Enhanced Markerless Stability in Sit-to-Stand Motion Capture

被引:1
作者
Milone, Dario [1 ]
Longo, Francesco [1 ]
Merlino, Giovanni [1 ]
De Marchis, Cristiano [1 ]
Risitano, Giacomo [1 ]
D'Agati, Luca [1 ]
机构
[1] Univ Messina, Dept Engn DI, I-98166 Messina, Italy
关键词
human movement analysis; motion tracking; neural network; markerless pose estimation; sit-to-stand analysis; OSTEOARTHRITIS; PREDICT;
D O I
10.3390/s24103022
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This study examined the efficacy of an optimized DeepLabCut (DLC) model in motion capture, with a particular focus on the sit-to-stand (STS) movement, which is crucial for assessing the functional capacity in elderly and postoperative patients. This research uniquely compared the performance of this optimized DLC model, which was trained using 'filtered' estimates from the widely used OpenPose (OP) model, thereby emphasizing computational effectiveness, motion-tracking precision, and enhanced stability in data capture. Utilizing a combination of smartphone-captured videos and specifically curated datasets, our methodological approach included data preparation, keypoint annotation, and extensive model training, with an emphasis on the flow of the optimized model. The findings demonstrate the superiority of the optimized DLC model in various aspects. It exhibited not only higher computational efficiency, with reduced processing times, but also greater precision and consistency in motion tracking thanks to the stability brought about by the meticulous selection of the OP data. This precision is vital for developing accurate biomechanical models for clinical interventions. Moreover, this study revealed that the optimized DLC maintained higher average confidence levels across datasets, indicating more reliable and accurate detection capabilities compared with standalone OP. The clinical relevance of these findings is profound. The optimized DLC model's efficiency and enhanced point estimation stability make it an invaluable tool in rehabilitation monitoring and patient assessments, potentially streamlining clinical workflows. This study suggests future research directions, including integrating the optimized DLC model with virtual reality environments for enhanced patient engagement and leveraging its improved data quality for predictive analytics in healthcare. Overall, the optimized DLC model emerged as a transformative tool for biomechanical analysis and physical rehabilitation, promising to enhance the quality of patient care and healthcare delivery efficiency.
引用
收藏
页数:16
相关论文
共 45 条
  • [1] Quantifying Jump Height Using Markerless Motion Capture with a Single Smartphone
    Aderinola, Timilehin B.
    Younesian, Hananeh
    Whelan, Darragh
    Caulfield, Brian
    Ifrim, Georgiana
    [J]. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY, 2023, 4 : 109 - 115
  • [2] Machine learning to detect, stage and classify diseases and their symptoms based on inertial sensor data: a mapping review
    Bibbo, Daniele
    De Marchis, Cristiano
    Schmid, Maurizio
    Ranaldi, Simone
    [J]. PHYSIOLOGICAL MEASUREMENT, 2023, 44 (12)
  • [3] Temporal, Kinematic and Kinetic Variables Derived from a Wearable 3D Inertial Sensor to Estimate Muscle Power during the 5 Sit to Stand Test in Older Individuals: A Validation Study
    Bochicchio, Gianluca
    Ferrari, Luca
    Bottari, Alberto
    Lucertini, Francesco
    Scarton, Alessandra
    Pogliaghi, Silvia
    [J]. SENSORS, 2023, 23 (10)
  • [4] Redefining Bradykinesia
    Bologna, Matteo
    Espay, Alberto J.
    Fasano, Alfonso
    Paparella, Giulia
    Hallett, Mark
    Berardelli, Alfredo
    [J]. MOVEMENT DISORDERS, 2023, 38 (04) : 551 - 557
  • [5] Sit-to-Stand Movement as a Performance-Based Measure for Patients With Total Knee Arthroplasty
    Boonstra, Miranda C.
    Schwering, Paul J. A.
    Malefijt, Maarten C. De Waal
    Verdonschot, Nico
    [J]. PHYSICAL THERAPY, 2010, 90 (02): : 149 - 156
  • [6] A neural network to predict the knee adduction moment in patients with osteoarthritis using anatomical landmarks obtainable from 2D video analysis
    Boswell, M. A.
    Uhlrich, S. D.
    Kidzinski, L.
    Thomas, K.
    Kolesar, J. A.
    Gold, G. E.
    Beaupre, G. S.
    Delp, S. L.
    [J]. OSTEOARTHRITIS AND CARTILAGE, 2021, 29 (03) : 346 - 356
  • [7] Smartphone videos of the sit-to-stand test predict osteoarthritis and health outcomes in a nationwide study
    Boswell, Melissa A.
    Kidzinski, Lukasz
    Hicks, Jennifer L.
    Uhlrich, Scott D.
    Falisse, Antoine
    Delp, Scott L.
    [J]. NPJ DIGITAL MEDICINE, 2023, 6 (01)
  • [8] OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
    Cao, Zhe
    Hidalgo, Gines
    Simon, Tomas
    Wei, Shih-En
    Sheikh, Yaser
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) : 172 - 186
  • [9] Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
    Cao, Zhe
    Simon, Tomas
    Wei, Shih-En
    Sheikh, Yaser
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1302 - 1310
  • [10] A 2D Markerless Gait Analysis Methodology: Validation on Healthy Subjects
    Castelli, Andrea
    Paolini, Gabriele
    Cereatti, Andrea
    Della Croce, Ugo
    [J]. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2015, 2015