MocapMe: DeepLabCut-Enhanced Neural Network for Enhanced Markerless Stability in Sit-to-Stand Motion Capture

被引:3
作者
Milone, Dario [1 ]
Longo, Francesco [1 ]
Merlino, Giovanni [1 ]
De Marchis, Cristiano [1 ]
Risitano, Giacomo [1 ]
D'Agati, Luca [1 ]
机构
[1] Univ Messina, Dept Engn DI, I-98166 Messina, Italy
关键词
human movement analysis; motion tracking; neural network; markerless pose estimation; sit-to-stand analysis; OSTEOARTHRITIS; PREDICT;
D O I
10.3390/s24103022
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This study examined the efficacy of an optimized DeepLabCut (DLC) model in motion capture, with a particular focus on the sit-to-stand (STS) movement, which is crucial for assessing the functional capacity in elderly and postoperative patients. This research uniquely compared the performance of this optimized DLC model, which was trained using 'filtered' estimates from the widely used OpenPose (OP) model, thereby emphasizing computational effectiveness, motion-tracking precision, and enhanced stability in data capture. Utilizing a combination of smartphone-captured videos and specifically curated datasets, our methodological approach included data preparation, keypoint annotation, and extensive model training, with an emphasis on the flow of the optimized model. The findings demonstrate the superiority of the optimized DLC model in various aspects. It exhibited not only higher computational efficiency, with reduced processing times, but also greater precision and consistency in motion tracking thanks to the stability brought about by the meticulous selection of the OP data. This precision is vital for developing accurate biomechanical models for clinical interventions. Moreover, this study revealed that the optimized DLC maintained higher average confidence levels across datasets, indicating more reliable and accurate detection capabilities compared with standalone OP. The clinical relevance of these findings is profound. The optimized DLC model's efficiency and enhanced point estimation stability make it an invaluable tool in rehabilitation monitoring and patient assessments, potentially streamlining clinical workflows. This study suggests future research directions, including integrating the optimized DLC model with virtual reality environments for enhanced patient engagement and leveraging its improved data quality for predictive analytics in healthcare. Overall, the optimized DLC model emerged as a transformative tool for biomechanical analysis and physical rehabilitation, promising to enhance the quality of patient care and healthcare delivery efficiency.
引用
收藏
页数:16
相关论文
共 45 条
[21]   Comparative Study of Markerless Vision-Based Gait Analyses for Person Re-Identification [J].
Kwon, Jaerock ;
Lee, Yunju ;
Lee, Jehyung .
SENSORS, 2021, 21 (24)
[22]  
Lonini Luca, 2022, Digit Biomark, V6, P9, DOI [10.1159/000520732, 10.1159/000520732]
[23]   DeepLabCut: markerless pose estimation of user-defined body parts with deep learning [J].
Mathis, Alexander ;
Mamidanna, Pranav ;
Cury, Kevin M. ;
Abe, Taiga ;
Murthy, Venkatesh N. ;
Mathis, Mackenzie Weygandt ;
Bethge, Matthias .
NATURE NEUROSCIENCE, 2018, 21 (09) :1281-+
[24]   Smart Design of Hip Replacement Prostheses Using Additive Manufacturing and Machine Learning Techniques [J].
Milone, Dario ;
D'Andrea, Danilo ;
Santonocito, Dario .
PROSTHESIS, 2024, 6 (01) :24-40
[25]   A New Approach for the Tribological and Mechanical Characterization of a Hip Prosthesis Trough a Numerical Model Based on Artificial Intelligence Algorithms and Humanoid Multibody Model [J].
Milone, Dario ;
Risitano, Giacomo ;
Pistone, Alessandro ;
Crisafulli, Davide ;
Alberti, Fabio .
LUBRICANTS, 2022, 10 (07)
[26]   Markerless vs. Marker-Based Gait Analysis: A Proof of Concept Study [J].
Moro, Matteo ;
Marchesi, Giorgia ;
Hesse, Filip ;
Odone, Francesca ;
Casadio, Maura .
SENSORS, 2022, 22 (05)
[27]   Synthesising 2D Video from 3D Motion Data for Machine Learning Applications [J].
Mundt, Marion ;
Oberlack, Henrike ;
Goldacre, Molly ;
Powles, Julia ;
Funken, Johannes ;
Morris, Corey ;
Potthast, Wolfgang ;
Alderson, Jacqueline .
SENSORS, 2022, 22 (17)
[28]   Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras [J].
Nakano, Nobuyasu ;
Sakura, Tetsuro ;
Ueda, Kazuhiro ;
Omura, Leon ;
Kimura, Arata ;
Iino, Yoichi ;
Fukashiro, Senshi ;
Yoshioka, Shinsuke .
FRONTIERS IN SPORTS AND ACTIVE LIVING, 2020, 2
[29]   Using DeepLabCut for 3D markerless pose estimation across species and behaviors [J].
Nath, Tanmay ;
Mathis, Alexander ;
Chen, An Chi ;
Patel, Amir ;
Bethge, Matthias ;
Mathis, Mackenzie Weygandt .
NATURE PROTOCOLS, 2019, 14 (07) :2152-2176
[30]   Can Markerless Pose Estimation Algorithms Estimate 3D Mass Centre Positions and Velocities during Linear Sprinting Activities? [J].
Needham, Laurie ;
Evans, Murray ;
Cosker, Darren P. ;
Colyer, Steffi L. .
SENSORS, 2021, 21 (08)