A Deep Neural Network-based method for estimation of 3D lifting motions

被引:29
|
作者
Mehrizi, Rahil [1 ]
Peng, Xi [2 ]
Xu, Xu [5 ]
Zhang, Shaoting [6 ]
Li, Kang [2 ,3 ,4 ]
机构
[1] Rutgers State Univ, Dept Ind & Syst Engn, Piscataway, NJ USA
[2] Rutgers State Univ, Dept Comp Sci, Piscataway, NJ USA
[3] Rutgers State Univ, Dept Biomed Engn, Piscataway, NJ USA
[4] Rutgers New Jersey Med Sch, Dept Orthopaed, Newark, NJ 07103 USA
[5] North Carolina State Univ, Edward P Fitts Dept Ind & Syst Engn, Raleigh, NC 27695 USA
[6] Univ N Carolina, Dept Comp Sci, Charlotte, NC USA
关键词
3D pose estimation; Machine learning; Deep Neural Network; Lifting; Biomechanics; MARKERLESS; KINEMATICS; DISORDERS; CAPTURE;
D O I
10.1016/j.jbiomech.2018.12.022
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The aim of this study is developing and validating a Deep Neural Network (DNN) based method for 3D pose estimation during lifting. The proposed DNN based method addresses problems associated with marker-based motion capture systems like excessive preparation time, movement obstruction, and controlled environment requirement. Twelve healthy adults participated in a protocol and performed nine lifting tasks with different vertical heights and asymmetry angles. They lifted a crate and placed it on a shelf while being filmed by two camcorders and a synchronized motion capture system, which directly measured their body movement. A DNN with two-stage cascaded structure was designed to estimate subjects' 3D body pose from images captured by camcorders. Our DNN augmented Hourglass network for monocular 2D pose estimation with a novel 3D pose generator subnetwork, which synthesized information from all available views to predict accurate 3D pose. We validated the results against the marker based motion capture system as a reference and examined the method performance under different lifting conditions. The average Euclidean distance between the estimated 3D pose and reference (3D pose error) on the whole dataset was 14.72 +/- 2.96 mm. Repeated measures ANOVAs showed lifting conditions can affect the method performance e.g. 60 degrees asymmetry angle and shoulder height lifting showed higher 3D pose error compare to other lifting conditions. The results demonstrated the capability of the proposed method for 3D pose estimation with high accuracy and without limitations of marker-based motion capture systems. The proposed method may be utilized as an on-site biomechanical analysis tool. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 93
页数:7
相关论文
共 50 条
  • [1] A computer vision based method for 3D posture estimation of symmetrical lifting
    Mehrizi, Rahil
    Peng, Xi
    Xu, Xu
    Zhang, Shaoting
    Metaxas, Dimitris
    Li, Kang
    JOURNAL OF BIOMECHANICS, 2018, 69 : 40 - 46
  • [2] Neural Network-Based Method for Orbit Uncertainty Propagation and Estimation
    Zhou, Xingyu
    Qiao, Dong
    Li, Xiangyu
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (01) : 1176 - 1193
  • [3] Deep Neural Network Integrated into Network-Based Stratification (D3NS): A Method to Uncover Cancer Subtypes from Somatic Mutations
    Valerio, Matteo
    Inno, Alessandro
    Zambelli, Alberto
    Cortesi, Laura
    Lorusso, Domenica
    Viassolo, Valeria
    Verze, Matteo
    Nicolis, Fabrizio
    Gori, Stefania
    CANCERS, 2024, 16 (16)
  • [4] Deep Neural Network-Based QoT Estimation for SMF and FMF Links
    Amirabadi, Mohammad Ali
    Kahaei, Mohammad Hossein
    Nezamalhosseini, S. Alireza
    Arpanaei, Farhad
    Carena, Andrea
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2023, 41 (06) : 1684 - 1695
  • [5] A deep neural network approach for accurate 3D shape estimation of soft manipulator with vision correction
    Zou, Shuangquan
    Lyu, Yueyong
    Qi, Jiaming
    Ma, Guangfu
    Guo, Yanning
    SENSORS AND ACTUATORS A-PHYSICAL, 2022, 344
  • [6] Study on 3D Action Recognition Based on Deep Neural Network
    Park, Sungjoo
    Kim, Dongchil
    2019 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2019, : 309 - 311
  • [7] Enhanced 3D Action Recognition Based on Deep Neural Network
    Park, Sungjoo
    Kim, Dongchil
    2022 THIRTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN), 2022, : 470 - 472
  • [8] Brain age estimation based on 3D MRI images using 3D convolutional neural network
    Pardakhti, Nastaran
    Sajedi, Hedieh
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (33-34) : 25051 - 25065
  • [9] A deep neural network-based approach for prediction of mutagenicity of compounds
    Kumar, Rajnish
    Khan, Farhat Ullah
    Sharma, Anju
    Siddiqui, Mohammed Haris
    Aziz, Izzatdin B. A.
    Kamal, Mohammad Amjad
    Ashraf, Ghulam Md
    Alghamdi, Badrah S.
    Uddin, Md Sahab
    ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH, 2021, 28 (34) : 47641 - 47650
  • [10] Brain age estimation based on 3D MRI images using 3D convolutional neural network
    Nastaran Pardakhti
    Hedieh Sajedi
    Multimedia Tools and Applications, 2020, 79 : 25051 - 25065