A Deep Neural Network-based method for estimation of 3D lifting motions

被引:29
|
作者
Mehrizi, Rahil [1 ]
Peng, Xi [2 ]
Xu, Xu [5 ]
Zhang, Shaoting [6 ]
Li, Kang [2 ,3 ,4 ]
机构
[1] Rutgers State Univ, Dept Ind & Syst Engn, Piscataway, NJ USA
[2] Rutgers State Univ, Dept Comp Sci, Piscataway, NJ USA
[3] Rutgers State Univ, Dept Biomed Engn, Piscataway, NJ USA
[4] Rutgers New Jersey Med Sch, Dept Orthopaed, Newark, NJ 07103 USA
[5] North Carolina State Univ, Edward P Fitts Dept Ind & Syst Engn, Raleigh, NC 27695 USA
[6] Univ N Carolina, Dept Comp Sci, Charlotte, NC USA
关键词
3D pose estimation; Machine learning; Deep Neural Network; Lifting; Biomechanics; MARKERLESS; KINEMATICS; DISORDERS; CAPTURE;
D O I
10.1016/j.jbiomech.2018.12.022
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The aim of this study is developing and validating a Deep Neural Network (DNN) based method for 3D pose estimation during lifting. The proposed DNN based method addresses problems associated with marker-based motion capture systems like excessive preparation time, movement obstruction, and controlled environment requirement. Twelve healthy adults participated in a protocol and performed nine lifting tasks with different vertical heights and asymmetry angles. They lifted a crate and placed it on a shelf while being filmed by two camcorders and a synchronized motion capture system, which directly measured their body movement. A DNN with two-stage cascaded structure was designed to estimate subjects' 3D body pose from images captured by camcorders. Our DNN augmented Hourglass network for monocular 2D pose estimation with a novel 3D pose generator subnetwork, which synthesized information from all available views to predict accurate 3D pose. We validated the results against the marker based motion capture system as a reference and examined the method performance under different lifting conditions. The average Euclidean distance between the estimated 3D pose and reference (3D pose error) on the whole dataset was 14.72 +/- 2.96 mm. Repeated measures ANOVAs showed lifting conditions can affect the method performance e.g. 60 degrees asymmetry angle and shoulder height lifting showed higher 3D pose error compare to other lifting conditions. The results demonstrated the capability of the proposed method for 3D pose estimation with high accuracy and without limitations of marker-based motion capture systems. The proposed method may be utilized as an on-site biomechanical analysis tool. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 93
页数:7
相关论文
共 50 条
  • [41] Graph neural network-based 3D asphalt concrete pavement response modelling
    Liu, Fangyu
    Al-Qadi, Imad L.
    INTERNATIONAL JOURNAL OF PAVEMENT ENGINEERING, 2025, 26 (01)
  • [42] 3D convolution neural network-based person identification using gait cycles
    Supraja, P.
    Tom, Rijo Jackson
    Tiwari, Ravi Shekhar
    Vijayakumar, V.
    Liu, Yan
    EVOLVING SYSTEMS, 2021, 12 (04) : 1045 - 1056
  • [43] A DEEP NEURAL NETWORK-BASED NUMERICAL METHOD FOR SOLVING CONTACT PROBLEMS
    Shen, X. I. N. G.
    Cheng, X. I. A. O. L. I. A. N. G.
    Liang, K. E. W. E., I
    Wang, X. I. L. U.
    Wu, Z. H. E. N. G. H. U. A.
    JOURNAL OF NONLINEAR AND VARIATIONAL ANALYSIS, 2022, 6 (05): : 483 - 498
  • [44] Deep convolutional neural network-based Bernoulli heatmap for head pose estimation
    Hu, Zhongxu
    Xing, Yang
    Lv, Chen
    Hang, Peng
    Liu, Jie
    NEUROCOMPUTING, 2021, 436 : 198 - 209
  • [45] DEEP NEURAL NETWORK-BASED NOISY PIXEL ESTIMATION FOR BREAST ULTRASOUND SEGMENTATION
    Jin, Songbai
    Lu, Wenkai
    Monkam, Patrice
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1776 - 1780
  • [46] A grasping posture estimation method based on 3D detection network
    Ge, Junyan
    Shi, Jinlong
    Zhou, Zhiqiang
    Wang, Zhi
    Qian, Qiang
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 100
  • [47] An optimal 3D convolutional neural network based lipreading method
    He, Lun
    Ding, Biyun
    Wang, Hao
    Zhang, Tao
    IET IMAGE PROCESSING, 2022, 16 (01) : 113 - 122
  • [48] A grasping posture estimation method based on 3D detection network
    Ge, Junyan
    Shi, Jinlong
    Zhou, Zhiqiang
    Wang, Zhi
    Qian, Qiang
    Computers and Electrical Engineering, 2022, 100
  • [49] Deep Neural Network for 3D Shape Classification Based on Mesh Feature
    Gao, Mengran
    Ruan, Ningjun
    Shi, Junpeng
    Zhou, Wanli
    SENSORS, 2022, 22 (18)
  • [50] 3D laser scanning strategy based on cascaded deep neural network
    Xu, Xiao-bin
    Zhao, Ming-hui
    Yang, Jian
    Xiong, Yi-yang
    Pang, Feng-lin
    Tan, Zhi-ying
    Luo, Min-zhou
    DEFENCE TECHNOLOGY, 2022, 18 (09) : 1727 - 1739