A Deep Neural Network-based method for estimation of 3D lifting motions

被引:29
作者
Mehrizi, Rahil [1 ]
Peng, Xi [2 ]
Xu, Xu [5 ]
Zhang, Shaoting [6 ]
Li, Kang [2 ,3 ,4 ]
机构
[1] Rutgers State Univ, Dept Ind & Syst Engn, Piscataway, NJ USA
[2] Rutgers State Univ, Dept Comp Sci, Piscataway, NJ USA
[3] Rutgers State Univ, Dept Biomed Engn, Piscataway, NJ USA
[4] Rutgers New Jersey Med Sch, Dept Orthopaed, Newark, NJ 07103 USA
[5] North Carolina State Univ, Edward P Fitts Dept Ind & Syst Engn, Raleigh, NC 27695 USA
[6] Univ N Carolina, Dept Comp Sci, Charlotte, NC USA
关键词
3D pose estimation; Machine learning; Deep Neural Network; Lifting; Biomechanics; MARKERLESS; KINEMATICS; DISORDERS; CAPTURE;
D O I
10.1016/j.jbiomech.2018.12.022
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The aim of this study is developing and validating a Deep Neural Network (DNN) based method for 3D pose estimation during lifting. The proposed DNN based method addresses problems associated with marker-based motion capture systems like excessive preparation time, movement obstruction, and controlled environment requirement. Twelve healthy adults participated in a protocol and performed nine lifting tasks with different vertical heights and asymmetry angles. They lifted a crate and placed it on a shelf while being filmed by two camcorders and a synchronized motion capture system, which directly measured their body movement. A DNN with two-stage cascaded structure was designed to estimate subjects' 3D body pose from images captured by camcorders. Our DNN augmented Hourglass network for monocular 2D pose estimation with a novel 3D pose generator subnetwork, which synthesized information from all available views to predict accurate 3D pose. We validated the results against the marker based motion capture system as a reference and examined the method performance under different lifting conditions. The average Euclidean distance between the estimated 3D pose and reference (3D pose error) on the whole dataset was 14.72 +/- 2.96 mm. Repeated measures ANOVAs showed lifting conditions can affect the method performance e.g. 60 degrees asymmetry angle and shoulder height lifting showed higher 3D pose error compare to other lifting conditions. The results demonstrated the capability of the proposed method for 3D pose estimation with high accuracy and without limitations of marker-based motion capture systems. The proposed method may be utilized as an on-site biomechanical analysis tool. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 93
页数:7
相关论文
共 50 条
  • [21] Neural Network-Based Joint Velocity Estimation Method for Improving Robot Control Performance
    Kim, Dongwhan
    Hwang, Soonwook
    Lim, Myotaeg
    Oh, Yonghwan
    Lee, Yisoo
    IEEE ACCESS, 2023, 11 : 130517 - 130526
  • [22] Deep Neural Network-Based Noise Estimation for Robust ASR in Dual-Microphone Smartphones
    Lopez-Espejo, Ivan
    Peinado, Antonio M.
    Gomez, Angel M.
    Martin-Donas, Juan M.
    ADVANCES IN SPEECH AND LANGUAGE TECHNOLOGIES FOR IBERIAN LANGUAGES, IBERSPEECH 2016, 2016, 10077 : 117 - 127
  • [23] A deep neural network-based smart error measurement method for fiscal accounting data
    Cai, Yutian
    Wang, Ting
    Wang, Shaohua
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (06) : 10866 - 10882
  • [24] Deep Neural Network Enhanced Sampling-Based Path Planning in 3D Space
    Wang, Jiankun
    Jia, Xiao
    Zhang, Tianyi
    Ma, Nachuan
    Meng, Max Q-H
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (04) : 3434 - 3443
  • [25] AttPNet: Attention-Based Deep Neural Network for 3D Point Set Analysis
    Yang, Yufeng
    Ma, Yixiao
    Zhang, Jing
    Gao, Xin
    Xu, Min
    SENSORS, 2020, 20 (19) : 1 - 20
  • [26] Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery
    Kim, Samuel
    Lu, Peter Y.
    Mukherjee, Srijon
    Gilbert, Michael
    Jing, Li
    Ceperic, Vladimir
    Soljacic, Marin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (09) : 4166 - 4177
  • [27] Generative Adversarial Network-Based Method for Transforming Single RGB Image Into 3D Point Cloud
    Chu, Phuong Minh
    Sung, Yunsick
    Cho, Kyungeun
    IEEE ACCESS, 2019, 7 : 1021 - 1029
  • [28] MRSL: Autonomous Neural Network-Based 3-D Positioning System
    Hedayati, Hooman
    Tabrizi, Nasseh
    2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI), 2015, : 170 - 174
  • [29] Deep Neural Network-based Automatic Modulation Classification Technique
    Kim, Byeoungdo
    Kim, Jaekyum
    Chae, Hyunmin
    Yoon, Dongweon
    Choi, Jun Won
    2016 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC 2016): TOWARDS SMARTER HYPER-CONNECTED WORLD, 2016, : 579 - 582
  • [30] Deep neural network-based bandwidth enhancement of photoacoustic data
    Gutta, Sreedevi
    Kadimesetty, Venkata Suryanarayana
    Kalva, Sandeep Kumar
    Pramanik, Manojit
    Ganapathy, Sriram
    Yalavarthy, Phaneendra K.
    JOURNAL OF BIOMEDICAL OPTICS, 2017, 22 (11)