A Deep Neural Network-based method for estimation of 3D lifting motions

被引:29
作者
Mehrizi, Rahil [1 ]
Peng, Xi [2 ]
Xu, Xu [5 ]
Zhang, Shaoting [6 ]
Li, Kang [2 ,3 ,4 ]
机构
[1] Rutgers State Univ, Dept Ind & Syst Engn, Piscataway, NJ USA
[2] Rutgers State Univ, Dept Comp Sci, Piscataway, NJ USA
[3] Rutgers State Univ, Dept Biomed Engn, Piscataway, NJ USA
[4] Rutgers New Jersey Med Sch, Dept Orthopaed, Newark, NJ 07103 USA
[5] North Carolina State Univ, Edward P Fitts Dept Ind & Syst Engn, Raleigh, NC 27695 USA
[6] Univ N Carolina, Dept Comp Sci, Charlotte, NC USA
关键词
3D pose estimation; Machine learning; Deep Neural Network; Lifting; Biomechanics; MARKERLESS; KINEMATICS; DISORDERS; CAPTURE;
D O I
10.1016/j.jbiomech.2018.12.022
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The aim of this study is developing and validating a Deep Neural Network (DNN) based method for 3D pose estimation during lifting. The proposed DNN based method addresses problems associated with marker-based motion capture systems like excessive preparation time, movement obstruction, and controlled environment requirement. Twelve healthy adults participated in a protocol and performed nine lifting tasks with different vertical heights and asymmetry angles. They lifted a crate and placed it on a shelf while being filmed by two camcorders and a synchronized motion capture system, which directly measured their body movement. A DNN with two-stage cascaded structure was designed to estimate subjects' 3D body pose from images captured by camcorders. Our DNN augmented Hourglass network for monocular 2D pose estimation with a novel 3D pose generator subnetwork, which synthesized information from all available views to predict accurate 3D pose. We validated the results against the marker based motion capture system as a reference and examined the method performance under different lifting conditions. The average Euclidean distance between the estimated 3D pose and reference (3D pose error) on the whole dataset was 14.72 +/- 2.96 mm. Repeated measures ANOVAs showed lifting conditions can affect the method performance e.g. 60 degrees asymmetry angle and shoulder height lifting showed higher 3D pose error compare to other lifting conditions. The results demonstrated the capability of the proposed method for 3D pose estimation with high accuracy and without limitations of marker-based motion capture systems. The proposed method may be utilized as an on-site biomechanical analysis tool. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 93
页数:7
相关论文
共 50 条
  • [41] An unsupervised adaptation method for deep neural network-based large vocabulary continuous speech recognition
    Xiao, Yeming
    Si, Yujing
    Xu, Ji
    Pan, Jielin
    Yan, Yonghong
    Journal of Information and Computational Science, 2014, 11 (14): : 4889 - 4899
  • [42] Bayesian Hyperparameter Optimization for Deep Neural Network-Based Network Intrusion Detection
    Masum, Mohammad
    Shahriar, Hossain
    Haddad, Hisham
    Faruk, Md Jobair Hossain
    Valero, Maria
    Khan, Md Abdullah
    Rahman, Mohammad A.
    Adnan, Muhaiminul, I
    Cuzzocrea, Alfredo
    Wu, Fan
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 5413 - 5419
  • [43] Combination of Deep Learner Network and Transformer for 3D Human Pose Estimation
    Tien-Dat Tran
    Xuan-Thuy Vo
    Duy-Linh Nguyen
    Jo, Kang-Hyun
    2022 22ND INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2022), 2022, : 174 - 178
  • [44] Software code refactoring based on deep neural network-based fitness function
    Karakati, Chitti Babu
    Thirumaaran, Sethukarasi
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (04)
  • [45] A Deep Neural Network-Based Feature Fusion for Bearing Fault Diagnosis
    Hoang, Duy Tang
    Tran, Xuan Toa
    Van, Mien
    Kang, Hee Jun
    SENSORS, 2021, 21 (01) : 1 - 13
  • [46] A Deep Neural Network-based Estimation of EMI Reduction by an Intermediate Coil in Automotive Wireless Power Transfer System
    Sim, Boogyo
    Lho, Daehwan
    Park, Dongryul
    Park, Hyunwook
    Kang, Hyungmin
    Kim, Joungho
    2020 IEEE INTERNATIONAL SYMPOSIUM ON ELECTROMAGNETIC COMPATIBILITY AND SIGNAL & POWER INTEGRITY VIRTUAL SYMPOSIUM(IEEE EMC+SIPI), 2020, : 407 - 410
  • [47] Deep Neural Network-Based Blind Modulation Classification for Fading Channels
    Lee, JungHwan
    Kim, Bueoungdo
    Kim, Jaekyum
    Yoon, Dongweon
    Choi, Jun Won
    2017 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2017, : 551 - 554
  • [48] A Deep Neural Network-Based Permanent Magnet Localization for Tongue Tracking
    Sebkhi, Nordine
    Sahadat, Nazmus
    Hersek, Sinan
    Bhaysar, Arpan
    Siahpoushan, Shayan
    Ghovanloo, Maysam
    Inan, Omer T.
    IEEE SENSORS JOURNAL, 2019, 19 (20) : 9324 - 9331
  • [49] A Deep Neural Network-Based Assistive Decision Method for Financial Risk Prediction in Carbon Trading Market
    Luo, Ji
    Zhuo, Wuyang
    Xu, Binfei
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (08)
  • [50] Deep Neural Network-based Feature Descriptor for Retinal Image Registration
    Sabanovic, Eldar
    Stankevicius, Gediminas
    Matuzevicius, Dalius
    2018 IEEE 6TH WORKSHOP ON ADVANCES IN INFORMATION, ELECTRONIC AND ELECTRICAL ENGINEERING (AIEEE), 2018,