Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras

被引:190
作者
Nakano, Nobuyasu [1 ,2 ]
Sakura, Tetsuro [3 ]
Ueda, Kazuhiro [3 ]
Omura, Leon [1 ,2 ]
Kimura, Arata [1 ]
Iino, Yoichi [1 ]
Fukashiro, Senshi [1 ]
Yoshioka, Shinsuke [1 ]
机构
[1] Univ Tokyo, Grad Sch Arts & Sci, Dept Life Sci, Tokyo, Japan
[2] Japan Soc Promot Sci, Tokyo, Japan
[3] Univ Tokyo, Grad Sch Arts & Sci, Dept Gen Syst Studies, Tokyo, Japan
来源
FRONTIERS IN SPORTS AND ACTIVE LIVING | 2020年 / 2卷
关键词
openPose; markerless; motion capture; biomechanics; human movement; MICROSOFT KINECT;
D O I
10.3389/fspor.2020.00050
中图分类号
G8 [体育];
学科分类号
04 ; 0403 ;
摘要
There is a need within human movement sciences for a markerless motion capture system, which is easy to use and sufficiently accurate to evaluate motor performance. This study aims to develop a 3D markerless motion capture technique, using OpenPose with multiple synchronized video cameras, and examine its accuracy in comparison with optical marker-based motion capture. Participants performed three motor tasks (walking, countermovement jumping, and ball throwing), and these movements measured using both marker-based optical motion capture and OpenPose-based markerless motion capture. The differences in corresponding joint positions, estimated from the two different methods throughout the analysis, were presented as a mean absolute error (MAE). The results demonstrated that, qualitatively, 3D pose estimation using markerless motion capture could correctly reproduce the movements of participants. Quantitatively, of all the mean absolute errors calculated, approximately 47% were < 20 mm, and 80% were < 30 mm. However, 10% were > 40 mm. The primary reason for mean absolute errors exceeding 40 mm was that OpenPose failed to track the participant's pose in 2D images owing to failures, such as recognition of an object as a human body segment or replacing one segment with another depending on the image of each frame. In conclusion, this study demonstrates that, if an algorithm that corrects all apparently wrong tracking can be incorporated into the system, OpenPose-based markerless motion capture can be used for human movement science with an accuracy of 30 mm or less.</p>
引用
收藏
页数:9
相关论文
共 23 条
  • [1] Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
    Cao, Zhe
    Simon, Tomas
    Wei, Shih-En
    Sheikh, Yaser
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1302 - 1310
  • [2] 3D Human Pose Estimation=2D Pose Estimation plus Matching
    Chen, Ching-Hang
    Ramanan, Deva
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5759 - 5767
  • [3] Validity of the Microsoft Kinect for assessment of postural control
    Clark, Ross A.
    Pua, Yong-Hao
    Fortin, Karine
    Ritchie, Callan
    Webster, Kate E.
    Denehy, Linda
    Bryant, Adam L.
    [J]. GAIT & POSTURE, 2012, 36 (03) : 372 - 377
  • [4] CMU Perceptual Computing Lab, 2017, OPENPOSE REAL TIM MU
  • [5] Leveraging Two Kinect Sensors for Accurate Full-Body Motion Capture
    Gao, Zhiquan
    Yu, Yao
    Zhou, Yu
    Du, Sidan
    [J]. SENSORS, 2015, 15 (09) : 24297 - 24317
  • [6] Prediction of the hip joint centre in adults, children, and patients with cerebral palsy based on magnetic resonance imaging
    Harrington, M. E.
    Zavatsky, A. B.
    Lawson, S. E. M.
    Yuan, Z.
    Theologis, T. N.
    [J]. JOURNAL OF BIOMECHANICS, 2007, 40 (03) : 595 - 602
  • [7] Learnable Triangulation of Human Pose
    Iskakov, Karim
    Burkov, Egor
    Lempitsky, Victor
    Malkov, Yury
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7717 - 7726
  • [8] Mechanical properties of upper torso rotation from the viewpoint of energetics during baseball pitching
    Kimura, Arata
    Yoshioka, Shinsuke
    Omura, Leon
    Fukashiro, Senshi
    [J]. EUROPEAN JOURNAL OF SPORT SCIENCE, 2020, 20 (05) : 606 - 613
  • [9] A TECHNIQUE FOR OBTAINING SPATIAL KINEMATIC PARAMETERS OF SEGMENTS OF BIOMECHANICAL SYSTEMS FROM CINEMATOGRAPHIC DATA
    MILLER, NR
    SHAPIRO, R
    MCLAUGHLIN, TM
    [J]. JOURNAL OF BIOMECHANICS, 1980, 13 (07) : 535 - +
  • [10] Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image
    Moon, Gyeongsik
    Chang, Ju Yong
    Lee, Kyoung Mu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 10132 - 10141