Deductive Learning for Weakly-Supervised 3D Human Pose Estimation via Uncalibrated Cameras

被引:0
|
作者
Chen, Xipeng [1 ]
Wei, Pengxu [1 ]
Lin, Liang [1 ,2 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] DarkMatter AI Res, Guangzhou, Peoples R China
基金
中国博士后科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Without prohibitive and laborious 3D annotations, weakly-supervised 3D human pose methods mainly employ the model regularization with geometric projection consistency or geometry estimation from multi-view images. Nevertheless, those approaches explicitly need known parameters of calibrated cameras, exhibiting a limited model generalization in various realistic scenarios. To mitigate this issue, in this paper, we propose a Deductive Weakly-Supervised Learning (DWSL) for 3D human pose machine. Our DWSL firstly learns latent representations on depth and camera pose for 3D pose reconstruction. Since weak supervision usually causes ill-conditioned learning or inferior estimation, our DWSL introduces deductive reasoning to make an inference for human pose from a view to another and develops a reconstruction loss to demonstrate what the model learns and infers is reliable. This learning by deduction strategy employs the view-transform demonstration and structural rules derived from depth, geometry and angle constraints, which improves the reliability of the model training with weak supervision. On three 3D human pose benchmarks, we conduct extensive experiments to evaluate our proposed method, which achieves superior performance in comparison with state-of-the-art weak-supervised methods. Particularly, our model shows an appealing potential for learning from 2D data captured in dynamic outdoor scenes, which demonstrates promising robustness and generalization in realistic scenarios. Our code is publicly available at https://github.com/XipengChen/DWSL-3D-pose.
引用
收藏
页码:1089 / 1096
页数:8
相关论文
共 50 条
  • [1] Absolute 3D Human Pose Estimation via Weakly-supervised Learning
    Guo, Yiru
    Chen, Zerui
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 273 - 276
  • [2] Towards 3D Human Pose Estimation in the Wild: a Weakly-supervised Approach
    Zhou, Xingyi
    Huang, Qixing
    Sun, Xiao
    Xue, Xiangyang
    Wei, Yichen
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 398 - 407
  • [3] Weakly-supervised pre-training for 3D human pose estimation via perspective knowledge
    Qiu, Zhongwei
    Qiu, Kai
    Fu, Jianlong
    Fu, Dongmei
    PATTERN RECOGNITION, 2023, 139
  • [4] Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild
    Iqbal, Umar
    Molchanov, Pavlo
    Kautz, Jan
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5242 - 5251
  • [5] Monocular Weakly-Supervised Camera-Relative 3D Human Pose Estimation
    Christidis, Anestis
    Papaioannidis, Christos
    Pitas, Ioannis
    2022 IEEE 14TH IMAGE, VIDEO, AND MULTIDIMENSIONAL SIGNAL PROCESSING WORKSHOP (IVMSP), 2022,
  • [6] Weakly-supervised 3D Pose Transfer with Keypoints
    Chen, Jinnan
    Li, Chen
    Lee, Gim Hee
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 15110 - 15119
  • [7] Weakly-Supervised Discovery of Geometry-Aware Representation for 3D Human Pose Estimation
    Chen, Xipeng
    Lin, Kwan-Yee
    Liu, Wentao
    Qian, Chen
    Lin, Liang
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10887 - 10896
  • [8] Human Pose as Calibration Pattern; 3D Human Pose Estimation with Multiple Unsynchronized and Uncalibrated Cameras
    Takahashi, Kosuke
    Mikami, Dan
    Isogawa, Mariko
    Kimata, Hideaki
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1856 - 1863
  • [9] BOOSTING THE PERFORMANCE OF WEAKLY-SUPERVISED 3D HUMAN POSE ESTIMATORS WITH POSE PRIOR REGULARIZERS
    Amadi, Lawrence
    Agam, Gady
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1791 - 1795
  • [10] Weakly-Supervised 3D Hand Pose Estimation from Monocular RGB Images
    Cai, Yujun
    Ge, Liuhao
    Cai, Jianfei
    Yuan, Junsong
    COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 : 678 - 694