3D Human Pose Estimation via Deep Learning from 2D annotations

被引:26
|
作者
Brau, Ernesto [1 ]
Jiang, Hao [1 ]
机构
[1] Boston Coll, Chestnut Hill, MA 02467 USA
关键词
PICTORIAL STRUCTURES; FLEXIBLE MIXTURES;
D O I
10.1109/3DV.2016.84
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a deep convolutional neural network for 3D human pose and camera estimation from monocular images that learns from 2D joint annotations. The proposed network follows the typical architecture, but contains an additional output layer which projects predicted 3D joints onto 2D, and enforces constraints on body part lengths in 3D. We further enforce pose constraints using an independently trained network that learns a prior distribution over 3D poses. We evaluate our approach on several benchmark datasets and compare against state-of-the-art approaches for 3D human pose estimation, achieving comparable performance. Additionally, we show that our approach significantly outperforms other methods in cases where 3D ground truth data is unavailable, and that our network exhibits good generalization properties.
引用
收藏
页码:582 / 591
页数:10
相关论文
共 50 条
  • [1] A review of deep learning techniques for 2D and 3D human pose estimation
    Ben Gamra, Miniar
    Akhloufi, Moulay A.
    IMAGE AND VISION COMPUTING, 2021, 114
  • [2] 2D and 3D Human Pose Estimation and Analysis Using Deep Learning
    Yadav, Anju
    Saxena, Rahul
    Bhattacharya, Anubhav
    Pal, Vipin
    Pathak, Nitish
    ADVANCES IN INFORMATION COMMUNICATION TECHNOLOGY AND COMPUTING, AICTC 2021, 2022, 392 : 133 - 143
  • [3] 3D Human Pose Estimation from Deep Multi-View 2D Pose
    Schwarcz, Steven
    Pollard, Thomas
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 2326 - 2331
  • [4] A Deep Learning Based Method For 3D Human Pose Estimation From 2D Fisheye Images
    Chen, Ching-Chun
    Wu, Chia-Min
    Shen, I-Chao
    Chen, Bing-Yu
    COMPANION OF THE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES (IUI'18), 2018,
  • [5] Recent Advances of Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspective
    Liu, Wu
    Bao, Qian
    Sun, Yu
    Mei, Tao
    ACM COMPUTING SURVEYS, 2023, 55 (04)
  • [6] 3D Human Pose Estimation=2D Pose Estimation plus Matching
    Chen, Ching-Hang
    Ramanan, Deva
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5759 - 5767
  • [7] 2D/3D Pose Estimation and Action Recognition using Multitask Deep Learning
    Luvizon, Diogo C.
    Picard, David
    Tabia, Hedi
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5137 - 5146
  • [8] 3D Human Pose Estimation with 2D Marginal Heatmaps
    Nibali, Aiden
    He, Zhen
    Morgan, Stuart
    Prendergast, Luke
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1477 - 1485
  • [9] Overview on 2D Human Pose Estimation Based on Deep Learning
    Zhang Y.
    Wen G.-Z.
    Mi S.-Y.
    Zhang M.-L.
    Geng X.
    Ruan Jian Xue Bao/Journal of Software, 2022, 33 (11): : 4173 - 4191
  • [10] Deep Learning Based 2D Human Pose Estimation: A Survey
    Dang, Qi
    Yin, Jianqin
    Wang, Bin
    Zheng, Wenqing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2019, 24 (06) : 663 - 676