3D Human Pose Estimation via Deep Learning from 2D annotations

被引:26
|
作者
Brau, Ernesto [1 ]
Jiang, Hao [1 ]
机构
[1] Boston Coll, Chestnut Hill, MA 02467 USA
来源
PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV) | 2016年
关键词
PICTORIAL STRUCTURES; FLEXIBLE MIXTURES;
D O I
10.1109/3DV.2016.84
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a deep convolutional neural network for 3D human pose and camera estimation from monocular images that learns from 2D joint annotations. The proposed network follows the typical architecture, but contains an additional output layer which projects predicted 3D joints onto 2D, and enforces constraints on body part lengths in 3D. We further enforce pose constraints using an independently trained network that learns a prior distribution over 3D poses. We evaluate our approach on several benchmark datasets and compare against state-of-the-art approaches for 3D human pose estimation, achieving comparable performance. Additionally, we show that our approach significantly outperforms other methods in cases where 3D ground truth data is unavailable, and that our network exhibits good generalization properties.
引用
收藏
页码:582 / 591
页数:10
相关论文
共 50 条
  • [21] Bayesian capsule networks for 3D human pose estimation from single 2D images
    Ramirez, Ivan
    Cuesta-Infante, Alfredo
    Schiavi, Emanuele
    Jose Pantrigo, Juan
    NEUROCOMPUTING, 2020, 379 (379) : 64 - 73
  • [22] 3D Human Pose Estimation With Adversarial Learning
    Meng, Wenming
    Hu, Tao
    Shuai, Li
    2019 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV), 2019, : 93 - 99
  • [23] Robust 3D Human Pose Estimation via Dual Dictionaries Learning
    Ji, Hao
    Su, Fei
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 3370 - 3373
  • [24] 3D Pose Estimation of Markerless Fish on Deep Learning
    Wang, Yuanchang
    Cao, Jianrong
    Wang, Ming
    Zhao, Qianchuan
    Gao, He
    NEURAL COMPUTING FOR ADVANCED APPLICATIONS, NCAA 2024, PT I, 2025, 2181 : 261 - 274
  • [25] Survey on 2D and 3D Human Pose Recovery
    Perez-Sala, Xavier
    Escalera, Sergio
    Angulo, Cecilio
    ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT, 2012, 248 : 101 - +
  • [26] Reconstructing 3D Human Pose from 2D Image Landmarks
    Ramakrishna, Varun
    Kanade, Takeo
    Sheikh, Yaser
    COMPUTER VISION - ECCV 2012, PT IV, 2012, 7575 : 573 - 586
  • [27] 3D hand pose and shape estimation from monocular RGB via efficient 2D cues
    Fenghao Zhang
    Lin Zhao
    Shengling Li
    Wanjuan Su
    Liman Liu
    Wenbing Tao
    Computational Visual Media, 2024, 10 : 79 - 96
  • [28] 3D hand pose and shape estimation from monocular RGB via efficient 2D cues
    Zhang, Fenghao
    Zhao, Lin
    Li, Shengling
    Su, Wanjuan
    Liu, Liman
    Tao, Wenbing
    COMPUTATIONAL VISUAL MEDIA, 2024, 10 (01): : 79 - 96
  • [29] Model transfer from 2D to 3D study for boxing pose estimation
    Lin, Jianchu
    Xie, Xiaolong
    Wu, Wangping
    Xu, Shengpeng
    Liu, Chunyan
    Hudoyberdi, Toshboev
    Chen, Xiaobing
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [30] A Survey on Deep Learning-Based 2D Human Pose Estimation Models
    Salisu S.
    Mohamed A.S.A.
    Jaafar M.H.
    Pauzi A.S.B.
    Younis H.A.
    Computers, Materials and Continua, 2023, 76 (02): : 2385 - 2400