3D Human Pose Estimation via Deep Learning from 2D annotations

被引:26
|
作者
Brau, Ernesto [1 ]
Jiang, Hao [1 ]
机构
[1] Boston Coll, Chestnut Hill, MA 02467 USA
来源
PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV) | 2016年
关键词
PICTORIAL STRUCTURES; FLEXIBLE MIXTURES;
D O I
10.1109/3DV.2016.84
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a deep convolutional neural network for 3D human pose and camera estimation from monocular images that learns from 2D joint annotations. The proposed network follows the typical architecture, but contains an additional output layer which projects predicted 3D joints onto 2D, and enforces constraints on body part lengths in 3D. We further enforce pose constraints using an independently trained network that learns a prior distribution over 3D poses. We evaluate our approach on several benchmark datasets and compare against state-of-the-art approaches for 3D human pose estimation, achieving comparable performance. Additionally, we show that our approach significantly outperforms other methods in cases where 3D ground truth data is unavailable, and that our network exhibits good generalization properties.
引用
收藏
页码:582 / 591
页数:10
相关论文
共 33 条
  • [1] 3D Human Pose Estimation from Deep Multi-View 2D Pose
    Schwarcz, Steven
    Pollard, Thomas
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 2326 - 2331
  • [2] Deep Learning Based 2D Human Pose Estimation: A Survey
    Dang, Qi
    Yin, Jianqin
    Wang, Bin
    Zheng, Wenqing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2019, 24 (06) : 663 - 676
  • [3] 3D Human Pose Estimation Using Convolutional Neural Networks with 2D Pose Information
    Park, Sungheon
    Hwang, Jihye
    Kwak, Nojun
    COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 156 - 169
  • [4] Survey on 2D and 3D Human Pose Recovery
    Perez-Sala, Xavier
    Escalera, Sergio
    Angulo, Cecilio
    ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT, 2012, 248 : 101 - +
  • [5] Efficient 3D human pose estimation from RGBD sensors
    Pascual-Hernandez, David
    de Frutos, Nuria Oyaga
    Mora-Jimenez, Inmaculada
    Canas-Plaza, Jose Maria
    DISPLAYS, 2022, 74
  • [6] Multiple human 3D pose estimation from multiview images
    Ershadi-Nasab, Sara
    Noury, Erfan
    Kasaei, Shohreh
    Sanaei, Esmaeil
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (12) : 15573 - 15601
  • [7] A Survey on Model Based Approaches for 2D and 3D Visual Human Pose Recovery
    Perez-Sala, Xavier
    Escalera, Sergio
    Angulo, Cecilio
    Gonzalez, Jordi
    SENSORS, 2014, 14 (03) : 4189 - 4210
  • [8] The Progress of Human Pose Estimation: A Survey and Taxonomy of Models Applied in 2D Human Pose Estimation
    Munea, Tewodros Legesse
    Jembre, Yalew Zelalem
    Weldegebriel, Halefom Tekle
    Chen, Longbiao
    Huang, Chenxi
    Yang, Chenhui
    IEEE ACCESS, 2020, 8 : 133330 - 133348
  • [9] Recent Advances in 3D Human Pose Estimation: From Optimization to Implementation and Beyond
    Yan, Jielu
    Zhou, Mingliang
    Pan, Jinli
    Yin, Meng
    Fang, Bin
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (02)
  • [10] 3D Human pose estimation: A review of the literature and analysis of covariates
    Sarafianos, Nikolaos
    Boteanu, Bogdan
    Ionescu, Bogdan
    Kakadiaris, Ioannis A.
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2016, 152 : 1 - 20