3D human body reconstruction based on SMPL model

被引:0
|
作者
Dongyue Chen
Yuanyuan Song
Fangzheng Liang
Teng Ma
Xiaoming Zhu
Tong Jia
机构
[1] Northeastern University,Artificial Intelligence Laboratory
来源
The Visual Computer | 2023年 / 39卷
关键词
3D human reconstruction; SMPL; Pose estimation;
D O I
暂无
中图分类号
学科分类号
摘要
Recovering 3D human pose and body shape from a monocular image is a challenging task in computer vision. In this paper, we present an optimization-based algorithm and an innovative framework to reconstruct 3D human body from a single monocular image. All the evaluation tasks are established on the basis of the classic parametric 3D body model SMPL. Firstly, a new combined objective function of SMPL parameters is proposed to involve four loss terms on 2D joints, 3D joints, facial landmarks and pose priori, respectively, which increase the reliability of the evaluation results dramatically. Furthermore, we use the estimation results given by an end-to-end regression network as the initial values of the parameters, which has been proved to speed up the optimization process. The experiments on benchmark datasets Human 3.6 M, LSP and a wild dataset demonstrate that our model achieves an accurate and robust estimation of the 3D human body and outperforms the popular competing algorithms in precision and robustness.
引用
收藏
页码:1893 / 1906
页数:13
相关论文
共 50 条
  • [41] Reconstruction of 3D Images from Human Activity by a Compound Reconstruction Model
    Hongna Zheng
    Li Yao
    Zhiying Long
    Cognitive Computation, 2022, 14 : 1509 - 1525
  • [42] Reconstruction of 3D Images from Human Activity by a Compound Reconstruction Model
    Zheng, Hongna
    Yao, Li
    Long, Zhiying
    COGNITIVE COMPUTATION, 2022, 14 (04) : 1509 - 1525
  • [43] JointMETRO: a 3D reconstruction model for human figures in works of art based on transformer
    Pang, Shanchen
    Peng, Rongrong
    Dong, Yukun
    Yuan, Qi
    Wang, Shengtao
    Sun, Junqi
    NEURAL COMPUTING & APPLICATIONS, 2023, 36 (20): : 11711 - 11725
  • [44] The Reconstruction of 3D Finite Element Model of Human Cervical Spine Based on Mimics
    Zhao, Lei
    Zhang, Zhiping
    Liu, Yajie
    Yang, Yang
    2015 The 5th International Conference on Information, Communication and Education Application (ICEA 2015), 2015, 85 : 251 - 256
  • [45] Research on Relational Model for Body Block of Menswear based on Digital 3D Human Model
    Duan, Jin
    Zhang, Xin
    Ying, Bo-An
    Zhang, Jue
    TEXTILE BIOENGINEERING AND INFORMATICS SYMPOSIUM PROCEEDINGS, 2016, VOLS 1 AND 2, 2016, : 450 - 458
  • [46] 3D action modeling and reconstruction for 2D human body tracking
    Rius, I
    Rowe, D
    González, J
    Roca, FX
    PATTERN RECOGNITION AND IMAGE ANALYSIS, PT 2, PROCEEDINGS, 2005, 3687 : 146 - 154
  • [47] 3D VISUALIZATION AND EMERGE 3D MODEL HUMAN BODY OF JAVA']JAVANESE DANCE
    Baktiar, Dony
    Damastuti, Fardani Annisa
    Nurindiyani, Artiarini
    2018 INTERNATIONAL ELECTRONICS SYMPOSIUM ON KNOWLEDGE CREATION AND INTELLIGENT COMPUTING (IES-KCIC), 2018, : 210 - 217
  • [48] 3D body reconstruction from photos based on range scan
    Seo, Hyewon
    Yeo, Young In
    Wohn, Kwangyun
    TECHNOLOGIES FOR E-LEARNING AND DIGITAL ENTERTAINMENT, PROCEEDINGS, 2006, 3942 : 849 - 860
  • [49] Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
    Bogo, Federica
    Kanazawa, Angjoo
    Lassner, Christoph
    Gehler, Peter
    Romero, Javier
    Black, Michael J.
    COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 : 561 - 578
  • [50] 3D body reconstruction for immersive interaction
    Cohen, I
    Lee, MW
    ARTICULATED MOTION AND DEFORMABLE OBJECTS, PROCEEDINGS, 2002, 2492 : 119 - 130