Portrait Relief Modeling from a Single Image

被引:10
作者
Zhang, Yu-Wei [1 ]
Zhang, Caiming [2 ,3 ]
Wang, Wenping [4 ]
Chen, Yanzhao [1 ]
Ji, Zhongping [5 ]
Liu, Hui [6 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Sch Mech & Automot Engn, Jinan 250000, Shandong, Peoples R China
[2] Shandong Univ, Software Coll, Jinan, Peoples R China
[3] Shandong Coinnovat Ctr Future Intelligent Comp, Yantai, Peoples R China
[4] Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[5] Hangzhou Dianzi Univ, Inst Graph & Image, Hangzhou 310005, Zhejiang, Peoples R China
[6] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan, Peoples R China
基金
中国国家自然科学基金;
关键词
Face; Three-dimensional displays; Image reconstruction; Solid modeling; Computational modeling; Strain; Shape; Bas-relief modeling; high relief modeling; 3D face reconstruction; height compression; detail recovery; BAS-RELIEFS; GENERATION;
D O I
10.1109/TVCG.2019.2892439
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a novel solution to enable portrait relief modeling from a single image. The main challenges are geometry reconstruction, facial details recovery and depth structure preservation. Previous image-based methods are developed for portrait bas-relief modeling in 2.5D form, but not adequate for 3D-like high relief modeling with undercut features. In this paper, we propose a template-based framework to generate portrait reliefs of various forms. Our method benefits from Shape-from-Shading (SFS). Specifically, we use bi-Laplacian mesh deformation to guide the relief modeling. Given a portrait image, we first use a template face to fit the portrait. We then apply bi-Laplacian mesh deformation to align the facial features. Afterwards, SFS-based reconstruction with a few user interactions is used to optimize the face depth, and create a relief with similar appearance to the input. Both depth structures and geometric details can be well constructed in the final relief. Experiments and comparisons to other methods demonstrate the effectiveness of the proposed method.
引用
收藏
页码:2659 / 2670
页数:12
相关论文
共 33 条
  • [1] Aldrian O., 2010, BMVC
  • [2] Reliefs as Images
    Alexa, Marc
    Matusik, Wojciech
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (04):
  • [3] High Reliefs from 3D Scenes
    Arpa, Sami
    Suesstrunk, Sabine
    Hersch, Roger D.
    [J]. COMPUTER GRAPHICS FORUM, 2015, 34 (02) : 253 - 263
  • [4] Preserving detailed features in digital bas-relief making
    Bian, Zhe
    Hu, Shi-Min
    [J]. COMPUTER AIDED GEOMETRIC DESIGN, 2011, 28 (04) : 245 - 256
  • [5] A morphable model for the synthesis of 3D faces
    Blanz, V
    Vetter, T
    [J]. SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, : 187 - 194
  • [6] Face recognition based on fitting a 3D morphable model
    Blanz, V
    Vetter, T
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (09) : 1063 - 1074
  • [7] On linear variational surface deformation methods
    Botsch, Mario
    Sorkine, Olga
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2008, 14 (01) : 213 - 230
  • [8] FaceWarehouse: A 3D Facial Expression Database for Visual Computing
    Cao, Chen
    Weng, Yanlin
    Zhou, Shun
    Tong, Yiying
    Zhou, Kun
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2014, 20 (03) : 413 - 425
  • [9] Cignoni P., 1997, J GRAPHICS TOOLS, V2, P15
  • [10] Reconstruction of Personalized 3D Face Rigs from Monocular Video
    Garrido, Pablo
    Zollhoefer, Michael
    Casas, Dan
    Valgaerts, Levi
    Varanasi, Kiran
    Perez, Patrick
    Theobalt, Christian
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (03):