Fine-grained 3D Face Reconstruction from a Single Image using Illumination Priors

被引:0
作者
Qiu, Weibin [1 ]
Yu, Yao [1 ]
Zhou, Yu [1 ]
Du, Sidan [1 ]
机构
[1] Nanjing Univ, Sch Elect Sci & Engn, Nanjing, Peoples R China
来源
PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5 | 2019年
关键词
3D Face Reconstruction; Morphable Model; Illumination Priors; Shape-from-Shading; SHAPE;
D O I
10.5220/0007406508760883
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
3D face reconstruction has a wide range of applications, but it is still a challenging problem, especially when dealing with a single image. Inspired by recent works in face illumination estimation and face animation from video, we propose a novel method for 3D face renconstruction with geometric details from a single image by using three steps. First, a coarse 3D face is generated in morphable model space by landmarks alignment. Afterwards, using the face illumination priors and surface normals generated from the coarse 3D face, we estimate both illumination condition and facial texture, making it possible for the final step that refines geometric details through shape-from-shading method. Experiments prove that our method outperforms state-of-the-art method in terms of accuracy and geometric preservation.
引用
收藏
页码:876 / 883
页数:8
相关论文
共 19 条
[1]  
[Anonymous], 2018, INT J COMPUTER VISIO
[2]  
Bagdanov A. D., 2011, JOINT ACM WORKSH HUM, P79
[3]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[4]   Displaced Dynamic Expression Regression for Real-time Facial Tracking and Animation [J].
Cao, Chen ;
Hou, Qiming ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (04)
[5]   Numerical methods for shape-from-shadling: A new survey with benchmarks [J].
Durou, Jean-Denis ;
Falcone, Maurizio ;
Sagona, Manuela .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 109 (01) :22-43
[6]   Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression [J].
Jackson, Aaron S. ;
Bulat, Adrian ;
Argyriou, Vasileios ;
Tzimiropoulos, Georgios .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1031-1039
[7]   3D Face Reconstruction from a Single Image Using a Single Reference Face Shape [J].
Kemelmacher-Shlizerman, Ira ;
Basri, Ronen .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (02) :394-405
[8]  
King DE, 2009, J MACH LEARN RES, V10, P1755
[9]   LIGHTNESS AND RETINEX THEORY [J].
LAND, EH ;
MCCANN, JJ .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1971, 61 (01) :1-&
[10]  
Li C, 2014, LECT NOTES COMPUT SC, V8693, P218, DOI 10.1007/978-3-319-10602-1_15