FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstruction

被引:17
作者
Bai, Haoran [1 ,2 ]
Kang, Di [2 ]
Zhang, Haoxian [2 ]
Pan, Jinshan [1 ]
Bao, Linchao [2 ]
机构
[1] Nanjing Univ Sci & Technol, Nanjing, Peoples R China
[2] Tencent AI Lab, Shenzhen, Peoples R China
来源
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR | 2023年
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
D O I
10.1109/CVPR52729.2023.00043
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a large-scale facial UV-texture dataset that contains over 50,000 high-quality texture UV-maps with even illuminations, neutral expressions, and cleaned facial regions, which are desired characteristics for rendering realistic 3D face models under different lighting conditions. The dataset is derived from a large-scale face image dataset namely FFHQ, with the help of our fully automatic and robust UV-texture production pipeline. Our pipeline utilizes the recent advances in StyleGAN-based facial image editing approaches to generate multi-view normalized face images from single-image inputs. An elaborated UV-texture extraction, correction, and completion procedure is then applied to produce high-quality UV-maps from the normalized face images. Compared with existing UV-texture datasets, our dataset has more diverse and higher-quality texture maps. We further train a GAN-based texture decoder as the nonlinear texture basis for parametric fitting based 3D face reconstruction. Experiments show that our method improves the reconstruction accuracy over state-of-the-art approaches, and more importantly, produces high-quality texture maps that are ready for realistic renderings. The dataset, code, and pre-trained texture decoder are publicly available at https://github.com/csbhr/FFHQ-UV.
引用
收藏
页码:362 / 371
页数:10
相关论文
共 46 条
[1]   StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows [J].
Abdal, Rameen ;
Zhu, Peihao ;
Mitra, Niloy J. ;
Wonka, Peter .
ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (03)
[2]  
[Anonymous], 2018, zllrunning. face-parsing.pytorch
[3]   High-Fidelity 3D Digital Human Head Creation from RGB-D Selfies [J].
Bao, Linchao ;
Lin, Xiangkai ;
Chen, Yajing ;
Zhang, Haoxian ;
Wang, Sheng ;
Zhe, Xuefei ;
Kang, Di ;
Huang, Haozhi ;
Jiang, Xinwei ;
Wang, Jue ;
Yu, Dong ;
Zhang, Zhengyou .
ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (01)
[4]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[5]   A 3D Morphable Model learnt from 10,000 faces [J].
Booth, James ;
Roussos, Anastasios ;
Zafeiriou, Stefanos ;
Ponniah, Allan ;
Dunaway, David .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5543-5552
[6]   Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generation [J].
Bouritsas, Giorgos ;
Bokhnyak, Sergiy ;
Ploumpis, Stylianos ;
Bronstein, Michael ;
Zafeiriou, Stefanos .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :7212-7221
[7]   How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks) [J].
Bulat, Adrian ;
Tzimiropoulos, Georgios .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1021-1030
[8]   A MULTIRESOLUTION SPLINE WITH APPLICATION TO IMAGE MOSAICS [J].
BURT, PJ ;
ADELSON, EH .
ACM TRANSACTIONS ON GRAPHICS, 1983, 2 (04) :217-236
[9]  
Chai Zenghao, 2022, ECCV
[10]  
Chung Wei-Chieh, 2022, Stylefaceuv: A 3d face uv map generator for view-consistent face image synthesis, P89