3D face reconstruction from single image with generative adversarial networks

被引:2
作者
Malah, Mehdi [1 ]
Hemam, Mounir [1 ]
Abbas, Faycal [2 ]
机构
[1] Univ Abbes Laghrour Khenchela, ICOSI Lab, BP 1252, El Houria 40004, Algeria
[2] Univ Abbes Laghrour Khenchela, LESIA Lab, BP 1252, El Houria 40004, Algeria
关键词
Single image 3D reconstruction; Face reconstruction; Generative adversarial networks; Graph convolution networks; GAN;
D O I
10.1016/j.jksuci.2022.11.014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional reconstruction techniques extract information from the object's geometry or one or more 2D images. On the other hand, the limit of the existing methods is that they generate less precise objects. Thus the lack of robustness towards several face reconstruction problems, such as the position of the head, occlusion, noise, and lighting variation. Therefore, generative neural networks and graphical convolution networks have marked a significant evolution in the field of 3D reconstruction. This paper proposes a model for 3D face reconstruction from a single 2D image. Our model is composed of a generator and a discriminator based on convolutional graphic layers. Indeed, in order to generate a face mesh with expression, our idea is to use the landmarks associated with this image as input to the generator to reconstruct a face geometry with expression and improve the convergence rate. As a result, our model offers an accurate reconstruction of facial geometry with expression; thus, our model outperforms state-of-the-art methods through qualitative and quantitative comparison.& COPY; 2022 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:250 / 256
页数:7
相关论文
共 33 条
[11]  
Fang Han., 2020, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPR), P804
[12]   Learning an Animatable Detailed 3D Face Model from In-The-Wild Images [J].
Feng, Yao ;
Feng, Haiwen ;
Black, Michael J. ;
Bolkart, Timo .
ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (04)
[13]   Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network [J].
Feng, Yao ;
Wu, Fan ;
Shao, Xiaohu ;
Wang, Yanfeng ;
Zhou, Xi .
COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 :557-574
[14]   Mesh R-CNN [J].
Gkioxari, Georgia ;
Malik, Jitendra ;
Johnson, Justin .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9784-9794
[15]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[16]   Fully Automated and Highly Accurate Dense Correspondence for Facial Surfaces [J].
Grewe, Carl Martin ;
Zachow, Stefan .
COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 :552-568
[17]  
Kingma DP, 2014, ADV NEUR IN, V27
[18]  
Leyuan Liu, 2019, 2019 IEEE International Conference on Image Processing (ICIP). Proceedings, P4434, DOI 10.1109/ICIP.2019.8803452
[19]   AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generation [J].
Mittal, Paritosh ;
Cheng, Yen-Chi ;
Singh, Maneesh ;
Tulsiani, Shubham .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :306-315
[20]   3D car shape reconstruction from a contour sketch using GAN and lazy learning [J].
Nozawa, Naoki ;
Shum, Hubert P. H. ;
Feng, Qi ;
Ho, Edmond S. L. ;
Morishima, Shigeo .
VISUAL COMPUTER, 2022, 38 (04) :1317-1330