3D face reconstruction from single image with generative adversarial networks

被引:2
作者
Malah, Mehdi [1 ]
Hemam, Mounir [1 ]
Abbas, Faycal [2 ]
机构
[1] Univ Abbes Laghrour Khenchela, ICOSI Lab, BP 1252, El Houria 40004, Algeria
[2] Univ Abbes Laghrour Khenchela, LESIA Lab, BP 1252, El Houria 40004, Algeria
关键词
Single image 3D reconstruction; Face reconstruction; Generative adversarial networks; Graph convolution networks; GAN;
D O I
10.1016/j.jksuci.2022.11.014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional reconstruction techniques extract information from the object's geometry or one or more 2D images. On the other hand, the limit of the existing methods is that they generate less precise objects. Thus the lack of robustness towards several face reconstruction problems, such as the position of the head, occlusion, noise, and lighting variation. Therefore, generative neural networks and graphical convolution networks have marked a significant evolution in the field of 3D reconstruction. This paper proposes a model for 3D face reconstruction from a single 2D image. Our model is composed of a generator and a discriminator based on convolutional graphic layers. Indeed, in order to generate a face mesh with expression, our idea is to use the landmarks associated with this image as input to the generator to reconstruct a face geometry with expression and improve the convergence rate. As a result, our model offers an accurate reconstruction of facial geometry with expression; thus, our model outperforms state-of-the-art methods through qualitative and quantitative comparison.& COPY; 2022 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:250 / 256
页数:7
相关论文
共 33 条
[21]  
Pan XA, 2021, Arxiv, DOI arXiv:2011.00844
[22]   3D hand mesh reconstruction from a monocular RGB image [J].
Peng, Hao ;
Xian, Chuhua ;
Zhang, Yunbo .
VISUAL COMPUTER, 2020, 36 (10-12) :2227-2239
[23]   CAN-GAN: Conditioned-attention normalized GAN for face age synthesis [J].
Shi, Chenglong ;
Zhang, Jiachao ;
Yao, Yazhou ;
Sun, Yunlian ;
Rao, Huaming ;
Shu, Xiangbo .
PATTERN RECOGNITION LETTERS, 2020, 138 :520-526
[24]   Face2Face: Real-time Face Capture and Reenactment of RGB Videos [J].
Thies, Justus ;
Zollhofer, Michael ;
Stamminger, Marc ;
Theobalt, Christian ;
Niessner, Matthias .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2387-2395
[25]  
ULLAH N, 2022, J KING SAUD U COMPUT
[26]  
Wang F., 2022, COMPU INTELL NEUROSC, V2022
[27]   Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images [J].
Wang, Nanyang ;
Zhang, Yinda ;
Li, Zhuwen ;
Fu, Yanwei ;
Liu, Wei ;
Jiang, Yu-Gang .
COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 :55-71
[28]  
Wozniak Marcin, 2021, DroneCom '21: Proceedings of the 4th ACM MobiCom Workshop on Drone Assisted Wireless Communications for 5G and Beyond, P31, DOI 10.1145/3477090.3481054
[29]   F3A-GAN: Facial Flow for Face Animation With Generative Adversarial Networks [J].
Wu, Xintian ;
Zhang, Qihang ;
Wu, Yiming ;
Wang, Huanyu ;
Li, Songyuan ;
Sun, Lingyun ;
Li, Xi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :8658-8670
[30]  
Ye Haizhou, 2022, VISUAL COMPUT, P1