3D face reconstruction from single image with generative adversarial networks

被引:2
作者
Malah, Mehdi [1 ]
Hemam, Mounir [1 ]
Abbas, Faycal [2 ]
机构
[1] Univ Abbes Laghrour Khenchela, ICOSI Lab, BP 1252, El Houria 40004, Algeria
[2] Univ Abbes Laghrour Khenchela, LESIA Lab, BP 1252, El Houria 40004, Algeria
关键词
Single image 3D reconstruction; Face reconstruction; Generative adversarial networks; Graph convolution networks; GAN;
D O I
10.1016/j.jksuci.2022.11.014
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional reconstruction techniques extract information from the object's geometry or one or more 2D images. On the other hand, the limit of the existing methods is that they generate less precise objects. Thus the lack of robustness towards several face reconstruction problems, such as the position of the head, occlusion, noise, and lighting variation. Therefore, generative neural networks and graphical convolution networks have marked a significant evolution in the field of 3D reconstruction. This paper proposes a model for 3D face reconstruction from a single 2D image. Our model is composed of a generator and a discriminator based on convolutional graphic layers. Indeed, in order to generate a face mesh with expression, our idea is to use the landmarks associated with this image as input to the generator to reconstruct a face geometry with expression and improve the convergence rate. As a result, our model offers an accurate reconstruction of facial geometry with expression; thus, our model outperforms state-of-the-art methods through qualitative and quantitative comparison.& COPY; 2022 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:250 / 256
页数:7
相关论文
共 33 条
[1]   Forest fog rendering using generative adversarial networks [J].
Abbas, Faycal ;
Babahenini, Mohamed Chaouki .
VISUAL COMPUTER, 2023, 39 (03) :943-952
[2]  
Afroze S., 2022, J KING SAUD U COMPUT
[3]  
Aldrian O, 2012, LECT NOTES COMPUT SC, V7574, P201, DOI 10.1007/978-3-642-33712-3_15
[4]  
Bagdanov AD, 2011, P 2011 JOINT ACM WOR, P79
[5]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[6]   Geometric Deep Learning Going beyond Euclidean data [J].
Bronstein, Michael M. ;
Bruna, Joan ;
LeCun, Yann ;
Szlam, Arthur ;
Vandergheynst, Pierre .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) :18-42
[7]   GAN-Based Blur Restoration for Finger Wrinkle Biometrics System [J].
Cho, Nam Sun ;
Kim, Chan Sik ;
Park, Chanhum ;
Park, Kang Ryoung .
IEEE ACCESS, 2020, 8 :49857-49872
[8]  
Deng Q., 2021, IEEE T VISUALIZA COM
[9]   Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set [J].
Deng, Yu ;
Yang, Jiaolong ;
Xu, Sicheng ;
Chen, Dong ;
Jia, Yunde ;
Tong, Xin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :285-295
[10]  
Dovgard R, 2004, LECT NOTES COMPUT SC, V3022, P99