Advanced 3D Face Reconstruction from Single 2D Images Using Enhanced Adversarial Neural Networks and Graph Neural Networks

被引:0
作者
Fathallah, Mohamed [1 ]
Eletriby, Sherif [2 ]
Alsabaan, Maazen [3 ]
Ibrahem, Mohamed I. [4 ]
Farok, Gamal [2 ]
机构
[1] Kafr El Sheikh Univ, Fac Comp & Informat, Dept Comp Sci, Kafr Al Sheikh 33511, Egypt
[2] Menoufia Univ, Fac Comp & Informat, Dept Comp Sci, Menoufia 32511, Egypt
[3] King Saud Univ, Coll Comp & Informat Sci, Dept Comp Engn, POB 51178, Riyadh 11543, Saudi Arabia
[4] Augusta Univ, Sch Comp & Cyber Sci, Augusta, GA 30912 USA
关键词
GANs; 3D reconstruction; GCNs; efficient-net;
D O I
10.3390/s24196280
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper presents a novel framework for 3D face reconstruction from single 2D images and addresses critical limitations in existing methods. Our approach integrates modified adversarial neural networks with graph neural networks to achieve state-of-the-art performance. Key innovations include (1) a generator architecture based on Graph Convolutional Networks (GCNs) with a novel loss function and identity blocks, mitigating mode collapse and instability; (2) the integration of facial landmarks and a non-parametric efficient-net decoder for enhanced feature capture; and (3) a lightweight GCN-based discriminator for improved accuracy and stability. Evaluated on the 300W-LP and AFLW2000-3D datasets, our method outperforms existing approaches, reducing Chamfer Distance by 62.7% and Earth Mover's Distance by 57.1% on 300W-LP. Moreover, our framework demonstrates superior robustness to variations in head positioning, occlusion, noise, and lighting conditions while achieving significantly faster processing times.
引用
收藏
页数:19
相关论文
共 38 条
[1]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[2]   A 3D Morphable Model learnt from 10,000 faces [J].
Booth, James ;
Roussos, Anastasios ;
Zafeiriou, Stefanos ;
Ponniah, Allan ;
Dunaway, David .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5543-5552
[3]   Faster, Better and More Detailed: 3D Face Reconstruction with Graph Convolutional Networks [J].
Cheng, Shiyang ;
Tzimiropoulos, Georgios ;
Shen, Jie ;
Pantic, Maja .
COMPUTER VISION - ACCV 2020, PT V, 2021, 12626 :188-205
[4]   A comprehensive survey on the biometric recognition systems based on physiological and behavioral modalities [J].
Dargan, Shaveta ;
Kumar, Munish .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 143
[5]  
Defferrard M, 2016, ADV NEUR IN, V29
[6]   Plausible 3D Face Wrinkle Generation Using Variational Autoencoders [J].
Deng, Qixin ;
Ma, Luming ;
Jin, Aobo ;
Bi, Huikun ;
Le, Binh Huy ;
Deng, Zhigang .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (09) :3113-3125
[7]   Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set [J].
Deng, Yu ;
Yang, Jiaolong ;
Xu, Sicheng ;
Chen, Dong ;
Jia, Yunde ;
Tong, Xin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :285-295
[8]   Fast 3D face reconstruction from a single image combining attention mechanism and graph convolutional network [J].
Deng, Zhuoran ;
Liang, Yan ;
Pan, Jiahui ;
Liao, Jiacheng ;
Hao, Yan ;
Wen, Xing .
VISUAL COMPUTER, 2023, 39 (11) :5547-5561
[9]   Novel Framework for Generating Criminals Images Based on Textual Data Using Identity GANs [J].
Fathallah, Mohamed ;
Sakr, Mohamed ;
Eletriby, Sherif .
CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (01) :383-396
[10]   Stabilizing and Improving Training of Generative Adversarial Networks Through Identity Blocks and Modified Loss Function [J].
Fathallah, Mohamed ;
Sakr, Mohamed ;
Eletriby, Sherif .
IEEE ACCESS, 2023, 11 :43276-43285