A systematic literature review of generative adversarial networks (GANs) in 3D avatar reconstruction from 2D images

被引:4
作者
Koh, Angela Jia Hui [1 ]
Tan, Siok Yee [1 ]
Nasrudin, Mohammad Faidzul [1 ]
机构
[1] Univ Kebangsaan Malaysia, Fac Informat Sci & Technol, Ctr Artificial Intelligence Technol, Bangi 43600, Selangor, Malaysia
关键词
3D avatar reconstruction; 2D images; Generative adversarial networks; Artificial intelligence; Deep learning; Systematic review; FACE; MODEL;
D O I
10.1007/s11042-024-18665-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rapid advancement of machine learning and computer vision has paved the way for significant processes in 3D avatar reconstruction from 2D images. Recently, generative adversarial networks (GANs) have emerged as a promising approach for generating realistic and detailed 3D avatar from a 2D images. This systematic literature review provides a comprehensive overview of research on 3D avatar reconstruction from a 2D image using GANs. 35 relevant studies from 2014 to 2022 using the databases ACM, IEEE Xplore, ScienceDirect and Web of Science were identified and analyzed. The review covers a wide range of topics, including network architectures, training methodologies, performance and evaluation metrics employed in the context of 3D avatar reconstruction using GANs. The following research questions are addressed: RQ1) What types of GAN models are employed in reconstructing 3D avatars from 2D images? RQ2) How is their performance in 3D avatar reconstruction? RQ3) What are the limitations and future directions of GAN models in 3D avatar reconstruction from 2D images? The findings indicate significant progress in generating high-fidelity 3D avatars using GAN-based approaches. Various GAN architectures are employed, each offering unique advantages and limitations. The identified challenges include the accuracy of fine-grained details, robustness to lighting and limited diversity of the training dataset. Future research directions involve improving accuracy and realism via enhanced details. In conclusion, this systematic literature review provides a comprehensive understanding of the state-of-the-art algorithms and methodologies in 3D avatar reconstruction using GANs. The review identifies research gaps and suggests potential directions for future investigation.
引用
收藏
页码:68813 / 68853
页数:41
相关论文
共 74 条
[51]  
Mahayuddin ZR, 2020, Asia-Pacific Journal of Information Technology and Multimedia, V09, P28, DOI [10.17576/apjitm-2020-0901-03, DOI 10.14569/IJACSA.2022.0131123]
[52]  
Nagano K, 2018, ACM T GRAPHIC, V37, DOI 10.1145/3272127.3275075
[53]   SiCloPe: Silhouette-Based Clothed People [J].
Natsume, Ryota ;
Saito, Shunsuke ;
Huang, Zeng ;
Chen, Weikai ;
Ma, Chongyang ;
Li, Hao ;
Morishima, Shigeo .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4475-4485
[54]   Realistic Dynamic Facial Textures from a Single Image using GANs [J].
Olszewski, Kyle ;
Li, Zimo ;
Yang, Chao ;
Zhou, Yi ;
Yu, Ronald ;
Huang, Zeng ;
Xiang, Sitao ;
Saito, Shunsuke ;
Kohli, Pushmeet ;
Li, Hao .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5439-5448
[55]   Dynamic Facial Expression Generation on Hilbert Hypersphere With Conditional Wasserstein Generative Adversarial Nets [J].
Otberdout, Naima ;
Daoudi, Mohammed ;
Kacem, Anis ;
Ballihi, Lahoucine ;
Berretti, Stefano .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) :848-863
[56]   A systematic review of augmented reality applications in maintenance [J].
Palmarini, Riccardo ;
Erkoyuncu, John Ahmet ;
Roy, Rajkumar ;
Torabmostaedi, Hosein .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2018, 49 :215-228
[57]   Semi-Supervised Monocular 3D Face Reconstruction With End-to-End Shape-Preserved Domain Transfer [J].
Piao, Jingtan ;
Qian, Chen ;
Li, Hongsheng .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9397-9406
[58]   GANimation: One-Shot Anatomically Consistent Facial Animation [J].
Pumarola, Albert ;
Agudo, Antonio ;
Martinez, Aleix M. ;
Sanfeliu, Alberto ;
Moreno-Noguer, Francesc .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (03) :698-713
[59]  
Radford A., 2015, CORR ABS151106434
[60]   Generative adversarial network based synthetic data training model for lightweight convolutional neural networks [J].
Rather, Ishfaq Hussain ;
Kumar, Sushil .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (2) :6249-6271