A systematic literature review of generative adversarial networks (GANs) in 3D avatar reconstruction from 2D images

被引:4
作者
Koh, Angela Jia Hui [1 ]
Tan, Siok Yee [1 ]
Nasrudin, Mohammad Faidzul [1 ]
机构
[1] Univ Kebangsaan Malaysia, Fac Informat Sci & Technol, Ctr Artificial Intelligence Technol, Bangi 43600, Selangor, Malaysia
关键词
3D avatar reconstruction; 2D images; Generative adversarial networks; Artificial intelligence; Deep learning; Systematic review; FACE; MODEL;
D O I
10.1007/s11042-024-18665-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rapid advancement of machine learning and computer vision has paved the way for significant processes in 3D avatar reconstruction from 2D images. Recently, generative adversarial networks (GANs) have emerged as a promising approach for generating realistic and detailed 3D avatar from a 2D images. This systematic literature review provides a comprehensive overview of research on 3D avatar reconstruction from a 2D image using GANs. 35 relevant studies from 2014 to 2022 using the databases ACM, IEEE Xplore, ScienceDirect and Web of Science were identified and analyzed. The review covers a wide range of topics, including network architectures, training methodologies, performance and evaluation metrics employed in the context of 3D avatar reconstruction using GANs. The following research questions are addressed: RQ1) What types of GAN models are employed in reconstructing 3D avatars from 2D images? RQ2) How is their performance in 3D avatar reconstruction? RQ3) What are the limitations and future directions of GAN models in 3D avatar reconstruction from 2D images? The findings indicate significant progress in generating high-fidelity 3D avatars using GAN-based approaches. Various GAN architectures are employed, each offering unique advantages and limitations. The identified challenges include the accuracy of fine-grained details, robustness to lighting and limited diversity of the training dataset. Future research directions involve improving accuracy and realism via enhanced details. In conclusion, this systematic literature review provides a comprehensive understanding of the state-of-the-art algorithms and methodologies in 3D avatar reconstruction using GANs. The review identifies research gaps and suggests potential directions for future investigation.
引用
收藏
页码:68813 / 68853
页数:41
相关论文
共 74 条
[1]  
Abdullah A, 2020, Asia-Pacific Journal of Information Technology and Multimedia, V09, P103, DOI [10.17576/apjitm-2020-0902-08, 10.17576/apjitm-2020-0902-08, DOI 10.17576/APJITM-2020-0902-08]
[2]   An efficient machine-learning model based on data augmentation for pain intensity recognition [J].
Al-Qerem, Ahmad .
EGYPTIAN INFORMATICS JOURNAL, 2020, 21 (04) :241-257
[3]  
Ammar Sirine, 2020, Advances in Visual Computing. 15th International Symposium, ISVC 2020. Proceedings. Lecture Notes in Computer Science (LNCS 12509), P463, DOI 10.1007/978-3-030-64556-4_36
[4]  
Baby Alba Terese, 2020, 2020 Advanced Computing and Communication Technologies for High Performance Applications (ACCTHPA), P125, DOI 10.1109/ACCTHPA49271.2020.9213233
[5]   Reconstruction of three-dimension digital rock guided by prior information with a combination of InfoGAN and style-based GAN [J].
Cao, Danping ;
Hou, Zhiyu ;
Liu, Qiang ;
Fu, Feiqi .
JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2022, 208
[6]   3D Aided Duet GANs for Multi-View Face Image Synthesis [J].
Cao, Jie ;
Hu, Yibo ;
Yu, Bing ;
He, Ran ;
Sun, Zhenan .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2019, 14 (08) :2028-2042
[7]   Photo-Realistic Facial Details Synthesis From Single Image [J].
Chen, Anpei ;
Chen, Zhang ;
Zhang, Guli ;
Mitchell, Kenny ;
Yu, Jingyi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9428-9438
[8]  
Cherian Aswathy K., 2021, Inventive Systems and Control. Proceedings of ICISC 2021. Lecture Notes in Networks and Systems (LNNS 204), P61, DOI 10.1007/978-981-16-1395-1_6
[9]   Generative Adversarial Networks based Super Resolution of Satellite Aircraft Imagery [J].
Chin, Jonathan ;
Mehmood, Asif .
PATTERN RECOGNITION AND TRACKING XXX, 2019, 10995
[10]   UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition [J].
Deng, Jiankang ;
Cheng, Shiyang ;
Xue, Niannan ;
Zhou, Yuxiang ;
Zafeiriou, Stefanos .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7093-7102