A Survey on Deep Generative 3D-aware Image Synthesis

被引:4
|
作者
Xia, Weihao [1 ]
Xue, Jing-Hao [1 ]
机构
[1] UCL, Dept Stat Sci, Gower St, London WC1E 6BT, England
基金
英国工程与自然科学研究理事会;
关键词
3D-aware image synthesis; deep generative models; implicit neural representation; generative adversarial network; diffusion probabilistic models; MODEL; GAN;
D O I
10.1145/3626193
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-fidelity images in a 3D-consistent manner while simultaneously capturing compact surfaces of objects from pure image collections without the need for any 3D supervision, thus bridging the gap between 2D imagery and 3D reality. The field of computer vision has been recently captivated by the task of deep generative 3D-aware image synthesis, with hundreds of papers appearing in top-tier journals and conferences over the past few years (mainly the past two years), but there lacks a comprehensive survey of this remarkable and swift progress. Our survey aims to introduce new researchers to this topic, provide a useful reference for related works, and stimulate future research directions through our discussion section. Apart from the presented papers, we aim to constantly update the latest relevant papers along with corresponding implementations at https://weihaox.github.io/3D-aware-Gen.
引用
收藏
页数:34
相关论文
共 50 条
  • [1] GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis
    Schwarz, Katja
    Liao, Yiyi
    Niemeyer, Michael
    Geiger, Andreas
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [2] 3D-aware Conditional Image Synthesis
    Deng, Kangle
    Yang, Gengshan
    Ramanan, Deva
    Zhu, Jun-Yan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4434 - 4445
  • [3] 3D-Aware Generative Model for Improved Side-View Image Synthesis
    Jo, Kyungmin
    Jin, Wonjoon
    Choo, Jaegul
    Lee, Hyunjoon
    Cho, Sunghyun
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 22805 - 22815
  • [4] Multi-View Consistent Generative Adversarial Networks for 3D-aware Image Synthesis
    Zhang, Xuanmeng
    Zheng, Zhedong
    Gao, Daiheng
    Zhang, Bang
    Pan, Pan
    Yang, Yi
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18429 - 18438
  • [5] Generative Multiplane Neural Radiance for 3D-Aware Image Generation
    Kumar, Amandeep
    Bhunia, Ankan Kumar
    Narayan, Sanath
    Cholakkal, Hisham
    Anwer, Rao Muhammad
    Khan, Salman
    Yang, Ming-Hsuan
    Khan, Fahad Shahbaz
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 7354 - 7364
  • [6] GRAM: Generative Radiance Manifolds for 3D-Aware Image Generation
    Deng, Yu
    Yang, Jiaolong
    Xiang, Jianfeng
    Tong, Xin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 10663 - 10673
  • [7] 3D-aware Blending with Generative NeRFs
    Kim, Hyunsu
    Lee, Gayoung
    Choi, Yunjey
    Kim, Jin-Hwa
    Zhu, Jun-Yan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 22849 - 22861
  • [8] Generative Novel View Synthesis with 3D-Aware Diffusion Models
    Chan, Eric R.
    Nagano, Koki
    Chan, Matthew A.
    Bergman, Alexander W.
    Park, Jeong Joon
    Levy, Axel
    Aittala, Miika
    De Mello, Shalini
    Karras, Tero
    Wetzstein, Gordon
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 4194 - 4206
  • [9] CG-NeRF: Conditional Generative Neural Radiance Fields for 3D-aware Image Synthesis
    Jo, Kyungmin
    Shim, Gyumin
    Jung, Sanghun
    Yang, Soyoung
    Choo, Jaegul
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 724 - 733
  • [10] Multi-view Consistent Generative Adversarial Networks for Compositional 3D-Aware Image Synthesis
    Zhang, Xuanmeng
    Zheng, Zhedong
    Gao, Daiheng
    Zhang, Bang
    Yang, Yi
    Chua, Tat-Seng
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (08) : 2219 - 2242