Two is Better than One: Achieving High-Quality 3D Scene Modeling with a NeRF Ensemble

被引:1
作者
Di Sario, Francesco [1 ]
Renzulli, Riccardo [1 ]
Tartaglione, Enzo [2 ]
Grangetto, Marco [1 ]
机构
[1] Univ Turin, Turin, Italy
[2] Inst Polytech Paris, Telecom Paris, LTCI, Palaiseau, France
来源
IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT II | 2023年 / 14234卷
关键词
NeRF; Ensemble; 3D scene modeling; Compression;
D O I
10.1007/978-3-031-43153-1_27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Field (NeRF) is a popular method for synthesizing novel views of a scene from a set of input images. While NeRF has demonstrated state-of-the-art performance in several applications, it suffers from high computational requirements. Recent works have attempted to address these issues by including explicit volumetric information, which makes the optimization process difficult when finegraining the voxel grids. In this paper, we propose an ensemble approach that combines the strengths of two NeRF models to achieve superior results compared to state-of-the-art architectures, with a similar number of parameters. Experimental results show that our ensemble approach is a promising strategy for performance enhancement, and beats vanilla approaches under the same parameter's cardinality constraint.
引用
收藏
页码:320 / 331
页数:12
相关论文
共 27 条
  • [1] NeRD: Neural Reflectance Decomposition from Image Collections
    Boss, Mark
    Braun, Raphael
    Jampani, Varun
    Barron, Jonathan T.
    Liu, Ce
    Lensch, Hendrik P. A.
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 12664 - 12674
  • [2] pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis
    Chan, Eric R.
    Monteiro, Marco
    Kellnhofer, Petr
    Wu, Jiajun
    Wetzstein, Gordon
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5795 - 5805
  • [3] TensoRF: Tensorial Radiance Fields
    Chen, Anpei
    Xu, Zexiang
    Geiger, Andreas
    Yu, Jingyi
    Su, Hao
    [J]. COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 333 - 350
  • [4] Compressing Explicit Voxel Grid Representations: fast NeRFs become also small
    Deng, Chenxi Lola
    Tartaglione, Enzo
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 1236 - 1245
  • [5] Neural Radiance Flow for 4D View Synthesis and Video Processing
    Du, Yilun
    Zhang, Yinan
    Yu, Hong-Xing
    Tenenbaum, Joshua B.
    Wu, Jiajun
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14304 - 14314
  • [6] Plenoxels: Radiance Fields without Neural Networks
    Fridovich-Keil, Sara
    Yu, Alex
    Tancik, Matthew
    Chen, Qinhong
    Recht, Benjamin
    Kanazawa, Angjoo
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5491 - 5500
  • [7] Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction
    Gafni, Guy
    Thies, Justus
    Zollhoefer, Michael
    Niessner, Matthias
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8645 - 8654
  • [8] Dynamic View Synthesis from Dynamic Monocular Video
    Gao, Chen
    Saraf, Ayush
    Kopf, Johannes
    Huang, Jia-Bin
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5692 - 5701
  • [9] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [10] Kosiorek Adam R, 2021, P MACHINE LEARNING R, P5742