Compressing Explicit Voxel Grid Representations: fast NeRFs become also small

被引:19
作者
Deng, Chenxi Lola [1 ]
Tartaglione, Enzo [1 ]
机构
[1] Inst Polytech Paris, Telecom Paris, LTCI, Paris, France
来源
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) | 2023年
关键词
D O I
10.1109/WACV56688.2023.00129
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
NeRFs have revolutionized the world of per-scene radiance field reconstruction because of their intrinsic compactness. One of the main limitations of NeRFs is their slow rendering speed, both at training and inference time. Recent research focuses on the optimization of an explicit voxel grid (EVG) that represents the scene, which can be paired with neural networks to learn radiance fields. This approach significantly enhances the speed both at train and inference time, but at the cost of large memory occupation. In this work we propose Re:NeRF, an approach that specifically targets EVG-NeRFs compressibility, aiming to reduce memory storage of NeRF models while maintaining comparable performance. We benchmark our approach with three different EVG-NeRF architectures on four popular benchmarks, showing Re:NeRF's broad usability and effectiveness.
引用
收藏
页码:1236 / 1245
页数:10
相关论文
共 43 条
[1]   NeRD: Neural Reflectance Decomposition from Image Collections [J].
Boss, Mark ;
Braun, Raphael ;
Jampani, Varun ;
Barron, Jonathan T. ;
Liu, Ce ;
Lensch, Hendrik P. A. .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :12664-12674
[2]   pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis [J].
Chan, Eric R. ;
Monteiro, Marco ;
Kellnhofer, Petr ;
Wu, Jiajun ;
Wetzstein, Gordon .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :5795-5805
[3]  
Chen A., 2022, ECCV
[4]   Unstructured Light Fields [J].
Davis, Abe ;
Levoy, Marc ;
Durand, Fredo .
COMPUTER GRAPHICS FORUM, 2012, 31 (02) :305-314
[5]  
Debevec P. E., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P11, DOI 10.1145/237170.237191
[6]   DeepView: View synthesis with learned gradient descent [J].
Flynn, John ;
Broxton, Michael ;
Debevec, Paul ;
DuVall, Matthew ;
Fyffe, Graham ;
Overbeck, Ryan ;
Snavely, Noah ;
Tucker, Richard .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2362-2371
[7]   Five-repetition sit-to-Stand test among patients post-stroke and healthy-matched controls: the use of different chair types and number of trials [J].
Franco, Juliane ;
Quintino, Ludmylla Ferreira ;
Faria, Christina D. C. M. .
PHYSIOTHERAPY THEORY AND PRACTICE, 2021, 37 (12) :1419-1428
[8]   Plenoxels: Radiance Fields without Neural Networks [J].
Fridovich-Keil, Sara ;
Yu, Alex ;
Tancik, Matthew ;
Chen, Qinhong ;
Recht, Benjamin ;
Kanazawa, Angjoo .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5491-5500
[9]   Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction [J].
Gafni, Guy ;
Thies, Justus ;
Zollhoefer, Michael ;
Niessner, Matthias .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8645-8654
[10]  
Gao Chen, 2021, ICCV, P5712