Real-time volume rendering with octree-based implicit surface representation

被引:0
作者
Li, Jiaze [1 ]
Zhang, Luo [1 ]
Hu, Jiangbei [1 ,2 ]
Zhang, Zhebin [3 ]
Sun, Hongyu [3 ]
Song, Gaochao [4 ]
He, Ying [1 ]
机构
[1] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
[2] Dalian Univ Technol, Int Sch Informat Sci & Engn, Dalian, Liaoning, Peoples R China
[3] InnoPeak Technol Inc, Bellevue, WA USA
[4] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
关键词
Neural rendering; Implicit surfaces; Octrees; Real-time volume rendering;
D O I
10.1016/j.cagd.2024.102322
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent breakthroughs in neural radiance fields have significantly advanced the field of novel view synthesis and 3D reconstruction from multi -view images. However, the prevalent neural volume rendering techniques often suffer from long rendering time and require extensive network training. To address these limitations, recent initiatives have explored explicit voxel representations of scenes to expedite training. Yet, they often fall short in delivering accurate geometric reconstructions due to a lack of effective 3D representation. In this paper, we propose an octree-based approach for the reconstruction of implicit surfaces from multi -view images. Leveraging an explicit, network -free data structure, our method substantially increases rendering speed, achieving real-time performance. Moreover, our reconstruction technique yields surfaces with quality comparable to state-of-the-art network -based learning methods. The source code and data can be downloaded from https://github .com /LaoChui999 /Octree -VolSDF.
引用
收藏
页数:15
相关论文
共 53 条
  • [1] Spherical Harmonics and Approximations on the Unit Sphere: An Introduction Preface
    Atkinson, Kendall
    Han, Weimin
    [J]. SPHERICAL HARMONICS AND APPROXIMATIONS ON THE UNIT SPHERE: AN INTRODUCTION, 2012, 2044 : V - +
  • [2] Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
    Barron, Jonathan T.
    Mildenhall, Ben
    Tancik, Matthew
    Hedman, Peter
    Martin-Brualla, Ricardo
    Srinivasan, Pratul P.
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5835 - 5844
  • [3] TensoRF: Tensorial Radiance Fields
    Chen, Anpei
    Xu, Zexiang
    Geiger, Andreas
    Yu, Jingyi
    Su, Hao
    [J]. COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 333 - 350
  • [4] MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architectures
    Chen, Zhiqin
    Funkhouser, Thomas
    Hedman, Peter
    Tagliasacchi, Andrea
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16569 - 16578
  • [5] Improving neural implicit surfaces geometry with patch warping
    Darmon, Francois
    Bascle, Benedicte
    Devaux, Jean-Clement
    Monasse, Pascal
    Aubry, Mathieu
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 6250 - 6259
  • [6] K-Planes: Explicit Radiance Fields in Space, Time, and Appearance
    Fridovich-Keil, Sara
    Meanti, Giacomo
    Warburg, Frederik Rahbaek
    Recht, Benjamin
    Kanazawa, Angjoo
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 12479 - 12488
  • [7] Plenoxels: Radiance Fields without Neural Networks
    Fridovich-Keil, Sara
    Yu, Alex
    Tancik, Matthew
    Chen, Qinhong
    Recht, Benjamin
    Kanazawa, Angjoo
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5491 - 5500
  • [8] Fu Qiancheng, 2022, Advances in Neural Information Processing Systems
  • [9] Strivec: Sparse Tri-Vector Radiance Fields
    Gao, Quankai
    Xu, Qiangeng
    Su, Hao
    Neumann, Ulrich
    Xu, Zexiang
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 17523 - 17533
  • [10] FastNeRF: High-Fidelity Neural Rendering at 200FPS
    Garbin, Stephan J.
    Kowalski, Marek
    Johnson, Matthew
    Shotton, Jamie
    Valentin, Julien
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14326 - 14335