Geometry-Guided Neural Implicit Surface Reconstruction

被引:0
作者
Li, Keqiang [1 ,2 ]
Wu, Huaiyu [1 ]
Zhao, Mingyang [3 ]
Fang, Qihang [1 ,2 ]
Yang, Jian [1 ,2 ]
Zhang, Ao [1 ,2 ]
Shen, Zhen [1 ]
Xiong, Gang [1 ]
Wang, Fei-Yue [4 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Hong Kong Inst Sci & Innovat, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
来源
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS | 2024年 / 11卷 / 06期
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Surface reconstruction; Image reconstruction; Rendering (computer graphics); Three-dimensional displays; Image color analysis; Accuracy; Surface treatment; Explicit geometry constraints; multiview images; neural implicit learning; surface reconstruction; PARADIGM; SCENES;
D O I
10.1109/TCSS.2024.3416313
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Multiview 3-D reconstruction holds considerable promise across a wide applications in social manufacturing. Conducting in-depth research on precise and robust multiview 3-D reconstruction holds the potential to significantly empower the domain of social manufacturing. Recently, there has been a burgeoning interest in the domain of neural implicit surfaces learning through volume rendering for the purpose of multiview reconstruction without 3-D supervision. Conventional approaches often overlook explicit multiview geometry constraints, resulting in shortcomings in generating consistent surface reconstructions and recovering fine details. To solve this, we propose geometry-guided neural implicit surface (GG-NeuS), a geometry-guided neural implicit surfaces learning method for multiview surface reconstruction. Our model places a stronger emphasis on maintaining geometry consistency, significantly enhancing the quality of reconstruction. First, we enforce multiview geometry constraints on the surface points by locating the zero-level set of signed distance function (SDF). Second, we incorporate normal cues, predicted by general-purpose monocular estimators, to substantially recover fine geometric details. Additionally, we introduce a voxel-based surface reconstruction methodology that strikes an optimal balance between training time and reconstruction quality. Through comprehensive qualitative and quantitative experiments and analyses, we demonstrate that GG-NeuS successfully reconstructs fine-grained surface details and achieves superior surface reconstruction quality than state-of-the-art approaches.
引用
收藏
页码:7898 / 7908
页数:11
相关论文
共 74 条
  • [1] [Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.445
  • [2] [Anonymous], 2018, CAA J AUTOMATICA SIN, V5, P489
  • [3] [Anonymous], 2022, IEEE J RADIO FREQ ID, V6, P758
  • [4] SAL: Sign Agnostic Learning of Shapes from Raw Data
    Atzmon, Matan
    Lipman, Yaron
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2562 - 2571
  • [5] Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
    Barron, Jonathan T.
    Mildenhall, Ben
    Tancik, Matthew
    Hedman, Peter
    Martin-Brualla, Ricardo
    Srinivasan, Pratul P.
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5835 - 5844
  • [6] Ben-Shabat Yizhak, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P20, DOI 10.1007/978-3-030-58452-8_2
  • [7] Recovering Fine Details for Neural Implicit Surface Reconstruction
    Chen, Decai
    Zhang, Peng
    Feldmann, Ingo
    Schreer, Oliver
    Eisert, Peter
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4319 - 4328
  • [8] Point-Based Multi-View Stereo Network
    Chen, Rui
    Han, Songfang
    Xu, Jing
    Su, Hao
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1538 - 1547
  • [9] Learning Implicit Fields for Generative Shape Modeling
    Chen, Zhiqin
    Zhang, Hao
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5932 - 5941
  • [10] 3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction
    Choy, Christopher B.
    Xu, Danfei
    Gwak, Jun Young
    Chen, Kevin
    Savarese, Silvio
    [J]. COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 : 628 - 644