NeuFG: Neural Fuzzy Geometric Representation for 3-D Reconstruction

被引:0
|
作者
Hong, Qingqi [1 ]
Yang, Chuanfeng [1 ]
Chen, Jiahui [1 ]
Li, Zihan [2 ,3 ]
Wu, Qingqiang [1 ]
Li, Qingde [4 ]
Tian, Jie [5 ,6 ]
机构
[1] Xiamen Univ, Sch Film, Sch Informat, Ctr Digital Media Comp, Xiamen 361005, Peoples R China
[2] Xiamen Univ, Xiamen, Peoples R China
[3] Univ Washington, Seattle, WA 98195 USA
[4] Univ Hull, Sch Comp Sci, Kingston Upon Hull HU6 7RX, England
[5] Beihang Univ, Sch Engn Med, Beijing 100191, Peoples R China
[6] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
3-D reconstruction; fuzzy set theory; multiview; neural rendering;
D O I
10.1109/TFUZZ.2024.3447088
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Three-dimensional reconstruction from multiview images is considered as a longstanding problem in computer vision and graphics. In order to achieve high-fidelity geometry and appearance of 3-D scenes, this article proposes a novel geometric object learning method for multiview reconstruction with fuzzy set theory. We establish a new neural 3D reconstruction theoretical frame called neural fuzzy geometric representation (NeuFG), which is a special type of implicit representation of geometric scene that only takes value in [0, 1]. NeuFG is essentially a volume image, and thus can be visualized directly with the conventional volume rendering technique. Extensive experiments on two public datasets, i.e., DTU and BlendedMVS, show that our method has the ability of accurately reconstructing complex shapes with vivid geometric details, without the requirement of mask supervision. Both qualitative and quantitative comparisons demonstrate that the proposed method has superior performance over the state-of-the-art neural scene representation methods. The code will be released on GitHub soon.
引用
收藏
页码:6340 / 6349
页数:10
相关论文
共 50 条
  • [41] RECONSTRUCTION OF 3-D BRANCHING STRUCTURES
    HENRI, CJ
    COLLINS, DL
    PETERS, TM
    LECTURE NOTES IN COMPUTER SCIENCE, 1991, 511 : 65 - 80
  • [42] Accuracy of 3-D Reconstruction With Occlusions
    Begon, Mickael
    Lacouture, Patrick
    JOURNAL OF APPLIED BIOMECHANICS, 2010, 26 (01) : 104 - 108
  • [43] A generalized fuzzy mathematical morphology and its application in robust 2-D and 3-D object representation
    Chatzis, V
    Pitas, I
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (10) : 1798 - 1810
  • [44] Combining a morphological interpolation approach with a surface reconstruction method for the 3-D representation of tomographic data
    Mouravliansky, N
    Matsopoulos, GK
    Delibasis, K
    Asvestas, P
    Nikita, KS
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2004, 15 (04) : 565 - 579
  • [45] 3-D Image Reconstruction in Planar Array ECT by Combining Depth Estimation and Sparse Representation
    Suo, Peng
    Sun, Jiangtao
    Tian, Wenbin
    Sun, Shijie
    Xu, Lijun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [46] Sparse Representation Denoising Framework for 3-D Building Reconstruction From Airborne LiDAR Data
    Cao, Zhimin
    Gu, Yanfeng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2016, 9 (05) : 1888 - 1900
  • [47] Hybrid mesh-neural representation for 3D transparent object reconstruction
    Xu, Jiamin
    Zhu, Zihan
    Bao, Hujun
    Xu, Weiwei
    COMPUTATIONAL VISUAL MEDIA, 2025, 11 (01): : 123 - 140
  • [48] RaNeRF: Neural 3-D Reconstruction of Space Targets From ISAR Image Sequences
    Liu, Afei
    Zhang, Shuanghui
    Zhang, Chi
    Zhi, Shuaifeng
    Li, Xiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [49] A neural matching algorithm for 3-D reconstruction from stereo pairs of linear images
    Ruichek, Y
    Postaire, JG
    PATTERN RECOGNITION LETTERS, 1996, 17 (04) : 387 - 398
  • [50] Neural network mapping of image-to-object coordinates for 3-D shape reconstruction
    Knopf, GK
    Kofman, J
    INTELLIGENT ROBOTS AND COMPUTER VISION XV: ALGORITHMS, TECHNIQUES, ACTIVE VISION, AND MATERIALS HANDLING, 1996, 2904 : 129 - 137