Fast 3D Reconstruction of UAV Images Based on Neural Radiance Field

被引:3
|
作者
Jiang, Cancheng [1 ]
Shao, Hua [1 ]
机构
[1] Nanjing Tech Univ, Coll Environm Sci & Engn, Nanjing 211816, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 18期
关键词
neural radiance field; 3D reconstruction; UAV images; multi-view;
D O I
10.3390/app131810174
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Traditional methods for 3D reconstruction of unmanned aerial vehicle (UAV) images often rely on classical multi-view 3D reconstruction techniques. This classical approach involves a sequential process encompassing feature extraction, matching, depth fusion, point cloud integration, and mesh creation. However, these steps, particularly those that feature extraction and matching, are intricate and time-consuming. Furthermore, as the number of steps increases, a corresponding amplification of cumulative error occurs, leading to its continual augmentation. Additionally, these methods typically utilize explicit representation, which can result in issues such as model discontinuity and missing data during the reconstruction process. To effectively address the challenges associated with heightened temporal expenditures, the absence of key elements, and the fragmented models inherent in three-dimensional reconstruction using Unmanned Aerial Vehicle (UAV) imagery, an alternative approach is introduced-the neural radiance field. This novel method leverages neural networks to intricately fit spatial information within the scene, thereby streamlining the reconstruction steps and rectifying model deficiencies. The neural radiance field method employs a fully connected neural network to meticulously model object surfaces and directly generate the 3D object model. This methodology simplifies the intricacies found in conventional 3D reconstruction processes. Implicitly encapsulating scene characteristics, the neural radiance field allows for iterative refinement of neural network parameters via the utilization of volume rendering techniques. Experimental results substantiate the efficacy of this approach, demonstrating its ability to complete scene reconstruction within a mere 5 min timeframe, thereby reducing reconstruction time by 90% while markedly enhancing reconstruction quality.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] 3D Reconstruction and Rendering Based on Improved Neural Radiance Field
    Wan, Xiaona
    Xu, Ziyun
    Kang, Jian
    Feng, Xiaoyi
    2024 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MEDIA COMPUTING, ICIPMC 2024, 2024, : 120 - 126
  • [2] 3D reconstruction based on neural radiance field structure ambiguity optimization
    Shi, Chao
    Deng, Huiping
    Xiang, Shen
    Wu, Jin
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (11) : 1483 - 1493
  • [3] Fast 3D reconstruction method based on UAV photography
    Wang, Jiang-An
    Ma, Huang-Te
    Wang, Chun-Mei
    He, Yong-Jie
    ETRI JOURNAL, 2018, 40 (06) : 788 - 793
  • [4] MP-NeRF: More refined deblurred neural radiance field for 3D reconstruction of blurred images
    Wang, Xiaohui
    Yin, Zhenyu
    Zhang, Feiqing
    Feng, Dan
    Wang, Zisong
    KNOWLEDGE-BASED SYSTEMS, 2024, 290
  • [5] 3D Reconstruction of Ancient Buildings Using UAV Images and Neural Radiation Field with Depth Supervision
    Ge, Yingwei
    Guo, Bingxuan
    Zha, Peishuai
    Jiang, San
    Jiang, Ziyu
    Li, Demin
    REMOTE SENSING, 2024, 16 (03)
  • [6] Fast 3D reconstruction of Ultrasonic Images Based on Generalized Regression Neural Network
    Asad, Babakhani
    Du Zhi-jiang
    Sun Li-ning
    Reza, Kardan
    Fereidoun, Mianji A.
    WORLD CONGRESS ON MEDICAL PHYSICS AND BIOMEDICAL ENGINEERING 2006, VOL 14, PTS 1-6, 2007, 14 : 3117 - +
  • [7] 3D reconstruction based on light field images
    Zhu, Dong
    Wu, Chunhong
    Liu, Yunluo
    Fu, Dongmei
    NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615
  • [8] Evaluating Neural Radiance Fields for 3D Plant Geometry Reconstruction in Field Conditions
    Arshad, Muhammad Arbab
    Jubery, Talukder
    Afful, James
    Jignasu, Anushrut
    Balu, Aditya
    Ganapathysubramanian, Baskar
    Sarkar, Soumik
    Krishnamurthy, Adarsh
    PLANT PHENOMICS, 2024, 6
  • [9] An automated 3D reconstruction method of UAV images
    Liu, Jun
    Wang, He
    Liu, Xiaoyang
    Li, Feng
    Sun, Guangtong
    Song, Ping
    AOPC 2015: TELESCOPE AND SPACE OPTICAL INSTRUMENTATION, 2015, 9678
  • [10] 3D scene reconstruction based on 3D laser point cloud combining UAV images
    Liu, Huiyun
    Yan, Yangyang
    Zhang, Xitong
    Wu, Zhenzhen
    2ND ISPRS INTERNATIONAL CONFERENCE ON COMPUTER VISION IN REMOTE SENSING (CVRS 2015), 2016, 9901