Fast 3D Reconstruction of UAV Images Based on Neural Radiance Field

被引:5
作者
Jiang, Cancheng [1 ]
Shao, Hua [1 ]
机构
[1] Nanjing Tech Univ, Coll Environm Sci & Engn, Nanjing 211816, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 18期
关键词
neural radiance field; 3D reconstruction; UAV images; multi-view;
D O I
10.3390/app131810174
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Traditional methods for 3D reconstruction of unmanned aerial vehicle (UAV) images often rely on classical multi-view 3D reconstruction techniques. This classical approach involves a sequential process encompassing feature extraction, matching, depth fusion, point cloud integration, and mesh creation. However, these steps, particularly those that feature extraction and matching, are intricate and time-consuming. Furthermore, as the number of steps increases, a corresponding amplification of cumulative error occurs, leading to its continual augmentation. Additionally, these methods typically utilize explicit representation, which can result in issues such as model discontinuity and missing data during the reconstruction process. To effectively address the challenges associated with heightened temporal expenditures, the absence of key elements, and the fragmented models inherent in three-dimensional reconstruction using Unmanned Aerial Vehicle (UAV) imagery, an alternative approach is introduced-the neural radiance field. This novel method leverages neural networks to intricately fit spatial information within the scene, thereby streamlining the reconstruction steps and rectifying model deficiencies. The neural radiance field method employs a fully connected neural network to meticulously model object surfaces and directly generate the 3D object model. This methodology simplifies the intricacies found in conventional 3D reconstruction processes. Implicitly encapsulating scene characteristics, the neural radiance field allows for iterative refinement of neural network parameters via the utilization of volume rendering techniques. Experimental results substantiate the efficacy of this approach, demonstrating its ability to complete scene reconstruction within a mere 5 min timeframe, thereby reducing reconstruction time by 90% while markedly enhancing reconstruction quality.
引用
收藏
页数:11
相关论文
共 22 条
[1]  
Agrawal M., 2001, P 2001 IEEE COMP SOC
[2]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[3]  
Broadhurst A., 2001, P 8 IEEE INT C COMP
[4]  
De Bonet J.S., 1999, P INT C COMP VIS ICC
[5]   Accurate, Dense, and Robust Multiview Stereopsis [J].
Furukawa, Yasutaka ;
Ponce, Jean .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (08) :1362-1376
[6]  
Galliani Silvano, 2016, Publikationen der Deutschen Gesellschaft f ur Photogrammetrie, Fernerkundung und Geoinformation e. V, V25, P2
[7]  
Hartley R., 2003, MULTIPLE VIEW GEOMET
[8]   UAV-Based Oblique Photogrammetry for Outdoor Data Acquisition and Offsite Visual Inspection of Transmission Line [J].
Jiang, San ;
Jiang, Wanshou ;
Huang, Wei ;
Yang, Liang .
REMOTE SENSING, 2017, 9 (03)
[9]   Screened Poisson Surface Reconstruction [J].
Kazhdan, Michael ;
Hoppe, Hugues .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (03)
[10]   A theory of shape by space carving [J].
Kutulakos, KN ;
Seitz, SM .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2000, 38 (03) :199-218