FlyNeRF: NeRF-Based Aerial Mapping for High-Quality 3D Scene Reconstruction

被引:0
|
作者
Dronova, Maria [1 ]
Cheremnykh, Vladislav [1 ]
Kotcov, Alexey [1 ]
Fedoseev, Aleksey [1 ]
Tsetserukou, Dzmitry [1 ]
机构
[1] Skolkovo Inst Sci & Technol, Intelligent Space Robot Lab, CDE, Bolshoy Blvd 30,Bld 1, Moscow 121205, Russia
来源
2024 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS, ICUAS | 2024年
基金
俄罗斯科学基金会;
关键词
D O I
10.1109/ICUAS60882.2024.10556906
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Current methods for 3D reconstruction and environmental mapping frequently face challenges in achieving high precision, highlighting the need for practical and effective solutions. In response to this issue, our study introduces FlyNeRF, a system integrating Neural Radiance Fields (NeRF) with dronebased data acquisition for high-quality 3D reconstruction. Utilizing unmanned aerial vehicles (UAV) for capturing images and corresponding spatial coordinates, the obtained data is subsequently used for the initial NeRF-based 3D reconstruction of the environment. Further evaluation of the reconstruction render quality is accomplished by the image evaluation neural network developed within the scope of our system. Depending on the results of the image evaluation module, our algorithm determines the position for additional image capture, thereby improving the reconstruction quality. The neural network introduced for render quality assessment demonstrates an accuracy of 97%. Furthermore, our adaptive methodology enhances the overall reconstruction quality, resulting in an average improvement of 2.5 dB in Peak Signal-to-Noise Ratio (PSNR) for the 10% quantile. The FlyNeRF demonstrates promising results, offering advancements in such fields as environmental monitoring, surveillance, and reconstruction of digital twins, where high-fidelity 3D reconstructions are crucial.
引用
收藏
页码:1050 / 1055
页数:6
相关论文
共 50 条
  • [1] A Critical Analysis of NeRF-Based 3D Reconstruction
    Remondino, Fabio
    Karami, Ali
    Yan, Ziyang
    Mazzacca, Gabriele
    Rigon, Simone
    Qin, Rongjun
    REMOTE SENSING, 2023, 15 (14)
  • [2] NERFBK: A HOLISTIC DATASET FOR BENCHMARKING NERF-BASED 3D RECONSTRUCTION
    Yan, Z.
    Mazzacca, G.
    Rigon, S.
    Farella, E. M.
    Trybala, P.
    Remondino, F.
    2ND GEOBENCH WORKSHOP ON EVALUATION AND BENCHMARKING OF SENSORS, SYSTEMS AND GEOSPATIAL DATA IN PHOTOGRAMMETRY AND REMOTE SENSING, VOL. 48-1, 2023, : 219 - 226
  • [3] NeRF-based 3D reconstruction pipeline for acquisition and analysis of tomato crop morphology
    Choi, Hong-Beom
    Park, Jae-Kun
    Park, Soo Hyun
    Lee, Taek Sung
    FRONTIERS IN PLANT SCIENCE, 2024, 15
  • [4] A monocular thoracoscopic 3D scene reconstruction framework based on NeRF
    Han, Juntao
    Zhang, Ziming
    Tan, Wenjun
    Wang, Yufei
    Li, Mingxiao
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2025,
  • [5] Two is Better than One: Achieving High-Quality 3D Scene Modeling with a NeRF Ensemble
    Di Sario, Francesco
    Renzulli, Riccardo
    Tartaglione, Enzo
    Grangetto, Marco
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT II, 2023, 14234 : 320 - 331
  • [6] Sampling-Based Path Planning for High-Quality Aerial 3D Reconstruction of Urban Scenes
    Yan, Feihu
    Xia, Enyong
    Li, Zhaoxin
    Zhou, Zhong
    REMOTE SENSING, 2021, 13 (05) : 1 - 23
  • [7] SAM-NeRF: NeRF-Based 3D Instance Segmentation with Segment Anything Model
    Wang, Xi
    Xie, Linglin
    Qiao, Peng
    Dou, Yong
    Liu, Sidun
    Li, Wenyu
    Yang, Kaijun
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT II, 2024, 15017 : 434 - 448
  • [8] High-Quality Reconstruction of 3D Model
    Liu, Xing-ming
    Cai, Tie
    Gui, Rong-zhi
    Wang, Hui-jing
    Liu, Jun-yao
    COMPUTER SCIENCE AND TECHNOLOGY (CST2016), 2017, : 946 - 954
  • [9] High-quality indoor scene 3D reconstruction with RGB-D cameras: A brief review
    Jianwei Li
    Wei Gao
    Yihong Wu
    Yangdong Liu
    Yanfei Shen
    Computational Visual Media, 2022, 8 (03) : 369 - 393
  • [10] High-quality indoor scene 3D reconstruction with RGB-D cameras: A brief review
    Jianwei Li
    Wei Gao
    Yihong Wu
    Yangdong Liu
    Yanfei Shen
    Computational Visual Media, 2022, 8 : 369 - 393