NeRF-Based Large-Scale Urban True Digital Orthophoto Map Generation Method

被引:0
|
作者
Wei, Jiaxin [1 ]
Zhu, Guobin [1 ]
Chen, Xiliang [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Neural radiance field; Training; Rendering (computer graphics); Image reconstruction; Accuracy; Three-dimensional displays; Autonomous aerial vehicles; Point cloud compression; Buildings; Urban areas; Large-scale urban scene; neural radiance field (NeRF); true digital orthophoto map (TDOM); OCCLUSION DETECTION;
D O I
10.1109/JSTARS.2024.3491869
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In urban scenes, there are man-made ground objects with complex structures and significant height differences, which leads to challenges in generating large-scale true digital orthophoto maps (TDOMs) of cities. However, traditional TDOM generation methods rely on precise prior geometric information, and this reliance makes it difficult to adapt to such complex environments. In this work, we propose TDOM-NeRF, a novel neural radiance field (NeRF) based method for large-scale urban TDOM generation. Without relying on additional prior information, our method utilizes multiview unmanned aerial vehicle (UAV) images as input and implicitly expresses the scene using hash grid features and multilayer perceptrons. By performing orthogonal volume rendering on the reconstruction results of the scene, we effectively address the problem of uneven scales in the synthetic views when generating TDOM. In actual training, we adopt a scene-block training strategy to extend our method to TDOM generation of large-scale scenes while achieving high-fidelity scene reconstruction. In addition, we regularize the model during training to eliminate erroneous "floating objects" in scene reconstruction, making our method applicable to low-overlap UAV datasets. Experimental results demonstrate that our method generates TDOMs with comparable geometric accuracy and eliminates issues such as ghosting, misalignment, and distortion in challenging areas, compared to commercial photogrammetry software like Metashape and Pix4DMapper. Furthermore, our method exhibits superior novel view synthesis performance compared to advanced NeRF methods like Ortho-NeRF. Our pipeline offers a flexible configuration of scene blocking, enabling a balance between performance and efficiency, which makes it particularly suitable for large-scale scene reconstruction.
引用
收藏
页码:1070 / 1084
页数:15
相关论文
共 50 条
  • [1] Satellite true digital orthophoto map generation without elevation data: a New NeRF-based method
    Qu, Yingjie
    An, Xiaoya
    Chen, Shihan
    Deng, Fei
    REMOTE SENSING LETTERS, 2024, 15 (03) : 258 - 269
  • [2] A fast approach to detect occlusions for large-scale true orthophoto generation
    Zhong, C. (dr.zhong.c@gmail.com), 1600, Science Press (41):
  • [3] Urban large-scale orthoimage standard for National Orthophoto Program
    Zhou, GQ
    IGARSS 2005: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-8, PROCEEDINGS, 2005, : 1214 - 1217
  • [4] Research on a True Digital Orthophoto Map generation technology based on 3D point cloud geometry
    Du, Shuhan
    Zheng, Fengjie
    Chen, Xiangning
    Wang, Haoyue
    Wang, Decheng
    Guo, Ningbo
    Yi, Hui
    INTERNATIONAL CONFERENCE ON COMPUTER VISION, APPLICATION, AND DESIGN (CVAD 2021), 2021, 12155
  • [5] Generating a High-Precision True Digital Orthophoto Map Based on UAV Images
    Liu, Yu
    Zheng, Xinqi
    Ai, Gang
    Zhang, Yi
    Zuo, Yuqiang
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2018, 7 (09)
  • [6] Ortho-NeRF: generating a true digital orthophoto map using the neural radiance field from unmanned aerial vehicle images
    Chen, Shihan
    Yan, Qingsong
    Qu, Yingjie
    Gao, Wang
    Yang, Junxing
    Deng, Fei
    GEO-SPATIAL INFORMATION SCIENCE, 2024,
  • [7] Linear Feature-Based Triangulation for Large-Scale Orthophoto Generation Over Mechanized Agricultural Fields
    Hasheminasab, Seyyed Meghdad
    Zhou, Tian
    Lin, Yi-Chun
    Habib, Ayman
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Height-Gradient-Based Method for Occlusion Detection in True Orthophoto Generation
    de Oliveira, Henrique Candido
    Galo, Mauricio
    Dal Poz, Aluir Porfirio
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (11) : 2222 - 2226
  • [9] A Method for Forest Vegetation Height Modeling Based on Aerial Digital Orthophoto Map and Digital Surface Model
    Deng, Xingsheng
    Tang, Guo
    Wang, Qingyang
    Luo, Lixia
    Long, Sichun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] A METHOD FOR GENERATING TRUE DIGITAL ORTHOPHOTO MAP OF UAV PLATFORM PUSH-BROOM HYPERSPECTRAL SCANNERS ASSISTED BY LIDAR
    Wang, Chen
    Gu, Yanfeng
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 7523 - 7526