BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fields

被引:27
|
作者
Wang, Peng [1 ,2 ]
Zhao, Lingzhe [2 ]
Ma, Ruijie [2 ]
Liu, Peidong [2 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Westlake Univ, Hangzhou, Peoples R China
关键词
D O I
10.1109/CVPR52729.2023.00406
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Fields (NeRF) have received considerable attention recently, due to its impressive capability in photo-realistic 3D reconstruction and novel view synthesis, given a set of posed camera images. Earlier work usually assumes the input images are of good quality. However, image degradation (e.g. image motion blur in low-light conditions) can easily happen in real-world scenarios, which would further affect the rendering quality of NeRF. In this paper, we present a novel bundle adjusted deblur Neural Radiance Fields (BAD-NeRF), which can be robust to severe motion blurred images and inaccurate camera poses. Our approach models the physical image formation process of a motion blurred image, and jointly learns the parameters of NeRF and recovers the camera motion trajectories during exposure time. In experiments, we show that by directly modeling the real physical image formation process, BAD-NeRF achieves superior performance over prior works on both synthetic and real datasets. Code and data are available at https://github.com/WU-CVGL/BAD-NeRF.
引用
收藏
页码:4170 / 4179
页数:10
相关论文
共 50 条
  • [1] Deblur-NeRF: Neural Radiance Fields from Blurry Images
    Ma, Li
    Li, Xiaoyu
    Liao, Jing
    Zhang, Qi
    Wang, Xuan
    Wang, Jue
    Sander, Pedro, V
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12851 - 12860
  • [2] BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splatting
    Zhao, Lingzhe
    Wang, Peng
    Liu, Peidong
    COMPUTER VISION - ECCV 2024, PT XXV, 2025, 15083 : 233 - 250
  • [3] URS-NeRF: Unordered Rolling Shutter Bundle Adjustment for Neural Radiance Fields
    Xu, Bo
    Liu, Ziao
    Guo, Mengqi
    Li, Jiancheng
    Lee, Gim Hee
    COMPUTER VISION-ECCV 2024, PT XXXV, 2025, 15093 : 458 - 475
  • [4] nerf2nerf: Pairwise Registration of Neural Radiance Fields
    Goli, Lily
    Rebain, Daniel
    Sabour, Sara
    Garg, Animesh
    Tagliasacchi, Andrea
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9354 - 9361
  • [5] D-NeRF: Neural Radiance Fields for Dynamic Scenes
    Pumarola, Albert
    Corona, Enric
    Pons-Moll, Gerard
    Moreno-Noguer, Francesc
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10313 - 10322
  • [6] Strata-NeRF : Neural Radiance Fields for Stratified Scenes
    Dhiman, Ankit
    Srinath, R.
    Rangwani, Harsh
    Parihar, Rishubh
    Boregowda, Lokesh R.
    Sridhar, Srinath
    Babu, R. Venkatesh
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 17557 - 17568
  • [7] DReg-NeRF: Deep Registration for Neural Radiance Fields
    Chen, Yu
    Lee, Gim Hee
    arXiv, 2023,
  • [8] NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
    Mildenhall, Ben
    Srinivasan, Pratul P.
    Tancik, Matthew
    Barron, Jonathan T.
    Ramamoorthi, Ravi
    Ng, Ren
    COMMUNICATIONS OF THE ACM, 2022, 65 (01) : 99 - 106
  • [9] NeRF-Editing: Geometry Editing of Neural Radiance Fields
    Yuan, Yu-Jie
    Sun, Yang-Tian
    Lai, Yu-Kun
    Ma, Yuewen
    Jia, Rongfei
    Gao, Lin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18332 - 18343
  • [10] SeaThru-NeRF: Neural Radiance Fields in Scattering Media
    Levy, Deborah
    Peleg, Amit
    Pearl, Naama
    Rosenbaum, Dan
    Akkaynak, Derya
    Korman, Simon
    Treibitz, Tali
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 56 - 65