BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fields

被引:27
|
作者
Wang, Peng [1 ,2 ]
Zhao, Lingzhe [2 ]
Ma, Ruijie [2 ]
Liu, Peidong [2 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Westlake Univ, Hangzhou, Peoples R China
关键词
D O I
10.1109/CVPR52729.2023.00406
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Fields (NeRF) have received considerable attention recently, due to its impressive capability in photo-realistic 3D reconstruction and novel view synthesis, given a set of posed camera images. Earlier work usually assumes the input images are of good quality. However, image degradation (e.g. image motion blur in low-light conditions) can easily happen in real-world scenarios, which would further affect the rendering quality of NeRF. In this paper, we present a novel bundle adjusted deblur Neural Radiance Fields (BAD-NeRF), which can be robust to severe motion blurred images and inaccurate camera poses. Our approach models the physical image formation process of a motion blurred image, and jointly learns the parameters of NeRF and recovers the camera motion trajectories during exposure time. In experiments, we show that by directly modeling the real physical image formation process, BAD-NeRF achieves superior performance over prior works on both synthetic and real datasets. Code and data are available at https://github.com/WU-CVGL/BAD-NeRF.
引用
收藏
页码:4170 / 4179
页数:10
相关论文
共 50 条
  • [41] SRes-NeRF: Improved Neural Radiance Fields for Realism and Accuracy of Specular Reflections
    Dai, Shufan
    Cao, Yangjie
    Duan, Pengsong
    Chen, Xianfu
    MULTIMEDIA MODELING, MMM 2023, PT I, 2023, 13833 : 306 - 317
  • [42] Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fields
    Sunderhauf, Niko
    Abou-Chakra, Jad
    Miller, Dimity
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9370 - 9376
  • [43] Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields
    Verbin, Dor
    Hedman, Peter
    Mildenhall, Ben
    Zickler, Todd
    Barron, Jonathan T.
    Srinivasan, Pratul P.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5481 - 5490
  • [44] IBL-NeRF: Image-Based Lighting Formulation of Neural Radiance Fields
    Choi, Changwoon
    Kim, Juhyeon
    Kim, Young Min
    COMPUTER GRAPHICS FORUM, 2023, 42 (07)
  • [45] SAR-NeRF: Neural Radiance Fields for Synthetic Aperture Radar Multiview Representation
    Lei, Zhengxin
    Xu, Feng
    Wei, Jiangtao
    Cai, Feng
    Wang, Feng
    Jin, Ya-Qiu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [46] PI-NeRF: A Partial-Invertible Neural Radiance Fields for Pose Estimation
    Li, Zhihao
    Fu, Kexue
    Wang, Haoran
    Wang, Manning
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7826 - 7836
  • [47] CF-NeRF: Camera Parameter Free Neural Radiance Fields with Incremental Learning
    Yan, Qingsong
    Wang, Qiang
    Zhao, Kaiyong
    Chen, Jie
    Li, Bo
    Chu, Xiaowen
    Deng, Fei
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 6440 - 6448
  • [48] Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
    Barron, Jonathan T.
    Mildenhall, Ben
    Tancik, Matthew
    Hedman, Peter
    Martin-Brualla, Ricardo
    Srinivasan, Pratul P.
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5835 - 5844
  • [49] AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
    Guo, Yudong
    Chen, Keyu
    Liang, Sen
    Liu, Yong-Jin
    Bao, Hujun
    Zhang, Juyong
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5764 - 5774
  • [50] EGRA-NeRF: Edge-Guided Ray Allocation for Neural Radiance Fields
    Gai Z.
    Liu Z.
    Tan M.
    Ding J.
    Yu J.
    Tong M.
    Yuan J.
    Image and Vision Computing, 2023, 134