BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fields

被引:27
|
作者
Wang, Peng [1 ,2 ]
Zhao, Lingzhe [2 ]
Ma, Ruijie [2 ]
Liu, Peidong [2 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Westlake Univ, Hangzhou, Peoples R China
关键词
D O I
10.1109/CVPR52729.2023.00406
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Fields (NeRF) have received considerable attention recently, due to its impressive capability in photo-realistic 3D reconstruction and novel view synthesis, given a set of posed camera images. Earlier work usually assumes the input images are of good quality. However, image degradation (e.g. image motion blur in low-light conditions) can easily happen in real-world scenarios, which would further affect the rendering quality of NeRF. In this paper, we present a novel bundle adjusted deblur Neural Radiance Fields (BAD-NeRF), which can be robust to severe motion blurred images and inaccurate camera poses. Our approach models the physical image formation process of a motion blurred image, and jointly learns the parameters of NeRF and recovers the camera motion trajectories during exposure time. In experiments, we show that by directly modeling the real physical image formation process, BAD-NeRF achieves superior performance over prior works on both synthetic and real datasets. Code and data are available at https://github.com/WU-CVGL/BAD-NeRF.
引用
收藏
页码:4170 / 4179
页数:10
相关论文
共 50 条
  • [21] CaSE-NeRF: Camera Settings Editing of Neural Radiance Fields
    Sun, Ciliang
    Li, Yuqi
    Li, Jiabao
    Wang, Chong
    Dai, Xinmiao
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 95 - 107
  • [22] NeRF-DA: Neural Radiance Fields Deblurring With Active Learning
    Hong, Sejun
    Kim, Eunwoo
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 261 - 265
  • [23] FoV-NeRF: Foveated Neural Radiance Fields for Virtual Reality
    Deng, Nianchen
    He, Zhenyi
    Ye, Jiannan
    Duinkharjav, Budmonde
    Chakravarthula, Praneeth
    Yang, Xubo
    Sun, Qi
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (11) : 3854 - 3864
  • [24] Point-NeRF: Point-based Neural Radiance Fields
    Xu, Qiangeng
    Xu, Zexiang
    Philip, Julien
    Bi, Sai
    Shu, Zhixin
    Sunkavalli, Kalyan
    Neumann, Ulrich
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5428 - 5438
  • [25] BARF : Bundle-Adjusting Neural Radiance Fields
    Lin, Chen-Hsuan
    Ma, Wei-Chiu
    Torralba, Antonio
    Lucey, Simon
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5721 - 5731
  • [26] NeRF-Art: Text-Driven Neural Radiance Fields Stylization
    Wang, Can
    Jiang, Ruixiang
    Chai, Menglei
    He, Mingming
    Chen, Dongdong
    Liao, Jing
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4983 - 4996
  • [27] NeRF-SR: High Quality Neural Radiance Fields using Supersampling
    Wang, Chen
    Wu, Xian
    Guo, Yuan-Chen
    Zhang, Song-Hai
    Tai, Yu-Wing
    Hu, Shi-Min
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6445 - 6454
  • [28] Ced-NeRF: A Compact and Efficient Method for Dynamic Neural Radiance Fields
    Lin, Youtian
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3504 - 3512
  • [29] Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fields
    Isaac-Medina, Brian K. S.
    Willcocks, Chris G.
    Breckon, Toby P.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 66 - 75
  • [30] RS-NeRF: Neural Radiance Fields from Rolling Shutter Images
    Niu, Muyao
    Chen, Tong
    Zhan, Yifan
    Li, Zhuoxiao
    Ji, Xiang
    Zheng, Yinqiang
    COMPUTER VISION-ECCV 2024, PT XLVI, 2025, 15104 : 163 - 180