BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fields

被引:27
|
作者
Wang, Peng [1 ,2 ]
Zhao, Lingzhe [2 ]
Ma, Ruijie [2 ]
Liu, Peidong [2 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Westlake Univ, Hangzhou, Peoples R China
关键词
D O I
10.1109/CVPR52729.2023.00406
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Fields (NeRF) have received considerable attention recently, due to its impressive capability in photo-realistic 3D reconstruction and novel view synthesis, given a set of posed camera images. Earlier work usually assumes the input images are of good quality. However, image degradation (e.g. image motion blur in low-light conditions) can easily happen in real-world scenarios, which would further affect the rendering quality of NeRF. In this paper, we present a novel bundle adjusted deblur Neural Radiance Fields (BAD-NeRF), which can be robust to severe motion blurred images and inaccurate camera poses. Our approach models the physical image formation process of a motion blurred image, and jointly learns the parameters of NeRF and recovers the camera motion trajectories during exposure time. In experiments, we show that by directly modeling the real physical image formation process, BAD-NeRF achieves superior performance over prior works on both synthetic and real datasets. Code and data are available at https://github.com/WU-CVGL/BAD-NeRF.
引用
收藏
页码:4170 / 4179
页数:10
相关论文
共 50 条
  • [31] DoF-NeRF: Depth-of-Field Meets Neural Radiance Fields
    Wu, Zijin
    Li, Xingyi
    Peng, Juewen
    Lu, Hao
    Cao, Zhiguo
    Zhong, Weicai
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1718 - 1729
  • [32] Touching a NeRF: Leveraging Neural Radiance Fields for Tactile Sensory Data Generation
    Zhong, Shaohong
    Albini, Alessandro
    Jones, Oiwi Parker
    Maiolino, Perla
    Posner, Ingmar
    CONFERENCE ON ROBOT LEARNING, VOL 205, 2022, 205 : 1618 - 1628
  • [33] E-NeRF: Neural Radiance Fields From a Moving Event Camera
    Klenk, Simon
    Koestler, Lukas
    Scaramuzza, Davide
    Cremers, Daniel
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (03) : 1587 - 1594
  • [34] Loc-NeRF: Monte Carlo Localization using Neural Radiance Fields
    Maggio, Dominic
    Abate, Marcus
    Shi, Jingnan
    Mario, Courtney
    Carlone, Luca
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 4018 - 4025
  • [35] LB-NERF: LIGHT BENDING NEURAL RADIANCE FIELDS FOR TRANSPARENT MEDIUM
    Fujitomi, Taku
    Sakurada, Ken
    Hamaguchi, Ryuhei
    Shishido, Hidehiko
    Onishi, Masaki
    Kameda, Yoshinari
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2142 - 2146
  • [36] ViP-NeRF: Visibility Prior for Sparse Input Neural Radiance Fields
    Somraj, Nagabhushan
    Soundararajan, Rajiv
    PROCEEDINGS OF SIGGRAPH 2023 CONFERENCE PAPERS, SIGGRAPH 2023, 2023,
  • [37] SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fields
    Mirzaei, Ashkan
    Aumentado-Armstrong, Tristan
    Derpanis, Konstantinos G.
    Kelly, Jonathan
    Brubaker, Marcus A.
    Gilitschenski, Igor
    Levinshtein, Alex
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 20669 - 20679
  • [38] NEURAL RADIANCE FIELDS (NERF): REVIEW AND POTENTIAL APPLICATIONS TO DIGITAL CULTURAL HERITAGE
    Croce, V.
    Caroti, G.
    De Luca, L.
    Piemonte, A.
    Veron, P.
    29TH CIPA SYMPOSIUM DOCUMENTING, UNDERSTANDING, PRESERVING CULTURAL HERITAGE. HUMANITIES AND DIGITAL TECHNOLOGIES FOR SHAPING THE FUTURE, VOL. 48-M-2, 2023, : 453 - 460
  • [39] Stega4NeRF: cover selection steganography for neural radiance fields
    Dong, Weina
    Liu, Jia
    Chen, Lifeng
    Sun, Wenquan
    Pan, Xiaozhong
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (03) : 33031
  • [40] Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
    Barron, Jonathan T.
    Mildenhall, Ben
    Verbin, Dor
    Srinivasan, Pratul P.
    Hedman, Peter
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5460 - 5469