WaterHE-NeRF: Water-ray matching neural radiance fields for underwater scene reconstruction

被引:0
作者
Zhou, Jingchun [1 ]
Liang, Tianyu [1 ]
Zhang, Dehuan [1 ]
Liu, Siyuan [2 ]
Wang, Junsheng [1 ]
Wu, Edmond Q. [3 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Liaoning, Peoples R China
[2] Dalian Maritime Univ, Dept Marine Engn, Dalian 116026, Liaoning, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater image; Image enhancement; Neural radiance field; Image fusion; IMAGE-ENHANCEMENT;
D O I
10.1016/j.inffus.2024.102770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Field (NeRF) technology demonstrates immense potential in novel viewpoint synthesis tasks due to its physics-based volumetric rendering process, which is particularly promising in underwater scenes. However, existing underwater NeRF methods face challenges in handling light attenuation caused by the water medium and the lack of real Ground Truth (GT) supervision. To address these issues, we propose WaterHE-NeRF, a novel approach incorporating a water-ray matching field developed based on Retinex theory. This field precisely encodes color, density, and illuminance attenuation in three-dimensional space. WaterHENeRF employs an illuminance attenuation mechanism to generate degraded and clear multi-view images, optimizing image restoration by combining reconstruction loss with Wasserstein distance. Furthermore, using histogram equalization (HE) as pseudo-GT, WaterHE-NeRF enhances the network's accuracy in preserving original details and color distribution. Extensive experiments on real underwater and synthetic datasets validate the effectiveness of WaterHE-NeRF.
引用
收藏
页数:17
相关论文
共 64 条
  • [1] Sea-thru: A Method For Removing Water From Underwater Images
    Akkaynak, Derya
    Treibitz, Tali
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1682 - 1691
  • [2] A Revised Underwater Image Formation Model
    Akkaynak, Derya
    Treibitz, Tali
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6723 - 6732
  • [3] Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
  • [4] Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
    Barron, Jonathan T.
    Mildenhall, Ben
    Verbin, Dor
    Srinivasan, Pratul P.
    Hedman, Peter
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5460 - 5469
  • [5] Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
    Barron, Jonathan T.
    Mildenhall, Ben
    Tancik, Matthew
    Hedman, Peter
    Martin-Brualla, Ricardo
    Srinivasan, Pratul P.
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5835 - 5844
  • [6] TensoRF: Tensorial Radiance Fields
    Chen, Anpei
    Xu, Zexiang
    Geiger, Andreas
    Yu, Jingyi
    Su, Hao
    [J]. COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 333 - 350
  • [7] Chen JF, 2023, PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, P5788
  • [8] Simple Baselines for Image Restoration
    Chen, Liangyu
    Chu, Xiaojie
    Zhang, Xiangyu
    Sun, Jian
    [J]. COMPUTER VISION, ECCV 2022, PT VII, 2022, 13667 : 17 - 33
  • [9] SP-SeaNeRF: Underwater Neural Radiance Fields with strong scattering perception
    Chen, Lifang
    Xiong, Yuchen
    Zhang, Yanjie
    Yu, Ruiyin
    Fang, Lian
    Liu, Defeng
    [J]. COMPUTERS & GRAPHICS-UK, 2024, 123
  • [10] PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN With Dual-Discriminators
    Cong, Runmin
    Yang, Wenyu
    Zhang, Wei
    Li, Chongyi
    Guo, Chun-Le
    Huang, Qingming
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4472 - 4485