WaterHE-NeRF: Water-ray matching neural radiance fields for underwater scene reconstruction

被引:0
作者
Zhou, Jingchun [1 ]
Liang, Tianyu [1 ]
Zhang, Dehuan [1 ]
Liu, Siyuan [2 ]
Wang, Junsheng [1 ]
Wu, Edmond Q. [3 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Liaoning, Peoples R China
[2] Dalian Maritime Univ, Dept Marine Engn, Dalian 116026, Liaoning, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater image; Image enhancement; Neural radiance field; Image fusion; IMAGE-ENHANCEMENT;
D O I
10.1016/j.inffus.2024.102770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Field (NeRF) technology demonstrates immense potential in novel viewpoint synthesis tasks due to its physics-based volumetric rendering process, which is particularly promising in underwater scenes. However, existing underwater NeRF methods face challenges in handling light attenuation caused by the water medium and the lack of real Ground Truth (GT) supervision. To address these issues, we propose WaterHE-NeRF, a novel approach incorporating a water-ray matching field developed based on Retinex theory. This field precisely encodes color, density, and illuminance attenuation in three-dimensional space. WaterHENeRF employs an illuminance attenuation mechanism to generate degraded and clear multi-view images, optimizing image restoration by combining reconstruction loss with Wasserstein distance. Furthermore, using histogram equalization (HE) as pseudo-GT, WaterHE-NeRF enhances the network's accuracy in preserving original details and color distribution. Extensive experiments on real underwater and synthetic datasets validate the effectiveness of WaterHE-NeRF.
引用
收藏
页数:17
相关论文
共 64 条
  • [21] Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fields
    Hu, Wenbo
    Wang, Yuling
    Ma, Lin
    Yang, Bangbang
    Gao, Lin
    Liu, Xiao
    Ma, Yuewen
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 19717 - 19726
  • [22] Contrastive Semi-supervised Learning for Underwater Image Restoration via Reliable Bank
    Huang, Shirui
    Wang, Keyan
    Liu, Huan
    Chen, Jun
    Li, Yunsong
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18145 - 18155
  • [23] Underwater Image Enhancement via Adaptive Group Attention-Based Multiscale Cascade Transformer
    Huang, Zhixiong
    Li, Jinjiang
    Hua, Zhen
    Fan, Linwei
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [24] Fast Underwater Image Enhancement for Improved Visual Perception
    Islam, Md Jahidul
    Xia, Youya
    Sattar, Junaed
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 3227 - 3234
  • [25] COMPUTER MODELING AND THE DESIGN OF OPTIMAL UNDERWATER IMAGING-SYSTEMS
    JAFFE, JS
    [J]. IEEE JOURNAL OF OCEANIC ENGINEERING, 1990, 15 (02) : 101 - 111
  • [26] Jiang JX, 2023, Arxiv, DOI arXiv:2305.08824
  • [27] Perception-Driven Deep Underwater Image Enhancement Without Paired Supervision
    Jiang, Qiuping
    Kang, Yaozu
    Wang, Zhihua
    Ren, Wenqi
    Li, Chongyi
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4884 - 4897
  • [28] Korhonen J, 2012, INT WORK QUAL MULTIM, P37, DOI 10.1109/QoMEX.2012.6263880
  • [29] SeaThru-NeRF: Neural Radiance Fields in Scattering Media
    Levy, Deborah
    Peleg, Amit
    Pearl, Naama
    Rosenbaum, Dan
    Akkaynak, Derya
    Korman, Simon
    Treibitz, Tali
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 56 - 65
  • [30] Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding
    Li, Chongyi
    Anwar, Saeed
    Hou, Junhui
    Cong, Runmin
    Guo, Chunle
    Ren, Wenqi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4985 - 5000