UIR-ES: An unsupervised underwater image restoration framework with equivariance and stein unbiased risk estimator

被引:0
|
作者
Zhu, Jiacheng [1 ]
Wen, Junjie [2 ]
Hong, Duanqin [1 ]
Lin, Zhanpeng [1 ]
Hong, Wenxing [1 ]
机构
[1] Xiamen Univ, Sch Aerosp Engn, Xiamen, Peoples R China
[2] Chinese Univ Hong Kong, Dept Mech & Automat Engn, Hong Kong, Peoples R China
关键词
Underwater image restoration; Unsupervised learning; Equivariance; Stein unbiased risk estimator; ENHANCEMENT; NETWORK; DESIGN;
D O I
10.1016/j.imavis.2024.105285
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater imaging faces challenges for enhancing object visibility and restoring true colors due to the absorptive and scattering characteristics of water. Underwater image restoration (UIR) seeks solutions to restore clean images from degraded ones, providing significant utility in downstream tasks. Recently, data-driven UIR has garnered much attention due to the potent expressive capabilities of deep neural networks (DNNs). These DNNs are supervised, relying on a large amount of labeled training samples. However, acquiring such data is expensive or even impossible in real-world underwater scenarios. While recent researches suggest that unsupervised learning is effective in UIR, none of these frameworks consider signal physical priors. In this work, we present a novel physics-inspired unsupervised UIR framework empowered by equivariance and unbiased estimation techniques. Specifically, equivariance stems from the invariance, inherent in natural signals to enhance data-efficient learning. Given that degraded images invariably contain noise, we propose a noise-tolerant loss for unsupervised UIR based on the Stein unbiased risk estimator to achieve an accurate estimation of the data consistency. Extensive experiments on the benchmark UIR datasets, including the UIEB and RUIE datasets, validate the superiority of the proposed method in terms of quantitative scores, visual outcomes, and generalization ability, compared to state-of-the-art counterparts. Moreover, our method demonstrates even comparable performance with the supervised model.
引用
收藏
页数:10
相关论文
共 2 条
  • [1] ENSURE: ENSEMBLE STEIN'S UNBIASED RISK ESTIMATOR FOR UNSUPERVISED LEARNING
    Aggarwal, Hemant Kumar
    Pramanik, Aniket
    Jacob, Mathews
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1160 - 1164
  • [2] Image Denoising using Orthonormal Wavelet Transform with Stein Unbiased Risk Estimator
    Yadav, Manish
    Yadav, Swati
    Sharma, Dilip
    2014 IEEE STUDENTS' CONFERENCE ON ELECTRICAL, ELECTRONICS AND COMPUTER SCIENCE (SCEECS), 2014,