Unsupervised underwater image restoration via Koschmieder model disentanglement

被引:0
作者
Zhang, Song [1 ,2 ,3 ,4 ]
An, Dong [1 ,2 ,3 ,4 ]
Li, Daoliang [1 ,2 ,3 ,4 ]
Zhao, Ran [1 ,2 ,3 ,4 ]
机构
[1] China Agr Univ, Natl Innovat Ctr Digital Fishery, Beijing 10083, Peoples R China
[2] China Agr Univ, Minist Agr & Rural Affairs, Key Lab Smart Farming Technol Aquat Anim & Livesto, Beijing 10083, Peoples R China
[3] China Agr Univ, Beijing Engn & Technol Res Ctr Internet Things Agr, Beijing 10083, Peoples R China
[4] China Agr Univ, Coll Informat & Elect Engn, Beijing 10083, Peoples R China
关键词
Underwater image restoration; Unsupervised learning; Koschmieder light scattering model; Reconstruction constraint; Homology constraint; ENHANCEMENT;
D O I
10.1016/j.eswa.2024.126075
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most deep learning-based underwater image enhancement approaches rely on paired underwater datasets. Given the scarcity of real-world paired datasets and the inadequacy of synthetic datasets in approximating real-world conditions, using deep learning to restore these degraded underwater images remains challenging. To address this, this paper proposes an unsupervised underwater image restoration method based on the Koschmieder light scattering model, called KM-UUIR. Specifically, we disentangle the input image into the global background light, the scene radiance (the clean image), and the transmission map. These three components are recombined to form a reconstructed image, with a reconstruction consistency constraint applied between the original and reconstructed images. Additionally, the estimated scene radiance and global background light are combined with the original image to generate a re-degraded image. The re-degraded image shares the same formation model and scene radiance as the original image. Thus, a homology consistency constraint is applied between the original and re-degraded images. Furthermore, no-reference constraints are introduced to reduce color distortion and achieve higher quality underwater images. Quantitative and qualitative experiments demonstrate the effectiveness of the proposed method, achieving a PSNR of 24.64 and an SSIM of 0.88 on the UIEB dataset, showing competitive performance even compared to supervised learning methods.
引用
收藏
页数:18
相关论文
共 86 条
[1]  
Kenk MA, 2020, Arxiv, DOI [arXiv:2008.05402, 10.48550/arXiv.2008.05402, DOI 10.48550/ARXIV.2008.05402]
[2]   Sea-thru: A Method For Removing Water From Underwater Images [J].
Akkaynak, Derya ;
Treibitz, Tali .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1682-1691
[3]   DivGAN: A diversity enforcing generative adversarial network for mode collapse reduction [J].
Allahyani, Manal ;
Alsulami, Rahaf ;
Alwafi, Taif ;
Alafif, Tarik ;
Ammar, Heyfa ;
Sabban, Sari ;
Chen, Xuewen .
ARTIFICIAL INTELLIGENCE, 2023, 317
[4]   HFM: A hybrid fusion method for underwater image enhancement [J].
An, Shunmin ;
Xu, Lihong ;
Deng, Zhichao ;
Zhang, Huapeng .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
[5]   O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :867-875
[6]   Color Balance and Fusion for Underwater Image Enhancement [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bekaert, Philippe .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :379-393
[7]  
Ba J.L., 2016, arXiv preprint arXiv:1607.06450, DOI DOI 10.48550/ARXIV.1607.06450
[8]   Structural similarity index (SSIM) revisited: A data-driven approach [J].
Bakurov, Illya ;
Buzzelli, Marco ;
Schettini, Raimondo ;
Castelli, Mauro ;
Vanneschi, Leonardo .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 189
[9]   Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset [J].
Berman, Dana ;
Levy, Deborah ;
Avidan, Shai ;
Treibitz, Tali .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) :2822-2837
[10]   A SPATIAL PROCESSOR MODEL FOR OBJECT COLOR-PERCEPTION [J].
BUCHSBAUM, G .
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 1980, 310 (01) :1-26