BDMUIE: Underwater image enhancement based on Bayesian diffusion model

被引:2
作者
Chen, Lingfeng [1 ]
Xu, Zhihan [2 ]
Wei, Chao [1 ]
Xu, Yuanxin [1 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Peoples R China
[2] Xian Jiaotong Liverpool Univ, Sch Adv Technol, Suzhou, Peoples R China
基金
国家重点研发计划;
关键词
Underwater image enhancement; Diffusion model; Bayesian diffusion model; Prior feature fusion;
D O I
10.1016/j.neucom.2024.129274
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing deep learning-based underwater image enhancement (UIE) methods primarily rely on data-driven approaches that map underwater images to their enhanced counterparts. However, these methods often neglect the role of prior information in improving image quality. Such prior information, derived from natural domain images with balanced color distributions and rich structural details, can guide the enhancement process by reducing the domain gap between underwater and natural images. To address this limitation, we introduce BDMUIE, an innovative UIE framework based on Bayesian diffusion models. By incorporating prior knowledge from natural domain images, BDMUIE modifies the reverse diffusion process to effectively reduce the domain gap between underwater and natural images. A novel multi-scale fusion mechanism is introduced, uniquely leveraging encoder features across diffusion branches. This mechanism seamlessly integrates prior information from natural domain images with features from the underwater enhancement branch, resulting in improved detail preservation and color restoration. Additionally, the ECAG block enhances the model's ability to remove noise while supporting the fusion process to retain structural and textural details. Extensive experiments on widely used underwater image datasets, as well as application experiments, demonstrate that BDMUIE achieves superior performance compared to state-of-the-art methods, with significant improvements in both visual quality and quantitative metrics, including PSNR and SSIM.
引用
收藏
页数:13
相关论文
共 61 条
[1]  
Ahn J, 2017, J MAR SCI TECH-JAPAN, V22, P758, DOI 10.1007/s00773-017-0442-1
[2]   Color Balance and Fusion for Underwater Image Enhancement [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bekaert, Philippe .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :379-393
[3]   PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN With Dual-Discriminators [J].
Cong, Runmin ;
Yang, Wenyu ;
Zhang, Wei ;
Li, Chongyi ;
Guo, Chun-Le ;
Huang, Qingming ;
Kwong, Sam .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :4472-4485
[4]  
Dhariwal P, 2021, ADV NEUR IN, V34
[5]   Transmission Estimation in Underwater Single Images [J].
Drews-, P., Jr. ;
do Nascimento, E. ;
Moraes, F. ;
Botelho, S. ;
Campos, M. .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, :825-830
[6]   UIEDP: Boosting underwater image enhancement with diffusion prior [J].
Du, Dazhao ;
Li, Enhan ;
Si, Lingyu ;
Zhai, Wenlong ;
Xu, Fanjiang ;
Niu, Jianwei ;
Sun, Fuchun .
EXPERT SYSTEMS WITH APPLICATIONS, 2025, 259
[7]   Uncertainty Inspired Underwater Image Enhancement [J].
Fu, Zhenqi ;
Wang, Wu ;
Huang, Yue ;
Ding, Xinghao ;
Ma, Kai-Kuang .
COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 :465-482
[8]   DiffWater: Underwater Image Enhancement Based on Conditional Denoising Diffusion Probabilistic Model [J].
Guan, Meisheng ;
Xu, Haiyong ;
Jiang, Gangyi ;
Yu, Mei ;
Chen, Yeyao ;
Luo, Ting ;
Zhang, Xuebo .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :2319-2335
[9]  
Ho J., 2020, Advances in neural information processing systems, P6840
[10]   Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization [J].
Huang, Xun ;
Belongie, Serge .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1510-1519