CPDM: Content-preserving diffusion model for underwater image enhancement

被引:1
作者
Shi, Xiaowen [1 ]
Wang, Yuan-Gen [1 ]
机构
[1] Guangzhou Univ, Sch Comp Sci & Cyber Engn, Guangzhou 510006, Peoples R China
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
基金
中国国家自然科学基金;
关键词
Content-preserving; Underwater image enhancement; Diffusion model; COLOR; DEPTH;
D O I
10.1038/s41598-024-82803-y
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Underwater image enhancement (UIE) is challenging since image degradation in aquatic environments is complicated and changing over time. Existing mainstream methods rely on either physical-model or data-driven, suffering from performance bottlenecks due to changes in imaging conditions or training instability. In this article, we attempt to adapt the diffusion model to the UIE task and propose a Content-Preserving Diffusion Model (CPDM) to address the above challenges. CPDM first leverages a diffusion model as its fundamental model for stable training and then designs a content-preserving framework to deal with changes in imaging conditions. Specifically, we construct a conditional input module by adopting both the raw image and the difference between the raw and noisy images as the input at each time step of the diffusion process, which can enhance the model's adaptability by considering the changes involving the raw images in underwater environments. To preserve the essential content of the raw images, we construct a content compensation module for content-aware training by extracting low-level image features of the raw images as compensation for each down block. We conducted tests on the LSUI, UIEB, and EUVP datasets, and the results show that CPDM outperforms state-of-the-art methods in both subjective and objective metrics, achieving the best overall performance. The GitHub link for the code is https://github.com/GZHU-DVL/CPDM.
引用
收藏
页数:12
相关论文
共 61 条
  • [1] Ahn J, 2017, J MAR SCI TECH-JAPAN, V22, P758, DOI 10.1007/s00773-017-0442-1
  • [2] Sea-thru: A Method For Removing Water From Underwater Images
    Akkaynak, Derya
    Treibitz, Tali
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1682 - 1691
  • [3] A Revised Underwater Image Formation Model
    Akkaynak, Derya
    Treibitz, Tali
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6723 - 6732
  • [4] What Is the Space of Attenuation Coefficients in Underwater Computer Vision?
    Akkaynak, Derya
    Treibitz, Tali
    Shlesinger, Tom
    Tamir, Raz
    Loya, Yossi
    Iluz, David
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 568 - 577
  • [5] Diffusion Models in Vision: A Survey
    Croitoru, Florinel-Alin
    Hondru, Vlad
    Ionescu, Radu Tudor
    Shah, Mubarak
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) : 10850 - 10869
  • [6] Dhariwal P, 2021, ADV NEUR IN, V34
  • [7] Transmission Estimation in Underwater Single Images
    Drews-, P., Jr.
    do Nascimento, E.
    Moraes, F.
    Botelho, S.
    Campos, M.
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, : 825 - 830
  • [8] Underwater Depth Estimation and Image Restoration Based on Single Images
    Drews, Paulo L. J., Jr.
    Nascimento, Erickson R.
    Botelho, Silvia S. C.
    Montenegro Campos, Mario Fernando
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) : 24 - 35
  • [9] UNDERWATER IMAGE ENHANCEMENT VIA LEARNING WATER TYPE DESENSITIZED REPRESENTATIONS
    Fu, Zhenqi
    Lin, Xiaopeng
    Wang, Wu
    Huang, Yue
    Ding, Xinghao
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2764 - 2768
  • [10] Automatic Red-Channel underwater image restoration
    Galdran, Adrian
    Pardo, David
    Picon, Artzai
    Alvarez-Gila, Aitor
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 26 : 132 - 145