A Patch-Based Method for Underwater Image Enhancement With Denoising Diffusion Models

被引:0
作者
Xia, Haisheng [1 ]
Bao, Binglei [2 ]
Liao, Fei [2 ]
Chen, Jintao [2 ]
Wang, Binglu [3 ]
Li, Zhijun [1 ]
机构
[1] Tongji Univ, Shanghai Yangzhi Rehabil Hosp, Translat Res Ctr, Shanghai Sunshine Rehabil Ctr,Sch Mech Engn, Shanghai 201804, Peoples R China
[2] Univ Sci & Technol China, Inst Adv Technol, Dept Automat, Hefei 230026, Peoples R China
[3] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Image restoration; Diffusion models; Noise; Noise reduction; Image resolution; Training; Spatial resolution; Knowledge based systems; Image enhancement; Atmospheric modeling; Deep learning; denoising diffusion models; patch-based method; underwater image enhancement (UIE); QUALITY;
D O I
10.1109/TCYB.2024.3482174
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The enhancement of underwater images has emerged as a significant technological challenge in advancing marine research and exploration tasks. Due to the scattering of suspended particles and absorption of light in underwater environments, underwater images tend to present blurriness and predominantly color distortion. In this study, we propose a novel approach utilizing denoising diffusion models to improve underwater degraded images. After training the noise estimation network of the denoising diffusion models, we accelerate the deterministic sampling process with denoising diffusion implicit models. We also propose a patch-based method by implementing average sampling between overlapping image patches at each sampling step, enabling the generation of images at arbitrary resolution while preserving their natural appearance and details. Through benchmark experiments, we illustrate that our method outperforms or closely approaches state-of-the-art techniques in terms of effectiveness and performance. We demonstrate that our approach reduces the interference of underwater environments with the semantic information of the images by salient object detection experiments.
引用
收藏
页码:269 / 281
页数:13
相关论文
共 58 条
  • [1] A Revised Underwater Image Formation Model
    Akkaynak, Derya
    Treibitz, Tali
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6723 - 6732
  • [2] True Color Correction of Autonomous Underwater Vehicle Imagery
    Bryson, Mitch
    Johnson-Roberson, Matthew
    Pizarro, Oscar
    Williams, Stefan B.
    [J]. JOURNAL OF FIELD ROBOTICS, 2016, 33 (06) : 853 - 874
  • [3] Dynamic Target Tracking Control of Autonomous Underwater Vehicle Based on Trajectory Prediction
    Cao, Xiang
    Ren, Lu
    Sun, Changyin
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (03) : 1968 - 1981
  • [4] Neural Manifold Modulated Continual Reinforcement Learning for Musculoskeletal Robots
    Chen, Jiahao
    Chen, Ziyu
    Yao, Chaojing
    Qiao, Hong
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (01) : 86 - 99
  • [5] Muscle-Synergies-Based Neuromuscular Control for Motion Learning and Generalization of a Musculoskeletal System
    Chen, Jiahao
    Qiao, Hong
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (06): : 3993 - 4006
  • [6] Towards Real-Time Advancement of Underwater Visual Quality With GAN
    Chen, Xingyu
    Yu, Junzhi
    Kong, Shihan
    Wu, Zhengxing
    Fang, Xi
    Wen, Li
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (12) : 9350 - 9359
  • [7] ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
    Choi, Jooyoung
    Kim, Sungwon
    Jeong, Yonghyun
    Gwon, Youngjune
    Yoon, Sungroh
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14347 - 14356
  • [8] A Generalized Unsharp Masking Algorithm
    Deng, Guang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (05) : 1249 - 1261
  • [9] Dhariwal P, 2021, ADV NEUR IN, V34
  • [10] Transmission Estimation in Underwater Single Images
    Drews-, P., Jr.
    do Nascimento, E.
    Moraes, F.
    Botelho, S.
    Campos, M.
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, : 825 - 830