Underwater image restoration based on dual information modulation network

被引:7
|
作者
Wang, Li [1 ]
Li, Xing [2 ,3 ]
Li, Ke [4 ]
Mu, Yang [4 ]
Zhang, Min [5 ]
Yue, Zhaoxin [1 ]
机构
[1] Nanjing Vocat Univ Ind Technol, Sch Comp & Software, Nanjing 210023, Peoples R China
[2] Nanjing Forestry Univ, Coll informat Sci & Technol, Nanjing 210037, Peoples R China
[3] Nanjing Forestry Univ, Coll Artificial Intelligence, Nanjing 210037, Peoples R China
[4] Nanchang Inst Technol, Sch Mech & Elect Engn, Nanchang 330000, Peoples R China
[5] Gannan Univ Sci & Technol, Dept Informat Engn, Ganzhou 341000, Peoples R China
关键词
SUPERRESOLUTION; ENHANCEMENT;
D O I
10.1038/s41598-024-55990-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The presence of light absorption and scattering in underwater conditions results in underwater images with missing details, low contrast, and color bias. The current deep learning-based methods bring unlimited potential for underwater image restoration (UIR) tasks. These methods, however, do not adequately take into account the inconsistency of the attenuation of different color channels and spatial regions when performing image restoration. To solve these gaps, we propose a dual information modulation network (DIMN) for accurate UIR tasks. To be specific, we design a multi-information enhancement module (MIEM), empowered by spatial-aware attention block (SAAB) and multi-scale structural Transformer block (MSTB), to guide the inductive bias of image degradation processes under nonhomogeneous media distributions. SAAB focuses on different spatial locations, capturing more spatial-aware cues to correct color deviations and recover details. MSTB utilizes the difference and complementarity between features at different scales to effectively complement the network's structural and global perceptual capabilities, enhancing image sharpness and contrast further. Experimental results reveal that the proposed DIMN exceeds most state-of-the-art UIR methods. Our code and results are available at: https://github.com/wwaannggllii/DIMN.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Frequency Domain Based Learning with Transformer for Underwater Image Restoration
    Wang, Danxu
    Sun, Zhonglin
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2022, 13629 : 218 - 232
  • [32] Underwater image restoration based on diffraction bounded optimization algorithm with dark channel prior
    Mathias, Ajisha
    Samiappan, Dhanalakshmi
    OPTIK, 2019, 192
  • [33] RGB-Based Triple-Dual-Path Recurrent Network for Underwater Image Dehazing
    Alenezi, Fayadh
    ELECTRONICS, 2022, 11 (18)
  • [34] Attenuation Coefficient Guided Two-Stage Network for Underwater Image Restoration
    Lin, Yufei
    Shen, Liquan
    Wang, Zhengyong
    Wang, Kun
    Zhang, Xi
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 199 - 203
  • [35] A Lightweight Multi-Branch Context Network for Unsupervised Underwater Image Restoration
    Wang, Rong
    Zhang, Yonghui
    Zhang, Yulu
    WATER, 2024, 16 (05)
  • [36] Review of underwater image restoration algorithms
    Raihan, Jarina A.
    Abas, Pg Emeroylariffion
    De Silva, Liyanage C.
    IET IMAGE PROCESSING, 2019, 13 (10) : 1587 - 1596
  • [37] Underwater Image Processing System for Image Enhancement and Restoration
    Cai, Chengyi
    Zhang, Yiheng
    Liu, Ting
    2019 IEEE 11TH INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN 2019), 2019, : 381 - 387
  • [38] An Underwater Image Restoration Method Based on Adaptive Brightness Improvement and Local Image Descattering
    Liang, Zheng
    Ruan, Rui
    Jiao, Lin
    Zhang, Weidong
    Zhuang, Peixian
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [39] Underwater image restoration via depth map and illumination estimation based on a single image
    Zhou, Jingchun
    Yang, Tongyu
    Ren, Wenqi
    Zhang, Dan
    Zhang, Weishi
    OPTICS EXPRESS, 2021, 29 (19) : 29864 - 29886
  • [40] Depthanything and SAM for UIE: exploring large model information contributes to underwater image restoration
    Shao, Jinxin
    Zhang, Haosu
    Miao, Jianming
    MACHINE VISION AND APPLICATIONS, 2025, 36 (02)