Underwater image restoration based on dual information modulation network

被引:7
|
作者
Wang, Li [1 ]
Li, Xing [2 ,3 ]
Li, Ke [4 ]
Mu, Yang [4 ]
Zhang, Min [5 ]
Yue, Zhaoxin [1 ]
机构
[1] Nanjing Vocat Univ Ind Technol, Sch Comp & Software, Nanjing 210023, Peoples R China
[2] Nanjing Forestry Univ, Coll informat Sci & Technol, Nanjing 210037, Peoples R China
[3] Nanjing Forestry Univ, Coll Artificial Intelligence, Nanjing 210037, Peoples R China
[4] Nanchang Inst Technol, Sch Mech & Elect Engn, Nanchang 330000, Peoples R China
[5] Gannan Univ Sci & Technol, Dept Informat Engn, Ganzhou 341000, Peoples R China
关键词
SUPERRESOLUTION; ENHANCEMENT;
D O I
10.1038/s41598-024-55990-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The presence of light absorption and scattering in underwater conditions results in underwater images with missing details, low contrast, and color bias. The current deep learning-based methods bring unlimited potential for underwater image restoration (UIR) tasks. These methods, however, do not adequately take into account the inconsistency of the attenuation of different color channels and spatial regions when performing image restoration. To solve these gaps, we propose a dual information modulation network (DIMN) for accurate UIR tasks. To be specific, we design a multi-information enhancement module (MIEM), empowered by spatial-aware attention block (SAAB) and multi-scale structural Transformer block (MSTB), to guide the inductive bias of image degradation processes under nonhomogeneous media distributions. SAAB focuses on different spatial locations, capturing more spatial-aware cues to correct color deviations and recover details. MSTB utilizes the difference and complementarity between features at different scales to effectively complement the network's structural and global perceptual capabilities, enhancing image sharpness and contrast further. Experimental results reveal that the proposed DIMN exceeds most state-of-the-art UIR methods. Our code and results are available at: https://github.com/wwaannggllii/DIMN.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] An Imaging Information Estimation Network for Underwater Image Color Restoration
    Lu, Jianxiang
    Yuan, Fei
    Yang, Weidi
    Cheng, En
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2021, 46 (04) : 1228 - 1239
  • [2] Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration
    Sharma, Prasen
    Bisht, Ira
    Sur, Arijit
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (01)
  • [3] UNDERWATER IMAGE RESTORATION BASED ON MINIMUM INFORMATION LOSS PRINCIPLE AND OPTICAL PROPERTIES OF UNDERWATER IMAGING
    Li, Chongyi
    Guo, Jichang
    Chen, Shanji
    Tang, Yibin
    Pang, Yanwei
    Wang, Jian
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1993 - 1997
  • [4] Underwater Image Restoration Based on Adaptive Color Compensation and Dual Transmission Estimation
    Wang, Yingbo
    Cao, Jie
    Rizvi, Saad
    Hao, Qun
    Fang, Yami
    IEEE ACCESS, 2020, 8 : 207834 - 207843
  • [5] Underwater Image Restoration Based on A New Underwater Image Formation Model
    Zhang, Mohua
    Peng, Jianhua
    IEEE ACCESS, 2018, 6 : 58634 - 58644
  • [6] Underwater Image Restoration Based on Image Blurriness and Light
    Peng, Yan-Tsung
    Cosman, Pamela C.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) : 1579 - 1594
  • [7] Underwater image restoration based on progressive guidance
    Zhang, Jianghe
    Chen, Weiling
    Lin, Zuxin
    Wei, Hongan
    Zhao, Tiesong
    SIGNAL PROCESSING, 2024, 223
  • [8] Underwater motion scene image restoration based on an improved U-Net network
    Liu, Jianye
    Luo, Hu
    Tu, Dawei
    APPLIED OPTICS, 2024, 63 (01) : 228 - 238
  • [9] Multi-scale adversarial network for underwater image restoration
    Lu, Jingyu
    Li, Na
    Zhang, Shaoyong
    Yu, Zhibin
    Zheng, Haiyong
    Zheng, Bing
    OPTICS AND LASER TECHNOLOGY, 2019, 110 : 105 - 113
  • [10] Multi-scale convolution underwater image restoration network
    Tang, Zhijie
    Li, Jianda
    Huang, Jingke
    Wang, Zhanhua
    Luo, Zhihang
    MACHINE VISION AND APPLICATIONS, 2022, 33 (06)