Underwater image restoration based on dual information modulation network

被引:7
|
作者
Wang, Li [1 ]
Li, Xing [2 ,3 ]
Li, Ke [4 ]
Mu, Yang [4 ]
Zhang, Min [5 ]
Yue, Zhaoxin [1 ]
机构
[1] Nanjing Vocat Univ Ind Technol, Sch Comp & Software, Nanjing 210023, Peoples R China
[2] Nanjing Forestry Univ, Coll informat Sci & Technol, Nanjing 210037, Peoples R China
[3] Nanjing Forestry Univ, Coll Artificial Intelligence, Nanjing 210037, Peoples R China
[4] Nanchang Inst Technol, Sch Mech & Elect Engn, Nanchang 330000, Peoples R China
[5] Gannan Univ Sci & Technol, Dept Informat Engn, Ganzhou 341000, Peoples R China
关键词
SUPERRESOLUTION; ENHANCEMENT;
D O I
10.1038/s41598-024-55990-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The presence of light absorption and scattering in underwater conditions results in underwater images with missing details, low contrast, and color bias. The current deep learning-based methods bring unlimited potential for underwater image restoration (UIR) tasks. These methods, however, do not adequately take into account the inconsistency of the attenuation of different color channels and spatial regions when performing image restoration. To solve these gaps, we propose a dual information modulation network (DIMN) for accurate UIR tasks. To be specific, we design a multi-information enhancement module (MIEM), empowered by spatial-aware attention block (SAAB) and multi-scale structural Transformer block (MSTB), to guide the inductive bias of image degradation processes under nonhomogeneous media distributions. SAAB focuses on different spatial locations, capturing more spatial-aware cues to correct color deviations and recover details. MSTB utilizes the difference and complementarity between features at different scales to effectively complement the network's structural and global perceptual capabilities, enhancing image sharpness and contrast further. Experimental results reveal that the proposed DIMN exceeds most state-of-the-art UIR methods. Our code and results are available at: https://github.com/wwaannggllii/DIMN.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Underwater Image Super-Resolution via Dual-aware Integrated Network
    Shi, Aiye
    Ding, Haimin
    APPLIED SCIENCES-BASEL, 2023, 13 (24):
  • [22] Underwater Image Restoration Based on a Laplace Operator Prior Term
    Li Jingming
    Hou Guojia
    Pan Zhenkuan
    Liu Yuhai
    Zhao Xin
    Wang Guodong
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (16)
  • [23] Single Underwater Image Restoration Based on Adaptive Transmission Fusion
    Chang, Herng-Hua
    IEEE ACCESS, 2020, 8 (08): : 38650 - 38662
  • [24] Learning-Based Dark and Blurred Underwater Image Restoration
    Xu, Yifeng
    Wang, Huigang
    Cooper, Garth Douglas
    Rong, Shaowei
    Sun, Weitao
    COMPLEXITY, 2020, 2020
  • [25] Underwater Image Restoration Based on Total Variation and Color Balance
    Hao Yali
    Hou Guojia
    Li Yuemei
    Huang Baoxiang
    Pan Zhenkuan
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (16)
  • [26] UNSUPERVISED AND UNTRAINED UNDERWATER IMAGE RESTORATION BASED ON PHYSICAL IMAGE FORMATION MODEL
    Chai, Shu
    Fu, Zhenqi
    Huang, Yue
    Tu, Xiaotong
    Ding, Xinghao
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2774 - 2778
  • [27] Underwater image restoration based on secondary guided transmission map
    Zhou, Jingchun
    Liu, Zhenzhen
    Zhang, Weidong
    Zhang, Dehuan
    Zhang, Weishi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (05) : 7771 - 7788
  • [28] Single underwater image restoration based on descattering and color correction
    Ke, Ke
    Zhang, Chunmin
    Tang, Qian
    He, Yifan
    Yao, Baoli
    OPTIK, 2022, 259
  • [29] Underwater image restoration based on improved dark channel prior
    Wang, Yingbo
    Cao, Jie
    Tang, Mingyuan
    Li, Guoliang
    Hao, Qun
    Fang, Yami
    SEVENTH SYMPOSIUM ON NOVEL PHOTOELECTRONIC DETECTION TECHNOLOGY AND APPLICATIONS, 2021, 11763
  • [30] FloodNet: Underwater image restoration based on residual dense learning
    Gangisetty, Shankar
    Rai, Raghu Raj
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 104