A Lightweight Multi-Branch Context Network for Unsupervised Underwater Image Restoration

被引:0
|
作者
Wang, Rong [1 ]
Zhang, Yonghui [1 ]
Zhang, Yulu [1 ]
机构
[1] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
关键词
lightweight; unsupervised learning; underwater image restoration; deep learning; ENHANCEMENT; MODEL;
D O I
10.3390/w16050626
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Underwater images commonly experience degradation caused by light absorption and scattering in water. Developing lightweight and efficient neural networks to restore degraded images is challenging because of the difficulty in obtaining high-quality paired images and the delicate trade-off between model performance and computational demands. To provide a lightweight and efficient solution for restoring images in terms of color, structure, texture details, etc., enabling the underwater image restoration task to be applied in real-world scenes, we propose an unsupervised lightweight multi-branch context network. Specifically, we design two lightweight multi-branch context subnetworks that enable multiple receptive field feature extraction and long-range dependency modeling to estimate scene radiance and transmission maps. Gaussian blur is adopted to approximate the global background light on the twice-downsampled degraded image. We design a comprehensive loss function that incorporates multiple components, including self-supervised consistency loss and reconstruction loss, to train the network using degraded images in an unsupervised learning manner. Experiments on several underwater image datasets demonstrate that our approach realizes good performance with very few model parameters (0.12 M), and is even comparable to state-of-the-art methods (up to 149 M) in color correction and contrast restoration.
引用
收藏
页数:17
相关论文
共 50 条
  • [11] Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation
    Jiang, Yun
    Liu, Wenhuan
    Wu, Chao
    Yao, Huixiao
    SYMMETRY-BASEL, 2021, 13 (03): : 1 - 25
  • [12] HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration
    Yan, Shuaizheng
    Chen, Xingyu
    Wu, Zhengxing
    Tan, Min
    Yu, Junzhi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 5004 - 5016
  • [13] Research on mechanical property prediction of hot rolled steel based on lightweight multi-branch convolutional neural network
    Zhang, Qiwen
    Wang, Yichao
    MATERIALS TODAY COMMUNICATIONS, 2023, 37
  • [14] Lightweight image super-resolution via multi-branch aware CNN and efficient transformer
    Xiang Gao
    Sining Wu
    Ying Zhou
    Xinrong Wu
    Fan Wang
    Xiaopeng Hu
    Neural Computing and Applications, 2024, 36 : 5285 - 5303
  • [15] Residual multi-branch distillation network for efficient image super-resolution
    Gao, Xiang
    Zhou, Ying
    Wu, Sining
    Wu, Xinrong
    Wang, Fan
    Hu, Xiaopeng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (30) : 75217 - 75241
  • [16] Lightweight image super-resolution via multi-branch aware CNN and efficient transformer
    Gao, Xiang
    Wu, Sining
    Zhou, Ying
    Wu, Xinrong
    Wang, Fan
    Hu, Xiaopeng
    NEURAL COMPUTING & APPLICATIONS, 2023, 36 (10) : 5285 - 5303
  • [17] Multi-scale adversarial network for underwater image restoration
    Lu, Jingyu
    Li, Na
    Zhang, Shaoyong
    Yu, Zhibin
    Zheng, Haiyong
    Zheng, Bing
    OPTICS AND LASER TECHNOLOGY, 2019, 110 : 105 - 113
  • [18] Multi-scale convolution underwater image restoration network
    Zhijie Tang
    Jianda Li
    Jingke Huang
    Zhanhua Wang
    Zhihang Luo
    Machine Vision and Applications, 2022, 33
  • [19] A Lightweight Residual Network for Unsupervised Deformable Image Registration
    Siyal, Ahsan Raza
    Grams, Astrid Ellen
    Haltmeier, Markus
    IEEE ACCESS, 2024, 12 : 186872 - 186882
  • [20] A hybrid attention network with convolutional neural network and transformer for underwater image restoration
    Jiao, Zhan
    Wang, Ruizi
    Zhang, Xiangyi
    Fu, Bo
    Thanh, Dang Ngoc Hoang
    PEERJ COMPUTER SCIENCE, 2023, 9