Multi-scale adversarial network for underwater image restoration

被引:114
|
作者
Lu, Jingyu [1 ]
Li, Na [1 ]
Zhang, Shaoyong [1 ]
Yu, Zhibin [1 ]
Zheng, Haiyong [1 ]
Zheng, Bing [1 ]
机构
[1] Ocean Univ China, 238 Songling Rd, Qingdao, Shandong, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Image processing; Generative adversarial network; Image restoration; ENHANCEMENT;
D O I
10.1016/j.optlastec.2018.05.048
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Underwater image restoration, which is the keystone to the underwater vision research, is still a challenging work. The key point of underwater image restoration work is how to remove the turbidity and the color distortion caused by the underwater environment. In this paper, we propose an underwater image restoration method based on transferring an underwater style image into a recovered style using Multi-Scale Cycle Generative Adversarial Network (MCycle GAN) System. We include a Structural Similarity Index Measure loss (SSIM loss), which can provide more flexibility to model the detail structural to improve the image restoration performance. We use dark channel prior (DCP) algorithm to get the transmission map of an image and design an adaptive SSIM loss to improve underwater image quality. We input this information into the network for multi-scale calculation on the images, which achieves the combination of DCP algorithm and Cycle-Consistent Adversarial Networks (CycleGAN). By compared the quantitative and qualitative with existing state-of-the-art approaches, our method shows a pleasing performance on the underwater image dataset. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:105 / 113
页数:9
相关论文
共 50 条
  • [41] Underwater image enhancement via extended multi-scale Retinex
    Zhang, Shu
    Wang, Ting
    Dong, Junyu
    Yu, Hui
    NEUROCOMPUTING, 2017, 245 : 1 - 9
  • [42] Image selective restoration using multi-scale variational decomposition
    Tang, Liming
    Fang, Zhuang
    Xiang, Changcheng
    Chen, Shiqiang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 40 : 638 - 655
  • [43] Deep Multi-Scale Transformer for Remote Sensing Image Restoration
    Li, Yanting
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 138 - 142
  • [44] A Multi-Scale Convolutional Hybrid Attention Residual Network for Enhancing Underwater Image and Identifying Underwater Multi-Scene Sea Cucumber
    Zhang, Lijun
    Ma, Zhe
    Zhou, Jixu
    Li, Kewei
    Li, Ming
    Wang, Hang
    Zhang, Qiang
    Wang, Chen
    Lu, Kunyuan
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (09): : 7397 - 7404
  • [45] Multi-input fusion adversarial network for underwater image enhancement
    Lin S.
    Liu S.
    Tang Y.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2020, 49 (05):
  • [46] AMMGAN: adaptive multi-scale modulation generative adversarial network for few-shot image generation
    Wenkuan Li
    Wenyi Xu
    Xubin Wu
    Qianshan Wang
    Qiang Lu
    Tianxia Song
    Haifang Li
    Applied Intelligence, 2023, 53 : 20979 - 20997
  • [47] Multi-scale information fusion generative adversarial network for real-world noisy image denoising
    Hu, Xuegang
    Zhao, Wei
    MACHINE VISION AND APPLICATIONS, 2024, 35 (04)
  • [48] Image Dehazing Algorithm Based on Multi-Scale Fusion and Adversarial Training
    Liu Yuhang
    Shuai, Wu
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (06)
  • [49] A generative adversarial network with multi-scale convolution and dilated convolution res-network for OCT retinal image despeckling
    Yu, Xiaojun
    Li, Mingshuai
    Ge, Chenkun
    Shum, Perry Ping
    Chen, Jinna
    Liu, Linbo
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 80
  • [50] Multi-scale Generative Adversarial Network for Automatic Sublingual Vein Segmentation
    Xiong, Qingyue
    Li, Xinlei
    Yang, Dawei
    Zhang, Wei
    Zhang, Ye
    Kong, Yajie
    Li, Fufeng
    Zhang, Wenqiang
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 851 - 856