Multi-scale adversarial network for underwater image restoration

被引:114
|
作者
Lu, Jingyu [1 ]
Li, Na [1 ]
Zhang, Shaoyong [1 ]
Yu, Zhibin [1 ]
Zheng, Haiyong [1 ]
Zheng, Bing [1 ]
机构
[1] Ocean Univ China, 238 Songling Rd, Qingdao, Shandong, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Image processing; Generative adversarial network; Image restoration; ENHANCEMENT;
D O I
10.1016/j.optlastec.2018.05.048
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Underwater image restoration, which is the keystone to the underwater vision research, is still a challenging work. The key point of underwater image restoration work is how to remove the turbidity and the color distortion caused by the underwater environment. In this paper, we propose an underwater image restoration method based on transferring an underwater style image into a recovered style using Multi-Scale Cycle Generative Adversarial Network (MCycle GAN) System. We include a Structural Similarity Index Measure loss (SSIM loss), which can provide more flexibility to model the detail structural to improve the image restoration performance. We use dark channel prior (DCP) algorithm to get the transmission map of an image and design an adaptive SSIM loss to improve underwater image quality. We input this information into the network for multi-scale calculation on the images, which achieves the combination of DCP algorithm and Cycle-Consistent Adversarial Networks (CycleGAN). By compared the quantitative and qualitative with existing state-of-the-art approaches, our method shows a pleasing performance on the underwater image dataset. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:105 / 113
页数:9
相关论文
共 50 条
  • [31] Multi-scale conditional reconstruction generative adversarial network
    Chen, Yanming
    Xu, Jiahao
    An, Zhulin
    Zhuang, Fuzhen
    IMAGE AND VISION COMPUTING, 2024, 141
  • [32] Multi-Scale Patch-Based Image Restoration
    Papyan, Vardan
    Elad, Michael
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (01) : 249 - 261
  • [33] Underwater image restoration using physical models with generative adversarial network and unified transformer framework
    Zhang, Zhongmin
    Zhao, Haisheng
    Li, Zexu
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (06)
  • [34] Local to non-local: Multi-scale progressive attention network for image restoration
    Shen, Lili
    Zhao, Bo
    Li, Qunxia
    Zhang, Chuhe
    Sun, Xichun
    Peng, Bo
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 233
  • [35] ROAD SEGMENTATION OF UAV RS IMAGE USING ADVERSARIAL NETWORK WITH MULTI-SCALE CONTEXT AGGREGATION
    Peng, Bo
    Li, Yuxia
    He, Lei
    Fan, Kunlong
    Tong, Ling
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 6935 - 6938
  • [36] Single Fog Image Restoration via Multi-scale Image Fusion
    Gao, Yin
    Su, Yijing
    Li, Qiming
    Li, Jun
    PROCEEDINGS OF 2017 3RD IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2017, : 1873 - 1878
  • [37] TMS-GAN: A Twofold Multi-Scale Generative Adversarial Network for Single Image Dehazing
    Wang, Pengyu
    Zhu, Hongqing
    Huang, Hui
    Zhang, Han
    Wang, Nan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 2760 - 2772
  • [38] Multi-scale RGB and NIR image Cross-fusion based on Generative Adversarial Network
    Xiang, Sen
    Hu, Zishan
    Deng, Huiping
    Wu, Jin
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4172 - 4177
  • [39] Infrared Simulation Based on Cascade Multi-Scale Information Fusion Adversarial Network
    Jia Ruiming
    Li Tong
    Liu Shengjie
    Cui Jiali
    Yuan Fei
    ACTA OPTICA SINICA, 2020, 40 (18)
  • [40] An Unsupervised Multi-scale Generative Adversarial Network for Remote Sensing Image Pan-Sharpening
    Wang, Yajie
    Xie, Yanyan
    Wu, Yanyan
    Liang, Kai
    Qiao, Jilin
    MULTIMEDIA MODELING, MMM 2022, PT II, 2022, 13142 : 356 - 368