Two-step domain adaptation for underwater image enhancement

被引:102
作者
Jiang, Qun [1 ]
Zhang, Yunfeng [1 ]
Bao, Fangxun [2 ]
Zhao, Xiuyang [3 ]
Zhang, Caiming [4 ]
Liu, Peide [5 ]
机构
[1] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan 250014, Peoples R China
[2] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
[3] Univ Jinan, Shandong Prov Key Lab Network Based Intelligent C, Jinan 250000, Peoples R China
[4] Shandong Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[5] Shandong Univ Finance & Econ, Sch Management Sci & Engn, Jinan 250014, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater image enhancement; Transfer learning; Domain adaptation; Cycle-consistent adversarial network;
D O I
10.1016/j.patcog.2021.108324
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, underwater image enhancement methods based on deep learning have achieved remarkable results. Since the images obtained in complex underwater scenarios lack a ground truth, these algorithms mainly train models on underwater images synthesized from in-air images. Synthesized underwater images are different from real-world underwater images; this difference leads to the limited generalizability of the training model when enhancing real-world underwater images. In this work, we present an underwater image enhancement method that does not require training on synthetic underwater images and eliminates the dependence on underwater ground-truth images. Specifically, a novel domain adaptation framework for real-world underwater image enhancement inspired by transfer learning is presented; it transfers in-air image dehazing to real-world underwater image enhancement. The experimental results on different real-world underwater scenes indicate that the proposed method produces visually satisfactory results. (c) 2021 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license ( http://creativecommons.org/licenses/by-nc-nd/4.0/ )
引用
收藏
页数:14
相关论文
共 40 条
[1]   O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :867-875
[2]  
Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
[3]   Learning Semantic Segmentation from Synthetic Data: A Geometrically Guided Input-Output Adaptation Approach [J].
Chen, Yuhua ;
Li, Wen ;
Chen, Xiaoran ;
Van Gool, Luc .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1841-1850
[4]   Underwater Image Enhancement by Wavelength Compensation and Dehazing [J].
Chiang, John Y. ;
Chen, Ying-Ching .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (04) :1756-1769
[5]  
Chopra S.D.L.I.D, 2013, INT C MACH LEARN ICM
[6]  
Christophe D.V., ARXIV PREPRINT ARXIV
[7]   Underwater Depth Estimation and Image Restoration Based on Single Images [J].
Drews, Paulo L. J., Jr. ;
Nascimento, Erickson R. ;
Botelho, Silvia S. C. ;
Montenegro Campos, Mario Fernando .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) :24-35
[8]   Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing [J].
Engin, Deniz ;
Genc, Anil ;
Ekenel, Hazim Kemal .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :938-946
[9]  
Fabbri C, 2018, IEEE INT CONF ROBOT, P7159
[10]  
Fu XY, 2014, IEEE IMAGE PROC, P4572, DOI 10.1109/ICIP.2014.7025927