Domain Adaptation for Underwater Image Enhancement via Content and Style Separation

被引:29
作者
Chen, Yu-Wei [1 ]
Pei, Soo-Chang [2 ]
机构
[1] Natl Taiwan Univ, Grad Inst Commun Engn, Taipei 10617, Taiwan
[2] Natl Taiwan Univ, Dept Elect Engn, Taipei 10617, Taiwan
关键词
Image enhancement; Image color analysis; Generators; Transforms; Computational modeling; Adaptation models; Visualization; Underwater communication; Deep learning; Underwater image enhancement; domain adaptation; content style disentanglement; real-world underwater images; deep learning;
D O I
10.1109/ACCESS.2022.3201555
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Underwater image suffer from color cast, low contrast and hazy effect, which degraded the high-level vision application. Recent learning-based methods demonstrate astonishing performance on underwater image enhancement, however, most of these works use synthetic pair data for supervised learning and ignore the domain gap to real-world data. Although some work leverage transfer learning and domain adaptation to alleviate this problem, they target to minimize the latent discrepancy of synthesis and real-world data, and make the latent space hard to interpret and cannot manipulate. To solve this problem, we propose a domain adaptation framework for underwater image enhancement via content and style separation, we aim to separate encoded feature into content and style latent and distinguish style latent from different domains, and process domain adaptation and image enhancement in latent space. Our model provide a user interact interface to adjust different enhanced level for continuous change by latent manipulation. Experiment on various public real-world underwater benchmarks demonstrate that the proposed framework is capable to perform domain adaptation for underwater image enhancement and outperform various state-of-the-art underwater image enhancement algorithms in quantity and quality. The model and source code will be available at https://github.com/fordevoted/UIESS.
引用
收藏
页码:90523 / 90534
页数:12
相关论文
共 45 条
[1]   Sea-thru: A Method For Removing Water From Underwater Images [J].
Akkaynak, Derya ;
Treibitz, Tali .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1682-1691
[2]  
Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
[3]   Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset [J].
Berman, Dana ;
Levy, Deborah ;
Avidan, Shai ;
Treibitz, Tali .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) :2822-2837
[4]  
Bousmalis K, 2016, ADV NEUR IN, V29
[5]  
Boying Zhang, 2021, 2021 4th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), P452, DOI 10.1109/PRAI53619.2021.9551050
[6]   Underwater Depth Estimation and Image Restoration Based on Single Images [J].
Drews, Paulo L. J., Jr. ;
Nascimento, Erickson R. ;
Botelho, Silvia S. C. ;
Montenegro Campos, Mario Fernando .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) :24-35
[7]   Deep Underwater Image Restoration and Beyond [J].
Dudhane, Akshay ;
Hambarde, Praful ;
Patil, Prashant ;
Murala, Subrahmanyam .
IEEE SIGNAL PROCESSING LETTERS, 2020, 27 :675-679
[8]  
Eriklindernoren, 2019, PYTORCH GAN
[9]  
Fabbri C, 2018, IEEE INT CONF ROBOT, P7159
[10]   Underwater image enhancement with global-local networks and compressed-histogram equalization [J].
Fu, Xueyang ;
Cao, Xiangyong .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 86