Unsupervised underwater image enhancement via content-style representation disentanglement

被引:14
作者
Zhu, Pengli [1 ,2 ]
Liu, Yancheng [1 ]
Wen, Yuanquan [1 ]
Xu, Minyi [1 ]
Fu, Xianping [3 ]
Liu, Siyuan [1 ]
机构
[1] Dalian Maritime Univ, Coll Marine Engn, Dalian, Peoples R China
[2] Natl Univ Singapore, Coll Design & Engn, Singapore, Singapore
[3] Dalian Maritime Univ, Coll Informat Sci & Technol, Dalian, Peoples R China
关键词
Underwater image enhancement; Representation disentanglement; Unsupervised learning; Cycle-consistent adversarial translation; NEURAL-NETWORK; TRANSLATION;
D O I
10.1016/j.engappai.2023.106866
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The absorption and scattering properties of the water medium cause various types of distortion in underwater images, which seriously affects the accuracy and effectiveness of subsequent processing. The application of supervised learning algorithms in underwater image enhancement is limited by the difficulty of obtaining a large number of underwater paired images in practical applications. As a solution, we propose an unsupervised representation disentanglement based underwater image enhancement method (URD-UIE). URD-UIE disentangles content information (e.g., texture, semantics) and style information (e.g., chromatic aberration, blur, noise, and clarity) from underwater images and then employs the disentangled information to generate the target distortion-free image. Our proposed method URD-UIE adopts an unsupervised cycle-consistent adversarial translation architecture and combines multiple loss functions to impose specific constraints on the output results of each module to ensure the structural consistency of underwater images before and after enhancement. The experimental results demonstrate that the URD-UIE technique effectively enhances the quality of underwater images when training with unpaired data, resulting in a significant improvement in the performance of the standard model for underwater object detection and semantic segmentation.
引用
收藏
页数:13
相关论文
共 76 条
  • [1] Anwar S, 2018, Arxiv, DOI arXiv:1807.03528
  • [2] Diving deeper into underwater image enhancement: A survey
    Anwar, Saeed
    Li, Chongyi
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 89
  • [3] Chen LC, 2017, Arxiv, DOI [arXiv:1706.05587, DOI 10.48550/ARXIV.1706.05587]
  • [4] Chen X, 2016, ADV NEUR IN, V29
  • [5] Domain Adaptation for Underwater Image Enhancement via Content and Style Separation
    Chen, Yu-Wei
    Pei, Soo-Chang
    [J]. IEEE ACCESS, 2022, 10 : 90523 - 90534
  • [6] Cheung Brian, 2014, arXiv
  • [7] Fabbri C, 2018, IEEE INT CONF ROBOT, P7159
  • [8] Ge Z, 2021, Arxiv, DOI [arXiv:2107.08430, DOI 10.48550/ARXIV.2107.08430, 10.48550/arXiv.2107.08430]
  • [9] Fast R-CNN
    Girshick, Ross
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1440 - 1448
  • [10] Glorot X., 2011, JMLR workshop and conference proceedings, P315, DOI DOI 10.1002/ECS2.1832