Unsupervised underwater image enhancement via content-style representation disentanglement

被引:14
作者
Zhu, Pengli [1 ,2 ]
Liu, Yancheng [1 ]
Wen, Yuanquan [1 ]
Xu, Minyi [1 ]
Fu, Xianping [3 ]
Liu, Siyuan [1 ]
机构
[1] Dalian Maritime Univ, Coll Marine Engn, Dalian, Peoples R China
[2] Natl Univ Singapore, Coll Design & Engn, Singapore, Singapore
[3] Dalian Maritime Univ, Coll Informat Sci & Technol, Dalian, Peoples R China
关键词
Underwater image enhancement; Representation disentanglement; Unsupervised learning; Cycle-consistent adversarial translation; NEURAL-NETWORK; TRANSLATION;
D O I
10.1016/j.engappai.2023.106866
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The absorption and scattering properties of the water medium cause various types of distortion in underwater images, which seriously affects the accuracy and effectiveness of subsequent processing. The application of supervised learning algorithms in underwater image enhancement is limited by the difficulty of obtaining a large number of underwater paired images in practical applications. As a solution, we propose an unsupervised representation disentanglement based underwater image enhancement method (URD-UIE). URD-UIE disentangles content information (e.g., texture, semantics) and style information (e.g., chromatic aberration, blur, noise, and clarity) from underwater images and then employs the disentangled information to generate the target distortion-free image. Our proposed method URD-UIE adopts an unsupervised cycle-consistent adversarial translation architecture and combines multiple loss functions to impose specific constraints on the output results of each module to ensure the structural consistency of underwater images before and after enhancement. The experimental results demonstrate that the URD-UIE technique effectively enhances the quality of underwater images when training with unpaired data, resulting in a significant improvement in the performance of the standard model for underwater object detection and semantic segmentation.
引用
收藏
页数:13
相关论文
共 76 条
  • [71] Underwater image restoration via backscatter pixel prior and color compensation
    Zhou, Jingchun
    Yang, Tongyu
    Chu, Weishen
    Zhang, Weishi
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 111
  • [72] Auto Color Correction of Underwater Images Utilizing Depth Information
    Zhou, Jingchun
    Zhang, Dehuan
    Ren, Wenqi
    Zhang, Weishi
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [73] Zhou XY, 2019, Arxiv, DOI [arXiv:1904.07850, DOI 10.48550/ARXIV.1904.07850]
  • [74] Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
    Zhu, Jun-Yan
    Park, Taesung
    Isola, Phillip
    Efros, Alexei A.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2242 - 2251
  • [75] Underwater Image Enhancement With Hyper-Laplacian Reflectance Priors
    Zhuang, Peixian
    Wu, Jiamin
    Porikli, Fatih
    Li, Chongyi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 5442 - 5455
  • [76] Bayesian retinex underwater image enhancement
    Zhuang, Peixian
    Li, Chongyi
    Wu, Jiamin
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 101