PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN With Dual-Discriminators

被引:81
作者
Cong, Runmin [1 ,2 ,3 ]
Yang, Wenyu [1 ,4 ]
Zhang, Wei [2 ,3 ]
Li, Chongyi [5 ]
Guo, Chun-Le [5 ]
Huang, Qingming [6 ,7 ,8 ]
Kwong, Sam [9 ,10 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[2] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[3] Minist Educ, Key Lab Machine Intelligence & Syst Control, Jinan 250061, Peoples R China
[4] Beijing Key Lab Adv Informat Sci & Network Technol, Beijing 100044, Peoples R China
[5] Nankai Univ, Coll Comp Sci, Tianjin, Peoples R China
[6] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 101408, Peoples R China
[7] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[8] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[9] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[10] City Univ Hong Kong, Shenzhen Res Inst, Shenzhen 518000, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater image enhancement; generative adversarial network; physical model; degradation quantization; COLOR CORRECTION; NETWORK;
D O I
10.1109/TIP.2023.3286263
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the light absorption and scattering induced by the water medium, underwater images usually suffer from some degradation problems, such as low contrast, color distortion, and blurring details, which aggravate the difficulty of downstream underwater understanding tasks. Therefore, how to obtain clear and visually pleasant images has become a common concern of people, and the task of underwater image enhancement (UIE) has also emerged as the times require. Among existing UIE methods, Generative Adversarial Networks (GANs) based methods perform well in visual aesthetics, while the physical model-based methods have better scene adaptability. Inheriting the advantages of the above two types of models, we propose a physical model-guided GAN model for UIE in this paper, referred to as PUGAN. The entire network is under the GAN architecture. On the one hand, we design a Parameters Estimation subnetwork (Par-subnet) to learn the parameters for physical model inversion, and use the generated color enhancement image as auxiliary information for the Two-Stream Interaction Enhancement sub-network (TSIE-subnet). Meanwhile, we design a Degradation Quantization (DQ) module in TSIE-subnet to quantize scene degradation, thereby achieving reinforcing enhancement of key regions. On the other hand, we design the Dual-Discriminators for the style-content adversarial constraint, promoting the authenticity and visual aesthetics of the results. Extensive experiments on three benchmark datasets demonstrate that our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics. The code and results can be found from the link of https://rmcong.github.io/proj_PUGAN.html.
引用
收藏
页码:4472 / 4485
页数:14
相关论文
共 52 条
  • [1] Color Balance and Fusion for Underwater Image Enhancement
    Ancuti, Codruta O.
    Ancuti, Cosmin
    De Vleeschouwer, Christophe
    Bekaert, Philippe
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 379 - 393
  • [2] Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
  • [3] MFFN: An Underwater Sensing Scene Image Enhancement Method Based on Multiscale Feature Fusion Network
    Chen, Renzhang
    Cai, Zhanchuan
    Cao, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Deep Photo Enhancer: Unpaired Learning for Image Enhancement from Photographs with GANs
    Chen, Yu-Sheng
    Wang, Yu-Ching
    Kao, Man-Hsin
    Chuang, Yung-Yu
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6306 - 6314
  • [5] Color Channel Compensation (3C): A Fundamental Pre-Processing Step for Image Enhancement
    Codruta, Ancuti O.
    Ancuti, Cosmin
    De Vleeschouwer, Christophe
    Sbert, Mateu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 2653 - 2665
  • [6] Underwater Depth Estimation and Image Restoration Based on Single Images
    Drews, Paulo L. J., Jr.
    Nascimento, Erickson R.
    Botelho, Silvia S. C.
    Montenegro Campos, Mario Fernando
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) : 24 - 35
  • [7] Automatic Red-Channel underwater image restoration
    Galdran, Adrian
    Pardo, David
    Picon, Artzai
    Alvarez-Gila, Aitor
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 26 : 132 - 145
  • [8] Underwater Image Enhancement Using Adaptive Retinal Mechanisms
    Gao, Shao-Bing
    Zhang, Ming
    Zhao, Qian
    Zhang, Xian-Shi
    Li, Yong-Jie
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5580 - 5595
  • [9] Underwater image quality enhancement through integrated color model with Rayleigh distribution
    Ghani, Ahmad Shahrizan Abdul
    Isa, Nor Ashidi Mat
    [J]. APPLIED SOFT COMPUTING, 2015, 27 : 219 - 230
  • [10] Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement
    Guo, Chunle
    Li, Chongyi
    Guo, Jichang
    Loy, Chen Change
    Hou, Junhui
    Kwong, Sam
    Cong, Runmin
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1777 - 1786