Joint Luminance and Chrominance Learning for Underwater Image Enhancement

被引:36
作者
Xue, Xinwei [1 ,2 ]
Hao, Zhenhua [2 ,3 ]
Ma, Long [2 ,3 ]
Wang, Yi [1 ,2 ]
Liu, Risheng [1 ,2 ,4 ]
机构
[1] Dalian Univ Technol, DUT RU Int Sch Informat Sci, Dalian, Peoples R China
[2] Dalian Univ Technol, Engn & Key Lab Ubiquitous Network & Serv Software, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Sch Software Technol, Dalian, Peoples R China
[4] Peng Cheng Lab, Shenzhen 518052, Peoples R China
基金
中国国家自然科学基金;
关键词
Image color analysis; Training; Image reconstruction; Image enhancement; Atmospheric modeling; Scattering; Deep learning; Underwater image enhancement; physics-inspired; cross color-space; cross color-channel;
D O I
10.1109/LSP.2021.3072563
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, learning-based works have been widely-investigated to enhance underwater images. However, interactions between various degradation factors (e.g., color distortion and haze effects) inevitably cause negative interference during the inference phase. Thus, these works cannot fully remove degraded factors. To address this problem, we propose a novel Joint Luminance and Chrominance Learning Network (JLCL-Net). Concretely, we reformulate the task as luminance reconstruction (for haze removal), and chrominance correction (for color correction) sub-tasks by separating the luminance and chrominance (i.e., color appearance) of the underwater images. In this way, we successfully realize the disentanglement in degraded factors to avoid introducing interference. We specify the reconstruction by integrating the atmospheric scattering model, which endows the adaptive dehazing ability over different scenarios. The correction learns to compensate for color by a simple network to reverse the color attenuation process. To this end, we obtain our JLCL-Net. To better train it, we design a new multi-stage cross-space training strategy, which progressively updates the network parameters to enlarge the network potentiality. Extensive evaluations are presented to fully verify our superiority against other methods.
引用
收藏
页码:818 / 822
页数:5
相关论文
共 24 条
[1]  
Ancuti CO, 2011, LECT NOTES COMPUT SC, V6493, P501
[2]  
Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
[3]  
[Anonymous], 2009, P 2009 AUSTR C ROB A
[4]  
[Anonymous], 2007, Color constancy
[5]   Underwater Depth Estimation and Image Restoration Based on Single Images [J].
Drews, Paulo L. J., Jr. ;
Nascimento, Erickson R. ;
Botelho, Silvia S. C. ;
Montenegro Campos, Mario Fernando .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) :24-35
[6]  
Fabbri C, 2018, IEEE INT CONF ROBOT, P7159
[7]  
Fu XY, 2017, I S INTELL SIG PROC, P789, DOI 10.1109/ISPACS.2017.8266583
[8]   Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network [J].
Guo, Yecai ;
Li, Hanyu ;
Zhuang, Peixian .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2020, 45 (03) :862-870
[9]  
Harris S. E., 1986, OCEANS 86 Conference Record. Science-Engineering-Adventure (Cat. No.86CH2363-0), P6, DOI 10.1109/OCEANS.1986.1160528
[10]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353