Two-Branch Deep Neural Network for Underwater Image Enhancement in HSV Color Space

被引:52
作者
Hu, Junkang [1 ]
Jiang, Qiuping [1 ]
Cong, Runmin [2 ]
Gao, Wei [3 ]
Shao, Feng [1 ]
机构
[1] Ningbo Univ, Sch Informat Sci & Engn, Ningbo 315211, Peoples R China
[2] Beijing Jiaotong Univ, Inst Informat Sci, Sch Comp & Informat Technol, Beijing 100091, Peoples R China
[3] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Image color analysis; Degradation; Deep learning; Image enhancement; Training; Generators; Computer architecture; Underwater image; image enhancement; deep learning; convolutional neural network; MODEL;
D O I
10.1109/LSP.2021.3099746
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the influence of light absorption and scattering, underwater images usually suffer from quality deteriorations such as color cast and reduced contrast. The diverse quality degradations not only dissatisfy the user expectation but also lead to a significant performance drop in many underwater vision applications. This letter proposes a novel two-branch deep neural network for underwater image enhancement (UIE), which is capable of separately removing color cast and enhancing image contrast by fully leveraging useful properties of the HSV color space in disentangling chrominance and intensity. Specifically, the input underwater image is first converted into the HSV color space and disentangled into HS and V channels to serve as the input of the two branches, respectively. Then, the color cast removal branch enhances the H and S channels with a generative adversarial network architecture while the contrast enhancement branch enhances the V channel via a traditional convolutional neural network. The enhanced channels by the two branches are merged and converted back into RGB color space to obtain the final enhanced result. Experimental results demonstrate that, compared with state-of-the-art UIE methods, our method can produce much more visually pleasing enhanced results.
引用
收藏
页码:2152 / 2156
页数:5
相关论文
共 34 条
  • [1] Color Balance and Fusion for Underwater Image Enhancement
    Ancuti, Codruta O.
    Ancuti, Cosmin
    De Vleeschouwer, Christophe
    Bekaert, Philippe
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 379 - 393
  • [2] Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
  • [3] Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
    Cai, Jianrui
    Gu, Shuhang
    Zhang, Lei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) : 2049 - 2062
  • [4] Underwater Depth Estimation and Image Restoration Based on Single Images
    Drews, Paulo L. J., Jr.
    Nascimento, Erickson R.
    Botelho, Silvia S. C.
    Montenegro Campos, Mario Fernando
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) : 24 - 35
  • [5] Underwater image enhancement with global-local networks and compressed-histogram equalization
    Fu, Xueyang
    Cao, Xiangyong
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 86
  • [6] Fu XY, 2014, IEEE IMAGE PROC, P4572, DOI 10.1109/ICIP.2014.7025927
  • [7] Automatic Red-Channel underwater image restoration
    Galdran, Adrian
    Pardo, David
    Picon, Artzai
    Alvarez-Gila, Aitor
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 26 : 132 - 145
  • [8] Underwater image quality enhancement through integrated color model with Rayleigh distribution
    Ghani, Ahmad Shahrizan Abdul
    Isa, Nor Ashidi Mat
    [J]. APPLIED SOFT COMPUTING, 2015, 27 : 219 - 230
  • [9] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [10] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778