Joint Iterative Color Correction and Dehazing for Underwater Image Enhancement

被引:35
|
作者
Wang, Kun [1 ]
Shen, Liquan [2 ]
Lin, Yufei [1 ]
Li, Mengyao [1 ]
Zhao, Qijie [3 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Joint Int Res Lab Specialty Fiber Opt & Adv Commu, Key Lab Specialty Fiber Opt & Opt Access Networks, Shanghai 200444, Peoples R China
[3] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Image color analysis; Feature extraction; Absorption; Attenuation; Scattering; Iterative methods; Image enhancement; Marine robotics; underwater image enhancement; deep learning in robotics; recurrent network; computer vision for automation;
D O I
10.1109/LRA.2021.3070253
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The captured underwater images suffer from color cast and haze effect caused by absorption and scattering. These interdependent phenomena jointly degrade images, resulting in failure of autonomous machines to recognize image contents. Most existing learning-based methods for underwater image enhancement (UIE) treat the degraded process as a whole and ignore the interaction between color correction and dehazing. Thus, they often obtain unnatural results. To this end, we propose a novel joint network to optimize the results of color correction and dehazing in multiple iterations. Firstly, a novel triplet-based color correction module is proposed to obtain color-balanced images with identical distribution of color channels. By means of inherent constraints of the triplet structure, the information of channel with less distortion is utilized to recover the information of other channels. Secondly, a recurrent dehazing module is designed to alleviate haze effect in images, where the Gated Recurrent Unit (GRU) as the memory module optimizes the results in multiple cycles to deal with severe underwater distortions. Finally, an iterative mechanism is proposed to jointly optimize the color correction and dehazing. By learning transform coefficients from dehazing features, color features and basic features of raw images are progressively refined, which maintains color balanced during the dehazing process and further improves clarity of images. Experimental results show that our network is superior to the existing state-of-the-art approaches for UIE and provides improved performance for underwater object detection.
引用
收藏
页码:5121 / 5128
页数:8
相关论文
共 50 条
  • [1] Underwater image enhancement by dehazing and color correction
    Li, Chongyi
    Guo, Jichang
    JOURNAL OF ELECTRONIC IMAGING, 2015, 24 (03)
  • [2] Underwater Image Enhancement based on Dehazing and Color Correction
    Li, Hanyu
    Zhuang, Peixian
    Wang, Wei
    Li, Jingjing
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1365 - 1370
  • [3] Underwater Image Enhancement by the Combination of Dehazing and Color Correction
    Zhang, Wenhao
    Li, Ge
    Ying, Zhenqiang
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT III, 2018, 11166 : 145 - 155
  • [4] An approach for underwater image enhancement based on color correction and dehazing
    Zhang, Yue
    Yang, Fuchun
    He, Weikai
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (05)
  • [5] Underwater image enhancement utilizing adaptive color correction and model conversion for dehazing
    Li, Yiming
    Li, Daoyu
    Gao, Zhijie
    Wang, Shuai
    Jiao, Qiang
    Bian, Liheng
    OPTICS AND LASER TECHNOLOGY, 2024, 169
  • [6] Underwater image enhancement using adaptive color restoration and dehazing
    Li, Tengyue
    Rong, Shenghui
    Zhao, Wenfeng
    Chen, Long
    Liu, Yongbin
    Zhou, Huiyu
    He, Bo
    OPTICS EXPRESS, 2022, 30 (04) : 6216 - 6235
  • [7] Fusion-based underwater image enhancement with category-specific color correction and dehazing
    Li, Yiming
    Zhu, Chunli
    Peng, Junxin
    Bian, Liheng
    OPTICS EXPRESS, 2022, 30 (19) : 33826 - 33841
  • [8] Single underwater image enhancement by attenuation map guided color correction and detail preserved dehazing
    Liang, Zheng
    Wang, Yafei
    Ding, Xueyan
    Mi, Zetian
    Fu, Xianping
    NEUROCOMPUTING, 2021, 425 : 160 - 172
  • [9] Locally Adaptive Color Correction for Underwater Image Dehazing and Matching
    Ancuti, Codruta O.
    Ancuti, Cosmin
    De Vleeschouwer, Christophe
    Garcia, Rafael
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 997 - 1005
  • [10] Underwater image restoration via adaptive color correction and dehazing
    Zhang, Jiening
    Yu, Qing
    Hou, Guojia
    APPLIED OPTICS, 2024, 63 (10) : 2728 - 2736