TCRN: A Two-Step Underwater Image Enhancement Network Based on Triple-Color Space Feature Reconstruction

被引:4
作者
Lin, Sen [1 ]
Zhang, Ruihang [1 ]
Ning, Zemeng [1 ]
Luo, Jie [1 ]
机构
[1] Shenyang Ligong Univ, Sch Automation & Elect Engn, Shenyang 110159, Peoples R China
关键词
underwater image enhancement; visual color correction; feature reconstruction; deep learning; QUALITY ASSESSMENT; MODEL; SYSTEM;
D O I
10.3390/jmse11061221
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
The underwater images acquired by marine detectors inevitably suffer from quality degradation due to color distortion and the haze effect. Traditional methods are ineffective in removing haze, resulting in the residual haze being intensified during color correction and contrast enhancement operations. Recently, deep-learning-based approaches have achieved greatly improved performance. However, most existing networks focus on the characteristics of the RGB color space, while ignoring factors such as saturation and hue, which are more important to the human visual system. Considering the above research, we propose a two-step triple-color space feature fusion and reconstruction network (TCRN) for underwater image enhancement. Briefly, in the first step, we extract LAB, HSV, and RGB feature maps of the image via a parallel U-net-like network and introduce a dense pixel attention module (DPM) to filter the haze noise of the feature maps. In the second step, we first propose the utilization of fully connected layers to enhance the long-term dependence between high-dimensional features of different color spaces; then, a group structure is used to reconstruct specific spacial features. When applied to the UFO dataset, our method improved PSNR by 0.21% and SSIM by 0.1%, compared with the second-best method. Numerous experiments have shown that our TCRN brings competitive results compared with state-of-the-art methods in both qualitative and quantitative analyses.
引用
收藏
页数:17
相关论文
共 45 条
[1]  
Akkaynak D., 2017, P IEEE C COMP VIS PA, P4931
[2]   Color Balance and Fusion for Underwater Image Enhancement [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bekaert, Philippe .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :379-393
[3]   Structural similarity index (SSIM) revisited: A data-driven approach [J].
Bakurov, Illya ;
Buzzelli, Marco ;
Schettini, Raimondo ;
Castelli, Mauro ;
Vanneschi, Leonardo .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 189
[4]   A SPATIAL PROCESSOR MODEL FOR OBJECT COLOR-PERCEPTION [J].
BUCHSBAUM, G .
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 1980, 310 (01) :1-26
[5]   Domain Adaptation for Underwater Image Enhancement via Content and Style Separation [J].
Chen, Yu-Wei ;
Pei, Soo-Chang .
IEEE ACCESS, 2022, 10 :90523-90534
[6]   Transmission Estimation in Underwater Single Images [J].
Drews-, P., Jr. ;
do Nascimento, E. ;
Moraes, F. ;
Botelho, S. ;
Campos, M. .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, :825-830
[7]   Underwater Depth Estimation and Image Restoration Based on Single Images [J].
Drews, Paulo L. J., Jr. ;
Nascimento, Erickson R. ;
Botelho, Silvia S. C. ;
Montenegro Campos, Mario Fernando .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) :24-35
[8]   Automatic system for improving underwater image contrast and color through recursive adaptive histogram modification [J].
Ghani, Ahmad Shahrizan Abdul ;
Isa, Nor Ashidi Mat .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2017, 141 :181-195
[9]   Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data [J].
Gu, Ke ;
Tao, Dacheng ;
Qiao, Jun-Fei ;
Lin, Weisi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (04) :1301-1313
[10]   No-reference blur assessment based on edge modeling [J].
Guan, Jingwei ;
Zhang, Wei ;
Gu, Jason ;
Ren, Hongliang .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 29 :1-7