Underwater image enhancement synthesizing multi-scale information and attention mechanisms

被引:0
作者
Xia X. [1 ]
Zhong Y. [1 ]
Hu P. [1 ]
Yao Y. [1 ,2 ]
Geng J. [2 ]
Zhang L. [2 ]
机构
[1] Key Laboratory of Road Construction Technology and Equipment, Ministry of Education, Chang'an University, Xi'an
[2] Henan Wanli Transportation Technology Group Co. Ltd., Xuchang
来源
Guangxue Jingmi Gongcheng/Optics and Precision Engineering | 2024年 / 32卷 / 10期
关键词
attention mechanism; encoder; generative adversarial network; multi-scale hybrid convolution; underwater image enhancement;
D O I
10.37188/OPE.20243210.1582
中图分类号
学科分类号
摘要
Aiming at the problems of color distortion and detail loss in underwater images due to water scattering and absorption,a generative adversarial network model integrating multi-scale information and attention mechanism was proposed to enhance underwater images. Firstly,to fully exploit and enhance both local and global information of the image,local encoders and global encoders were employed to extract local and global features respectively,which were then fused to achieve complementarity. Next,a multi-scale hybrid convolution was designed to capture multi-scale information,increasing the network's adaptability to features at different scales. Subsequently,attention mechanisms were utilized to enhance the accuracy of feature extraction,emphasizing the focus on high-value features. Finally,by iteratively applying multi-scale hybrid convolution and attention mechanisms to refine features,the enhanced image was gradually up-sampled. Compared with the six classical and state-of-the-art methods,the proposed model not only achieved the best visual perception in subjective evaluations but also outperformed the six comparative methods on the entire test set in terms of four objective evaluation metrics peak signal-to-noise ratio (PSNR),structural similarity(SSIM),underwater image quality measurement(UIQM),and natural image quality evaluation(NIQE)with average scores of 22. 499,0. 789,2. 911,and 4. 175,respectively. The improvements over the best scores among the comparative methods are 0. 353,0. 002,0. 025,and 0. 307,respectively. These results indicate that the proposed model not only corrects image color distortion but also performs well in restoring image details,increasing image contrast,and enhancing clarity. Therefore,it shows promising prospects for practical applications in underwater image enhancement. © 2024 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:1582 / 1594
页数:12
相关论文
共 32 条
[1]  
GUO J C, LI C Y,, GUO C L,, Et al., Research progress of underwater image enhancement and restoration methods[J], Journal of Image and Graphics, 22, 3, pp. 273-287, (2017)
[2]  
YUAN G M,, YANG G,, WANG J F,, Et al., Coarse-to-fine underwater image enhancement based on multi-level wavelet transform[J], Opt. Precision Eng, 30, 22, pp. 2939-2951, (2022)
[3]  
LIN S, LIU X., Underwater image enhancement algorithm using gated fusion generative adversarial network[J], Journal of Graphics, 42, 6, pp. 948-956, (2021)
[4]  
WANG M J, LIU Y R,, Et al., Three-dimensional reconstruction and analysis of target laser point cloud data in simulated turbulent water environment[J], Opto-Electronic Engineering, 50, 6, (2023)
[5]  
Enhancement of low quality underwater image through integrated global and local contrast correction[J], Applied Soft Computing, 37, C, pp. 332-344, (2015)
[6]  
HU Z Y, CHEN Q, ZHU D Q., Underwater image enhancement based on color balance and multi-scale fusion[J], Opt. Precision Eng, 30, 17, pp. 2133-2146, (2022)
[7]  
ZHANG N N, LI Z W,, GUO X J,, Et al., Two-stage image restoration using improved atmospheric scattering model[J], Opt. Precision Eng, 30, 18, pp. 2267-2279, (2022)
[8]  
CONG R M, ZHANG Y M,, ZHANG C, Et al., Research progress of deep learning driven underwater image enhancement and restoration[J], Journal of Signal Processing, 36, 9, pp. 1377-1389, (2020)
[9]  
ISLAM M J, SATTAR J., Enhancing underwater imagery using generative adversarial networks[C], 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 7159-7165, (2018)
[10]  
ZHU J Y, ISOLA P,, Et al., Unpaired image-to-image translation using cycle-consistent adversarial networks[C], 2017 IEEE International Conference on Computer Vision(ICCV), pp. 2242-2251, (2017)