Underwater image enhancement using joint texture perception and color histogram features

被引:1
作者
Yuan, Guoming [1 ]
Liu, Haijun [1 ]
Li, Xiaoli [1 ]
Zhang, Ruilei [1 ]
Shan, Weifeng [1 ]
机构
[1] Department of emergency management, Institute of Disaster Prevention, Sanhe
来源
Guangxue Jingmi Gongcheng/Optics and Precision Engineering | 2024年 / 32卷 / 13期
关键词
convolutional neural network(CNN); deep learning; image enhancement; multi-head attention mechanism; texture perception;
D O I
10.37188/OPE.20243213.2112
中图分类号
学科分类号
摘要
While deep learning methods show promising visual results, current end-to-end networks often lack tailored architectures to address common issues like color distortion and texture blurriness. To improve their effectiveness, we propose an underwater image enhancement network that utilizes joint texture perception and color histogram features. The network comprises a texture-aware module, a color histogram extraction module, and a color-texture fusion enhancement module. The texture-aware network incorporates a deformable transformer module, leveraging spatially aware deformable convolution to enhance multi-head attention and extract texture features. The color histogram extraction module harnesses histograms from real underwater images to compute the loss function. Subsequently, the color-texture fusion module merges the color and texture features, which are then processed by the enhancement network to produce the final results. This approach effectively preserves texture structures, corrects color distortions, and maintains information consistency. Extensive experiments demonstrate that our method surpasses existing underwater image enhancement algorithms, achieving a 10% increase in the UIQM metric and reducing processing time to just 0.051 s per image. Our model successfully meets the demands of underwater visual enhancement tasks. © 2024 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:2112 / 2127
页数:15
相关论文
共 12 条
[1]  
WANG H T, LIU Q SH, CHEN L, Et al., Improved CycleGAN network for underwater micro⁃ scopic image color correction[J], Opt. Precision Eng, 30, 12, pp. 1499-1508, (2022)
[2]  
DREWS P L J, NASCIMENTO E R, BOTELHO S S C,, Et al., Underwater depth estimation and image restoration based on single images[J], IEEE Computer Graphics and Applications, 36, 2, pp. 24-35, (2016)
[3]  
SONG W, WANG Y, HUANG D M,, Et al., Enhancement of underwater images with statistical model of background light and optimization of transmission map[J], IEEE Transactions on Broadcasting, 66, 1, pp. 153-169, (2020)
[4]  
LI X J, HOU G J, TAN L, Et al., A hybrid frame⁃work for underwater image enhancement[J], IEEE Access, 8, pp. 197448-197462, (2020)
[5]  
HU ZH Y,, CHEN Q, ZHU D Q., Underwater image enhancement based on color balance and multi-scale fusion[J], Opt. Precision Eng, 30, 17, pp. 2133-2146, (2022)
[6]  
ANWAR S, PORKLI F., Deep underwater image enhancement [J], (2018)
[7]  
LI C Y, GUO C L, REN W Q, Et al., An underwater image enhancement benchmark dataset and beyond[J], IEEE Transactions on Image Processing, (2019)
[8]  
WANG N, ZHOU Y B, HAN F, Et al., UW⁃ GAN:underwater GAN for real-world underwater color restoration and dehazing[J], (2019)
[9]  
MA Z Y, A wavelet-based dual-stream net⁃ work for underwater image enhancement [C], ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2769-2773, (2022)
[10]  
LIU S B, FAN H J,, LIN S,, Et al., Adaptive learning attention network for underwater image enhancement[J], IEEE Robotics and Automation Letters, 7, 2, pp. 5326-5333, (2022)