HFM: A hybrid fusion method for underwater image enhancement

被引:45
作者
An, Shunmin [1 ]
Xu, Lihong [2 ]
Deng, Zhichao [1 ]
Zhang, Huapeng [3 ]
机构
[1] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai, Peoples R China
[2] Tongji Univ, Sch Elect & Informat Engn, Shanghai, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Automat, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Color correction; Contrast enhancement; Image fusion; Underwater imaging; Visibility recovery; RESTORATION; QUALITY; MODEL;
D O I
10.1016/j.engappai.2023.107219
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Different underwater images captured by different devices may exhibit varying degrees of nonlinear rendering, leading to white balance distortion. Meanwhile, wavelength attenuation and light scattering associated with distance can cause color shifts, reduced visibility, and decreased contrast in underwater images. This will result in difficult access to underwater information, which in turn will affect the application of advanced vision. Considering these degradation issues, we propose a hybrid fusion method for underwater image enhancement, called HFM. In terms of technical contributions, we introduce a color and white balance correction module that addresses color and white balance distortion in underwater images using the gray world principle and a nonlinear color mapping function. We design a visibility recovery module based on type-II fuzzy sets and a contrast enhancement module using curve transformation. Besides, inspired by image fusion methods, we propose an underwater image perception fusion module that focuses on two different tasks simultaneously, fusing underwater images of visibility and contrast. Therefore, the proposed method can effectively solve the problems of white balance distortion, color shift, low visibility and low contrast in underwater images, and achieves optimal results in application tests of geometric rotation estimation, feature point matching and edge detection. Through comparative experiments analyzed on four real scene datasets, the proposed method achieves superior results compared to 14 state-of-the-art underwater image enhancement methods. The code is publicly available at: https://github.com/An-Shunmin/HFM.
引用
收藏
页数:19
相关论文
共 52 条
[11]   Semantic attention and relative scene depth-guided network for underwater image enhancement [J].
Chen, Tingkai ;
Wang, Ning ;
Chen, Yanzheng ;
Kong, Xiangjun ;
Lin, Yejin ;
Zhao, Hong ;
Karimi, Hamid Reza .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
[12]   Towards Real-Time Advancement of Underwater Visual Quality With GAN [J].
Chen, Xingyu ;
Yu, Junzhi ;
Kong, Shihan ;
Wu, Zhengxing ;
Fang, Xi ;
Wen, Li .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (12) :9350-9359
[13]   Underwater Depth Estimation and Image Restoration Based on Single Images [J].
Drews, Paulo L. J., Jr. ;
Nascimento, Erickson R. ;
Botelho, Silvia S. C. ;
Montenegro Campos, Mario Fernando .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) :24-35
[14]   Direct linear and refraction-invariant pose estimation and calibration model for underwater imaging [J].
Elnashef, Bashar ;
Filin, Sagi .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 154 :259-271
[15]  
Fu ZQ, 2022, AAAI CONF ARTIF INTE, P643
[16]   Automatic Red-Channel underwater image restoration [J].
Galdran, Adrian ;
Pardo, David ;
Picon, Artzai ;
Alvarez-Gila, Aitor .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 26 :132-145
[17]   A novel dark channel prior guided variational framework for underwater image restoration [J].
Hou, Guojia ;
Li, Jingming ;
Wang, Guodong ;
Yang, Huan ;
Huang, Baoxiang ;
Pan, Zhenkuan .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 66
[18]   Hue preserving-based approach for underwater colour image enhancement [J].
Hou, Guojia ;
Pan, Zhenkuan ;
Huang, Baoxiang ;
Wang, Guodong ;
Luan, Xin .
IET IMAGE PROCESSING, 2018, 12 (02) :292-298
[19]   Shallow-Water Image Enhancement Using Relative Global Histogram Stretching Based on Adaptive Parameter Acquisition [J].
Huang, Dongmei ;
Wang, Yan ;
Song, Wei ;
Sequeira, Jean ;
Mavromatis, Sebastien .
MULTIMEDIA MODELING, MMM 2018, PT I, 2018, 10704 :453-465
[20]   Fast Underwater Image Enhancement for Improved Visual Perception [J].
Islam, Md Jahidul ;
Xia, Youya ;
Sattar, Junaed .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) :3227-3234