Multi-view underwater image enhancement method via embedded fusion mechanism

被引:129
作者
Zhou, Jingchun [1 ]
Sun, Jiaming [1 ]
Zhang, Weishi [1 ]
Lin, Zifan [2 ]
机构
[1] Dalian Maritime Univ DMU, Coll Informat Sci & Technol, Dalian 116026, Peoples R China
[2] Univ Western Australia UWA, Dept Elect & Elect Engn, Crawley, WA 6009, Australia
关键词
Underwater image; Multi-view input; Fusion mechanism; Deep learning;
D O I
10.1016/j.engappai.2023.105946
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to wavelength-dependent light absorption and scattering, underwater images often appear with a colour cast and blurry details. Most existing deep learning methods utilize a single input end-to-end network structure, which leads to a single form and content of the extracted features. To address these problems, we present a novel multi-feature underwater image enhancement method via embedded fusion mechanism (MFEF). We find that the quality of reconstruction results is affected by the quality of the input image to some extent, and use pre-processing to obtain high-quality images, which can improve the final reconstruction effect. We introduce the white balance (WB) algorithm and the contrast-limited adaptive histogram equalization (CLAHE) algorithm employing multiple path inputs to extract different forms of rich features in multiple views. To fully interact with features from multiple views, we design a multi-feature fusion (MFF) module to fuse derived image features. We suggest a novel pixel-weighted channel attention module (PCAM) that calibrates the detailed features of the degraded images using a weight matrix to give diverse weights to the encoded features. Ultimately, our network utilizes a fusion mechanism-based encoder and decoder that can be applied to restore various underwater scenes. In the UIEB dataset, our PSNR increased by 10.2% compared to that of Ucolor. Extensive experimental results demonstrate that the MFEF method outperforms other state-of-the-art underwater image enhancement methods in various real-world datasets.
引用
收藏
页数:12
相关论文
共 43 条
[1]  
Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
[2]  
[Anonymous], OCEAN ENG, V4, P541
[3]  
[Anonymous], INT J COMPUT VISION, V60, P91
[4]  
Chen R., 2022, IEEE T GEOSCI ELECT, V60, P1
[5]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[6]   Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network [J].
Guo, Yecai ;
Li, Hanyu ;
Zhuang, Peixian .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2020, 45 (03) :862-870
[7]  
Islam M., 2022, C ROB SCI SYST RSS N, P1
[8]   Fast Underwater Image Enhancement for Improved Visual Perception [J].
Islam, Md Jahidul ;
Xia, Youya ;
Sattar, Junaed .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) :3227-3234
[9]   Underwater Image Enhancement Quality Evaluation: Benchmark Dataset and Objective Metric [J].
Jiang, Qiuping ;
Gu, Yuese ;
Li, Chongyi ;
Cong, Runmin ;
Shao, Feng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) :5959-5974
[10]   Target Oriented Perceptual Adversarial Fusion Network for Underwater Image Enhancement [J].
Jiang, Zhiying ;
Li, Zhuoxiao ;
Yang, Shuzhou ;
Fan, Xin ;
Liu, Risheng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) :6584-6598