An Underwater Image Restoration Deep Learning Network Combining Attention Mechanism and Brightness Adjustment

被引:5
作者
Zheng, Jianhua [1 ,2 ]
Zhao, Ruolin [1 ,2 ]
Yang, Gaolin [2 ,3 ]
Liu, Shuangyin [1 ,2 ]
Zhang, Zihao [1 ,2 ]
Fu, Yusha [1 ,2 ]
Lu, Junde [1 ,2 ]
机构
[1] Zhongkai Univ Agr & Engn, Coll Informat Sci & Technol, Guangzhou 510225, Peoples R China
[2] Zhongkai Univ Agr & Engn, Guangzhou Key Lab Agr Prod Qual & Safety Traceabil, Guangzhou 510225, Peoples R China
[3] Commun Univ China, Sch Informat & Commun Engn, Beijing 100024, Peoples R China
基金
中国国家自然科学基金;
关键词
underwater image processing; underwater image restoration; image formation model; deep learning; attention mechanism; BACKGROUND LIGHT; COLOR CONSTANCY; ENHANCEMENT; PSNR;
D O I
10.3390/jmse12010007
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
This study proposes Combining Attention and Brightness Adjustment Network (CABA-Net), a deep learning network for underwater image restoration, to address the issues of underwater image color-cast, low brightness, and low contrast. The proposed approach achieves a multi-branch ambient light estimation by extracting the features of different levels of underwater images to achieve accurate estimates of the ambient light. Additionally, an encoder-decoder transmission map estimation module is designed to combine spatial attention structures that can extract the different layers of underwater images' spatial features to achieve accurate transmission map estimates. Then, the transmission map and precisely predicted ambient light were included in the underwater image formation model to achieve a preliminary restoration of underwater images. HSV brightness adjustment was conducted by combining the channel and spatial attention to the initial underwater image to complete the final underwater image restoration. Experimental results on the Underwater Image Enhancement Benchmark (UIEB) and Real-world Underwater Image Enhancement (RUIE) datasets show excellent performance of the proposed method in subjective comparisons and objective assessments. Furthermore, several ablation studies are conducted to understand the effect of each network component and prove the effectiveness of the suggested approach.
引用
收藏
页数:21
相关论文
共 55 条
[1]   Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset [J].
Berman, Dana ;
Levy, Deborah ;
Avidan, Shai ;
Treibitz, Tali .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) :2822-2837
[2]  
Cao KM, 2018, IEEE SW SYMP IMAG, P1, DOI 10.1109/SSIAI.2018.8470347
[3]  
Carlevaris-Bianco N., 2010, P OCEANS 2010 MTSIEE, P1
[4]   UNSUPERVISED AND UNTRAINED UNDERWATER IMAGE RESTORATION BASED ON PHYSICAL IMAGE FORMATION MODEL [J].
Chai, Shu ;
Fu, Zhenqi ;
Huang, Yue ;
Tu, Xiaotong ;
Ding, Xinghao .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :2774-2778
[5]  
[陈学磊 Chen Xuelei], 2022, [计算机工程, Computer Engineering], V48, P243
[6]   A novel underwater image restoration method based on decomposition network and physical imaging model [J].
Cui, Yanfang ;
Sun, Yujuan ;
Jian, Muwei ;
Zhang, Xiaofeng ;
Yao, Tao ;
Gao, Xin ;
Li, Yiru ;
Zhang, Yan .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (09) :5672-5690
[7]  
Dasari Siva Krishna, 2023, Proceedings of International Conference on Data Analytics and Insights, ICDAI 2023. Lecture Notes in Networks and Systems (727), P715, DOI 10.1007/978-981-99-3878-0_61
[8]   Deep Sea Image Enhancement Method Based on the Active Illumination [J].
Deng Xiang-yu ;
Wang Hui-gang ;
Zhang Yong-qing .
ACTA PHOTONICA SINICA, 2020, 49 (03)
[9]  
Dimitri G.M., 2021, bioRxiv, DOI [10.1101/2021.03.08.434427, DOI 10.1101/2021.03.08.434427]
[10]   Transmission Estimation in Underwater Single Images [J].
Drews-, P., Jr. ;
do Nascimento, E. ;
Moraes, F. ;
Botelho, S. ;
Campos, M. .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, :825-830