SGUIE-Net: Semantic Attention Guided Underwater Image Enhancement With Multi-Scale Perception

被引:134
作者
Qi, Qi [1 ]
Li, Kunqian [2 ]
Zheng, Haiyong [3 ]
Gao, Xiang [2 ,4 ]
Hou, Guojia [5 ]
Sun, Kun [6 ]
机构
[1] Ocean Univ China, Fac Informat Sci & Engn, Qingdao 266100, Peoples R China
[2] Ocean Univ China, Coll Engn, Qingdao 266100, Peoples R China
[3] Ocean Univ China, Coll Elect Engn, Intelligent Informat Sensing & Proc Lab, Qingdao 266100, Peoples R China
[4] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
[5] Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
[6] China Univ Geosci, Sch Comp Sci, Wuhan 430078, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Image enhancement; Task analysis; Feature extraction; Training; Degradation; Visualization; Underwater image enhancement; deep learning; semantic guidance; attention mechanism; SUIM-E dataset;
D O I
10.1109/TIP.2022.3216208
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the wavelength-dependent light attenuation, refraction and scattering, underwater images usually suffer from color distortion and blurred details. However, due to the limited number of paired underwater images with undistorted images as reference, training deep enhancement models for diverse degradation types is quite difficult. To boost the performance of data-driven approaches, it is essential to establish more effective learning mechanisms that mine richer supervised information from limited training sample resources. In this paper, we propose a novel underwater image enhancement network, called SGUIE-Net, in which we introduce semantic information as high-level guidance via region-wise enhancement feature learning. Accordingly, we propose semantic region-wise enhancement module to better learn local enhancement features for semantic regions with multi-scale perception. After using them as complementary features and feeding them to the main branch, which extracts the global enhancement features on the original image scale, the fused features bring semantically consistent and visually superior enhancements. Extensive experiments on the publicly available datasets and our proposed dataset demonstrate the impressive performance of SGUIE-Net. The code and proposed dataset are available at https://trentqq.github.io/SGUIE-Net.html.
引用
收藏
页码:6816 / 6830
页数:15
相关论文
共 58 条
[1]   Color Balance and Fusion for Underwater Image Enhancement [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bekaert, Philippe .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :379-393
[2]  
Ancuti C, 2012, PROC CVPR IEEE, P81, DOI 10.1109/CVPR.2012.6247661
[3]   Diving deeper into underwater image enhancement: A survey [J].
Anwar, Saeed ;
Li, Chongyi .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 89
[4]  
Berman D., 2017, PROC BRIT MACHINE VI, V1, P2
[5]   Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset [J].
Berman, Dana ;
Levy, Deborah ;
Avidan, Shai ;
Treibitz, Tali .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) :2822-2837
[6]   Pre-Trained Image Processing Transformer [J].
Chen, Hanting ;
Wang, Yunhe ;
Guo, Tianyu ;
Xu, Chang ;
Deng, Yiping ;
Liu, Zhenhua ;
Ma, Siwei ;
Xu, Chunjing ;
Xu, Chao ;
Gao, Wen .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12294-12305
[7]  
Choy CB, 2016, ADV NEUR IN, V29
[8]   Underwater Depth Estimation and Image Restoration Based on Single Images [J].
Drews, Paulo L. J., Jr. ;
Nascimento, Erickson R. ;
Botelho, Silvia S. C. ;
Montenegro Campos, Mario Fernando .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2016, 36 (02) :24-35
[9]  
Fabbri C, 2018, IEEE INT CONF ROBOT, P7159
[10]   Automatic Red-Channel underwater image restoration [J].
Galdran, Adrian ;
Pardo, David ;
Picon, Artzai ;
Alvarez-Gila, Aitor .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 26 :132-145