Deep Underwater Image Quality Assessment With Explicit Degradation Awareness Embedding

被引:2
作者
Jiang, Qiuping [1 ]
Gu, Yuese [1 ]
Wu, Zongwei [2 ]
Li, Chongyi [3 ]
Xiong, Huan [4 ]
Shao, Feng [1 ]
Wang, Zhihua [5 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
[2] Univ Wurzburg, Comp Vis Lab, D-97074 Wurzburg, Germany
[3] Nankai Univ, Sch Comp Sci, Tianjin 300071, Peoples R China
[4] Harbin Inst Technol, Inst Adv Study Math, Harbin 150006, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Degradation; Training; Gray-scale; Image quality; Electronic mail; Distortion; Decoding; Imaging; Image color analysis; Artificial neural networks; Image quality assessment; underwater image; degradation awareness; deep learning; GRADIENT MAGNITUDE; FUSION;
D O I
10.1109/TIP.2025.3539477
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater Image Quality Assessment (UIQA) is currently an area of intensive research interest. Existing deep learning-based UIQA models always learn a deep neural network to directly map the input degraded underwater image into a final quality score via end-to-end training. However, a wide variety of image contents or distortion types may correspond to the same quality score, making it challenging to train such a deep model merely with a single subjective quality score as supervision. An intuitive idea to solve this problem is to exploit more detailed degradation-aware information as supplementary guidance to facilitate model learning. In this paper, we devise a novel deep UIQA model with Explicit Degradation Awareness embedding, i.e., EDANet. To train the EDANet, a two-stage training strategy is adopted. First, a tailored Degradation Information Discovery subnetwork (DIDNet) is pre-trained to infer a residual map between the input degraded underwater image and its pseudoreference counterpart. The inferred residual map explicitly characterizes the local degradation of the input underwater image. The intermediate feature representations on the decoder side of DIDNet are then embedded into the Degradation-guided Quality Evaluation subnetwork (DQENet), which significantly enhances the feature characterization capability with higher degradation awareness for quality prediction. The superiority of our EDANet against 18 state-of-the-art methods has been well demonstrated by extensive comparisons on two benchmark datasets. The source code of our EDANet is available at https://github.com/yia-yuese/EDANet.
引用
收藏
页码:1297 / 1310
页数:14
相关论文
共 69 条
[1]   A Revised Underwater Image Formation Model [J].
Akkaynak, Derya ;
Treibitz, Tali .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6723-6732
[2]   What Is the Space of Attenuation Coefficients in Underwater Computer Vision? [J].
Akkaynak, Derya ;
Treibitz, Tali ;
Shlesinger, Tom ;
Tamir, Raz ;
Loya, Yossi ;
Iluz, David .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :568-577
[3]   Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset [J].
Berman, Dana ;
Levy, Deborah ;
Avidan, Shai ;
Treibitz, Tali .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) :2822-2837
[4]   Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment [J].
Bosse, Sebastian ;
Maniry, Dominique ;
Mueller, Klaus-Robert ;
Wiegand, Thomas ;
Samek, Wojciech .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :206-219
[5]  
Bousmalis K, 2016, ADV NEUR IN, V29
[6]   Semi-Reference Sonar Image Quality Assessment Based on Task and Visual Perception [J].
Chen, Weiling ;
Gu, Ke ;
Zhao, Tiesong ;
Jiang, Gangyi ;
Le Callet, Patrick .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :1008-1020
[7]   Reference-Free Quality Assessment of Sonar Images via Contour Degradation Measurement [J].
Chen, Weiling ;
Gu, Ke ;
Lin, Weisi ;
Xia, Zhifang ;
Le Callet, Patrick ;
Cheng, En .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) :5336-5351
[8]   Image Quality Assessment: Unifying Structure and Texture Similarity [J].
Ding, Keyan ;
Ma, Kede ;
Wang, Shiqi ;
Simoncelli, Eero P. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (05) :2567-2581
[9]   Automatic Red-Channel underwater image restoration [J].
Galdran, Adrian ;
Pardo, David ;
Picon, Artzai ;
Alvarez-Gila, Aitor .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 26 :132-145
[10]   Perceptual quality prediction on authentically distorted images using a bag of features approach [J].
Ghadiyaram, Deepti ;
Bovik, Alan C. .
JOURNAL OF VISION, 2017, 17 (01)