Deep Underwater Image Quality Assessment With Explicit Degradation Awareness Embedding

被引:2
作者
Jiang, Qiuping [1 ]
Gu, Yuese [1 ]
Wu, Zongwei [2 ]
Li, Chongyi [3 ]
Xiong, Huan [4 ]
Shao, Feng [1 ]
Wang, Zhihua [5 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
[2] Univ Wurzburg, Comp Vis Lab, D-97074 Wurzburg, Germany
[3] Nankai Univ, Sch Comp Sci, Tianjin 300071, Peoples R China
[4] Harbin Inst Technol, Inst Adv Study Math, Harbin 150006, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Degradation; Training; Gray-scale; Image quality; Electronic mail; Distortion; Decoding; Imaging; Image color analysis; Artificial neural networks; Image quality assessment; underwater image; degradation awareness; deep learning; GRADIENT MAGNITUDE; FUSION;
D O I
10.1109/TIP.2025.3539477
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater Image Quality Assessment (UIQA) is currently an area of intensive research interest. Existing deep learning-based UIQA models always learn a deep neural network to directly map the input degraded underwater image into a final quality score via end-to-end training. However, a wide variety of image contents or distortion types may correspond to the same quality score, making it challenging to train such a deep model merely with a single subjective quality score as supervision. An intuitive idea to solve this problem is to exploit more detailed degradation-aware information as supplementary guidance to facilitate model learning. In this paper, we devise a novel deep UIQA model with Explicit Degradation Awareness embedding, i.e., EDANet. To train the EDANet, a two-stage training strategy is adopted. First, a tailored Degradation Information Discovery subnetwork (DIDNet) is pre-trained to infer a residual map between the input degraded underwater image and its pseudoreference counterpart. The inferred residual map explicitly characterizes the local degradation of the input underwater image. The intermediate feature representations on the decoder side of DIDNet are then embedded into the Degradation-guided Quality Evaluation subnetwork (DQENet), which significantly enhances the feature characterization capability with higher degradation awareness for quality prediction. The superiority of our EDANet against 18 state-of-the-art methods has been well demonstrated by extensive comparisons on two benchmark datasets. The source code of our EDANet is available at https://github.com/yia-yuese/EDANet.
引用
收藏
页码:1297 / 1310
页数:14
相关论文
共 69 条
[11]   No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency [J].
Golestaneh, S. Alireza ;
Dadsetan, Saba ;
Kitani, Kris M. .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :3989-3999
[12]   Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data [J].
Gu, Ke ;
Tao, Dacheng ;
Qiao, Jun-Fei ;
Lin, Weisi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (04) :1301-1313
[13]   Using Free Energy Principle For Blind Image Quality Assessment [J].
Gu, Ke ;
Zhai, Guangtao ;
Yang, Xiaokang ;
Zhang, Wenjun .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (01) :50-63
[14]   Toward Convolutional Blind Denoising of Real Photographs [J].
Guo, Shi ;
Yan, Zifei ;
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1712-1722
[15]   Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network [J].
Guo, Yecai ;
Li, Hanyu ;
Zhuang, Peixian .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2020, 45 (03) :862-870
[16]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[17]   Optical turbulence on underwater image degradation in natural environments [J].
Hou, Weilin ;
Woods, Sarah ;
Jarosz, Ewa ;
Goode, Wesley ;
Weidemann, Alan .
APPLIED OPTICS, 2012, 51 (14) :2678-2686
[18]   Blind Image Quality Assessment via Deep Learning [J].
Hou, Weilong ;
Gao, Xinbo ;
Tao, Dacheng ;
Li, Xuelong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (06) :1275-1286
[19]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]
[20]   COMPUTER MODELING AND THE DESIGN OF OPTIMAL UNDERWATER IMAGING-SYSTEMS [J].
JAFFE, JS .
IEEE JOURNAL OF OCEANIC ENGINEERING, 1990, 15 (02) :101-111