Deep Underwater Image Quality Assessment With Explicit Degradation Awareness Embedding

被引:2
作者
Jiang, Qiuping [1 ]
Gu, Yuese [1 ]
Wu, Zongwei [2 ]
Li, Chongyi [3 ]
Xiong, Huan [4 ]
Shao, Feng [1 ]
Wang, Zhihua [5 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
[2] Univ Wurzburg, Comp Vis Lab, D-97074 Wurzburg, Germany
[3] Nankai Univ, Sch Comp Sci, Tianjin 300071, Peoples R China
[4] Harbin Inst Technol, Inst Adv Study Math, Harbin 150006, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Degradation; Training; Gray-scale; Image quality; Electronic mail; Distortion; Decoding; Imaging; Image color analysis; Artificial neural networks; Image quality assessment; underwater image; degradation awareness; deep learning; GRADIENT MAGNITUDE; FUSION;
D O I
10.1109/TIP.2025.3539477
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater Image Quality Assessment (UIQA) is currently an area of intensive research interest. Existing deep learning-based UIQA models always learn a deep neural network to directly map the input degraded underwater image into a final quality score via end-to-end training. However, a wide variety of image contents or distortion types may correspond to the same quality score, making it challenging to train such a deep model merely with a single subjective quality score as supervision. An intuitive idea to solve this problem is to exploit more detailed degradation-aware information as supplementary guidance to facilitate model learning. In this paper, we devise a novel deep UIQA model with Explicit Degradation Awareness embedding, i.e., EDANet. To train the EDANet, a two-stage training strategy is adopted. First, a tailored Degradation Information Discovery subnetwork (DIDNet) is pre-trained to infer a residual map between the input degraded underwater image and its pseudoreference counterpart. The inferred residual map explicitly characterizes the local degradation of the input underwater image. The intermediate feature representations on the decoder side of DIDNet are then embedded into the Degradation-guided Quality Evaluation subnetwork (DQENet), which significantly enhances the feature characterization capability with higher degradation awareness for quality prediction. The superiority of our EDANet against 18 state-of-the-art methods has been well demonstrated by extensive comparisons on two benchmark datasets. The source code of our EDANet is available at https://github.com/yia-yuese/EDANet.
引用
收藏
页码:1297 / 1310
页数:14
相关论文
共 69 条
[31]   An Underwater Image Enhancement Benchmark Dataset and Beyond [J].
Li, Chongyi ;
Guo, Chunle ;
Ren, Wenqi ;
Cong, Runmin ;
Hou, Junhui ;
Kwong, Sam ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4376-4389
[32]   MMMNet: An End-to-End Multi-Task Deep Convolution Neural Network With Multi-Scale and Multi-Hierarchy Fusion for Blind Image Quality Assessment [J].
Li, Fan ;
Zhang, Yangfan ;
Cosman, Pamela C. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) :4798-4811
[33]   Unsupervised Domain Adaptation in the Wild via Disentangling Representation Learning [J].
Li, Haoliang ;
Wan, Renjie ;
Wang, Shiqi ;
Kot, Alex C. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (02) :267-283
[34]   Blind Image Quality Assessment Using Statistical Structural and Luminance Features [J].
Li, Qiaohong ;
Lin, Weisi ;
Xu, Jingtao ;
Fang, Yuming .
IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (12) :2457-2469
[35]   Underwater Image Quality Assessment Based on Multiscale and Antagonistic Energy [J].
Li, Xinyue ;
Xu, Haiyong ;
Jiang, Gangyi ;
Yu, Mei ;
Chen, Yeyao ;
Luo, Ting ;
Ying, Hongwei .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 :1-14
[36]   RankIQA: Learning from Rankings for No-reference Image Quality Assessment [J].
Liu, Xialei ;
Van de Weijer, Joost ;
Bagdanov, Andrew D. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1040-1049
[37]   UIQI: A Comprehensive Quality Evaluation Index for Underwater Images [J].
Liu, Yutao ;
Gu, Ke ;
Cao, Jingchao ;
Wang, Shiqi ;
Zhai, Guangtao ;
Dong, Junyu ;
Kwong, Sam .
IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 :2560-2573
[38]   Applications of Geo-Referenced Underwater Photo Mosaics in Marine Biology and Archaeology [J].
Ludvigsen, Martin ;
Sortland, Bjorn ;
Johnsen, Geir ;
Singh, Hanumant .
OCEANOGRAPHY, 2007, 20 (04) :140-149
[39]  
McGlamery B. L., 1979, Proceedings of the Society of Photo-Optical Instrumentation Engineers, V208, P221
[40]   Blind Image Quality Estimation via Distortion Aggravation [J].
Min, Xiongkuo ;
Zhai, Guangtao ;
Gu, Ke ;
Liu, Yutao ;
Yang, Xiaokang .
IEEE TRANSACTIONS ON BROADCASTING, 2018, 64 (02) :508-517