Knowledge-Guided Blind Image Quality Assessment With Few Training Samples

被引:8
|
作者
Song, Tianshu [1 ]
Li, Leida [2 ]
Wu, Jinjian [2 ]
Yang, Yuzhe [3 ]
Li, Yaqian [3 ]
Guo, Yandong [3 ]
Shi, Guangming [2 ]
机构
[1] China Univ Min & Technol, Sch Informat & Control Engn, Xuzhou 221116, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
[3] OPPO Res Inst, Shanghai 200032, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Distortion; Training; Measurement; Image quality; Predictive models; Knowledge representation; Image quality assessment; knowledge embedding; human visual system; natural scene statistics; generalization;
D O I
10.1109/TMM.2022.3233244
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Blind image quality assessment (BIQA) for in-the-wild images has achieved great progress by training advanced deep neural networks. However, the current BIQA models are suffering the generalization challenge, meaning that a well-trained BIQA model is still very limited in evaluating images with different distributions. Deep BIQA models are data-intensive, but the annotation of image quality labels is extremely expensive. To design a generalizable BIQA model with few training samples is highly desired. Motivated by the above fact, this paper presents a knowledge-guided BIQA (KG-IQA) framework by integrating domain knowledge from the human visual system (HVS) and natural scene statistics (NSS). Specifically, the quality-aware HVS and NSS features are first extracted as prior knowledge. Then, we embed the two types of knowledge into the conventional deep neural network by learning to predict the HVS and NSS features, producing the knowledge-enhanced quality features, based on which the final image quality score is obtained. We conduct extensive experiments and comparisons on five authentically distorted IQA datasets. The experimental results demonstrate that the introduction of knowledge greatly reduces the requirement on the amount of training images, and the proposed KG-IQA model achieves superior performance in terms of both prediction accuracy and generalization ability.
引用
收藏
页码:8145 / 8156
页数:12
相关论文
共 50 条
  • [11] A Multiscale Approach to Deep Blind Image Quality Assessment
    Liu, Manni
    Huang, Jiabin
    Zeng, Delu
    Ding, Xinghao
    Paisley, John
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1656 - 1667
  • [12] Blind Image Quality Assessment for a Single Image From Text-to-Image Synthesis
    Yu, Wenxin
    Zhang, Xuewen
    Zhang, Yunye
    Zhang, Zhiqiang
    Zhou, Jinjia
    IEEE ACCESS, 2021, 9 : 94656 - 94667
  • [13] Visual Interaction Perceptual Network for Blind Image Quality Assessment
    Wang, Xiaoqi
    Xiong, Jian
    Lin, Weisi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8958 - 8971
  • [14] Blind Image Quality Assessment With Active Inference
    Ma, Jupo
    Wu, Jinjian
    Li, Leida
    Dong, Weisheng
    Xie, Xuemei
    Shi, Guangming
    Lin, Weisi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3650 - 3663
  • [15] LIQA: Lifelong Blind Image Quality Assessment
    Liu, Jianzhao
    Zhou, Wei
    Li, Xin
    Xu, Jiahua
    Chen, Zhibo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5358 - 5373
  • [16] Cross-Domain Feature Similarity Guided Blind Image Quality Assessment
    Feng, Chenxi
    Ye, Long
    Zhang, Qin
    FRONTIERS IN NEUROSCIENCE, 2022, 15
  • [17] Prior Knowledge-Guided Transformer for Remote Sensing Image Captioning
    Meng, Lingwu
    Wang, Jing
    Yang, Yang
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 13
  • [18] Category Knowledge-Guided Parameter Calibration for Few-Shot Object Detection
    Chen, Chaofan
    Yang, Xiaoshan
    Zhang, Jinpeng
    Dong, Bo
    Xu, Changsheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1092 - 1107
  • [19] Blind Image Quality Assessment Based on Multi-scale KLT
    Yang, Chao
    Zhang, Xinfeng
    An, Ping
    Shen, Liquan
    Kuo, C. -C. Jay
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1557 - 1566
  • [20] Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild
    Zhang, Weixia
    Ma, Kede
    Zhai, Guangtao
    Yang, Xiaokang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3474 - 3486