Knowledge-Guided Blind Image Quality Assessment With Few Training Samples

被引:8
|
作者
Song, Tianshu [1 ]
Li, Leida [2 ]
Wu, Jinjian [2 ]
Yang, Yuzhe [3 ]
Li, Yaqian [3 ]
Guo, Yandong [3 ]
Shi, Guangming [2 ]
机构
[1] China Univ Min & Technol, Sch Informat & Control Engn, Xuzhou 221116, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
[3] OPPO Res Inst, Shanghai 200032, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Distortion; Training; Measurement; Image quality; Predictive models; Knowledge representation; Image quality assessment; knowledge embedding; human visual system; natural scene statistics; generalization;
D O I
10.1109/TMM.2022.3233244
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Blind image quality assessment (BIQA) for in-the-wild images has achieved great progress by training advanced deep neural networks. However, the current BIQA models are suffering the generalization challenge, meaning that a well-trained BIQA model is still very limited in evaluating images with different distributions. Deep BIQA models are data-intensive, but the annotation of image quality labels is extremely expensive. To design a generalizable BIQA model with few training samples is highly desired. Motivated by the above fact, this paper presents a knowledge-guided BIQA (KG-IQA) framework by integrating domain knowledge from the human visual system (HVS) and natural scene statistics (NSS). Specifically, the quality-aware HVS and NSS features are first extracted as prior knowledge. Then, we embed the two types of knowledge into the conventional deep neural network by learning to predict the HVS and NSS features, producing the knowledge-enhanced quality features, based on which the final image quality score is obtained. We conduct extensive experiments and comparisons on five authentically distorted IQA datasets. The experimental results demonstrate that the introduction of knowledge greatly reduces the requirement on the amount of training images, and the proposed KG-IQA model achieves superior performance in terms of both prediction accuracy and generalization ability.
引用
收藏
页码:8145 / 8156
页数:12
相关论文
共 50 条
  • [1] Multitask Deep Neural Network With Knowledge-Guided Attention for Blind Image Quality Assessment
    Zhou, Tianwei
    Tan, Songbai
    Zhao, Baoquan
    Yue, Guanghui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7577 - 7588
  • [2] Blind Image Quality Assessment for Authentic Distortions by Intermediary Enhancement and Iterative Training
    Song, Tianshu
    Li, Leida
    Chen, Pengfei
    Liu, Hantao
    Qian, Jiansheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7592 - 7604
  • [3] Knowledge-Guided Semantic Transfer Network for Few-Shot Image Recognition
    Li, Zechao
    Tang, Hao
    Peng, Zhimao
    Qi, Guo-Jun
    Tang, Jinhui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15
  • [4] Blind Image Quality Assessment by Visual Neuron Matrix
    Chang, Hua-Wen
    Bi, Xiao-Dong
    Kai, Chen
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1803 - 1807
  • [5] Blind Image Quality Assessment via Adaptive Graph Attention
    Wang, Huasheng
    Liu, Jiang
    Tan, Hongchen
    Lou, Jianxun
    Liu, Xiaochang
    Zhou, Wei
    Liu, Hantao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 10299 - 10309
  • [6] Training Quality-Aware Filters for No-Reference Image Quality Assessment
    Zhang, Lin
    Gu, Zhongyi
    Liu, Xiaoxu
    Li, Hongyu
    Lu, Jianwei
    IEEE MULTIMEDIA, 2014, 21 (04) : 67 - 75
  • [7] Knowledge-Guided Multi-Label Few-Shot Learning for General Image Recognition
    Chen, Tianshui
    Lin, Liang
    Chen, Riquan
    Hui, Xiaolu
    Wu, Hefeng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) : 1371 - 1384
  • [8] Active Learning-Based Sample Selection for Label-Efficient Blind Image Quality Assessment
    Song, Tianshu
    Li, Leida
    Cheng, Deqiang
    Chen, Pengfei
    Wu, Jinjian
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5884 - 5896
  • [9] Blind Image Quality Assessment Based on Perceptual Comparison
    Li, Aobo
    Wu, Jinjian
    Liu, Yongxu
    Li, Leida
    Dong, Weisheng
    Shi, Guangming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 9671 - 9682
  • [10] Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Token
    Shi, Jinsong
    Gao, Pan
    Smolic, Aljosa
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4641 - 4651