Knowledge-Guided Blind Image Quality Assessment With Few Training Samples

被引:8
作者
Song, Tianshu [1 ]
Li, Leida [2 ]
Wu, Jinjian [2 ]
Yang, Yuzhe [3 ]
Li, Yaqian [3 ]
Guo, Yandong [3 ]
Shi, Guangming [2 ]
机构
[1] China Univ Min & Technol, Sch Informat & Control Engn, Xuzhou 221116, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
[3] OPPO Res Inst, Shanghai 200032, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Distortion; Training; Measurement; Image quality; Predictive models; Knowledge representation; Image quality assessment; knowledge embedding; human visual system; natural scene statistics; generalization;
D O I
10.1109/TMM.2022.3233244
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Blind image quality assessment (BIQA) for in-the-wild images has achieved great progress by training advanced deep neural networks. However, the current BIQA models are suffering the generalization challenge, meaning that a well-trained BIQA model is still very limited in evaluating images with different distributions. Deep BIQA models are data-intensive, but the annotation of image quality labels is extremely expensive. To design a generalizable BIQA model with few training samples is highly desired. Motivated by the above fact, this paper presents a knowledge-guided BIQA (KG-IQA) framework by integrating domain knowledge from the human visual system (HVS) and natural scene statistics (NSS). Specifically, the quality-aware HVS and NSS features are first extracted as prior knowledge. Then, we embed the two types of knowledge into the conventional deep neural network by learning to predict the HVS and NSS features, producing the knowledge-enhanced quality features, based on which the final image quality score is obtained. We conduct extensive experiments and comparisons on five authentically distorted IQA datasets. The experimental results demonstrate that the introduction of knowledge greatly reduces the requirement on the amount of training images, and the proposed KG-IQA model achieves superior performance in terms of both prediction accuracy and generalization ability.
引用
收藏
页码:8145 / 8156
页数:12
相关论文
共 50 条
  • [21] Category Knowledge-Guided Parameter Calibration for Few-Shot Object Detection
    Chen, Chaofan
    Yang, Xiaoshan
    Zhang, Jinpeng
    Dong, Bo
    Xu, Changsheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1092 - 1107
  • [22] Deep Blind Chest X-Ray Image Quality Assessment With Region-of-Interest-Guided Attention
    Jin, Jianqiu
    Chen, Xiaoming
    Meng, Yu
    Gong, Xiangyang
    Yang, Bailin
    Chung, Yuk Ying
    [J]. IEEE MULTIMEDIA, 2023, 30 (04) : 36 - 46
  • [23] Blind Night-Time Image Quality Assessment: Subjective and Objective Approaches
    Xiang, Tao
    Yang, Ying
    Guo, Shangwei
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (05) : 1259 - 1272
  • [24] Multilevel Feature Fusion for End-to-End Blind Image Quality Assessment
    Lan, Xuting
    Zhou, Mingliang
    Xu, Xueyong
    Wei, Xuekai
    Liao, Xingran
    Pu, Huayan
    Luo, Jun
    Xiang, Tao
    Fang, Bin
    Shang, Zhaowei
    [J]. IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (03) : 801 - 811
  • [25] Learning a Unified Blind Image Quality Metric via On-Line and Off-Line Big Training Instances
    Gu, Ke
    Xu, Xin
    Qiao, Junfei
    Jiang, Qiuping
    Lin, Weisi
    Thalmann, Daniel
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2020, 6 (04) : 780 - 791
  • [26] FsPN: Blind Image Quality Assessment Based on Feature-Selected Pyramid Network
    Tang, Long
    Han, Yongming
    Yuan, Liang
    Zhai, Guangtao
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 1 - 5
  • [27] Utilizing Image Scales Towards Totally Training Free Blind Image Quality Assessment
    Saha, Ashirbani
    Wu, Qing Ming Jonathan
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (06) : 1879 - 1892
  • [28] Blind Image Quality Assessment Without Human Training Using Latent Quality Factors
    Mittal, Anish
    Muralidhar, Gautam S.
    Ghosh, Joydeep
    Bovik, Alan C.
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2012, 19 (02) : 75 - 78
  • [29] Blind Stereoscopic Image Quality Assessment Accounting for Human Monocular Visual Properties and Binocular Interactions
    Liu, Yun
    Yan, Weiqing
    Zheng, Zhi
    Huang, Baoqing
    Yu, Hongwei
    [J]. IEEE ACCESS, 2020, 8 : 33666 - 33678
  • [30] Viewport Perception Based Blind Stereoscopic Omnidirectional Image Quality Assessment
    Qi, Yubin
    Jiang, Gangyi
    Yu, Mei
    Zhang, Yun
    Ho, Yo-Sung
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (10) : 3926 - 3941