共 50 条
Knowledge-Guided Blind Image Quality Assessment With Few Training Samples
被引:8
|作者:
Song, Tianshu
[1
]
Li, Leida
[2
]
Wu, Jinjian
[2
]
Yang, Yuzhe
[3
]
Li, Yaqian
[3
]
Guo, Yandong
[3
]
Shi, Guangming
[2
]
机构:
[1] China Univ Min & Technol, Sch Informat & Control Engn, Xuzhou 221116, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
[3] OPPO Res Inst, Shanghai 200032, Peoples R China
基金:
中国国家自然科学基金;
关键词:
Feature extraction;
Distortion;
Training;
Measurement;
Image quality;
Predictive models;
Knowledge representation;
Image quality assessment;
knowledge embedding;
human visual system;
natural scene statistics;
generalization;
D O I:
10.1109/TMM.2022.3233244
中图分类号:
TP [自动化技术、计算机技术];
学科分类号:
0812 ;
摘要:
Blind image quality assessment (BIQA) for in-the-wild images has achieved great progress by training advanced deep neural networks. However, the current BIQA models are suffering the generalization challenge, meaning that a well-trained BIQA model is still very limited in evaluating images with different distributions. Deep BIQA models are data-intensive, but the annotation of image quality labels is extremely expensive. To design a generalizable BIQA model with few training samples is highly desired. Motivated by the above fact, this paper presents a knowledge-guided BIQA (KG-IQA) framework by integrating domain knowledge from the human visual system (HVS) and natural scene statistics (NSS). Specifically, the quality-aware HVS and NSS features are first extracted as prior knowledge. Then, we embed the two types of knowledge into the conventional deep neural network by learning to predict the HVS and NSS features, producing the knowledge-enhanced quality features, based on which the final image quality score is obtained. We conduct extensive experiments and comparisons on five authentically distorted IQA datasets. The experimental results demonstrate that the introduction of knowledge greatly reduces the requirement on the amount of training images, and the proposed KG-IQA model achieves superior performance in terms of both prediction accuracy and generalization ability.
引用
收藏
页码:8145 / 8156
页数:12
相关论文