HDIQA: A Hyper Debiasing Framework for Full Reference Image Quality Assessment

被引:6
|
作者
Zhou, Mingliang [1 ]
Wang, Heqiang [1 ]
Wei, Xuekai [1 ]
Feng, Yong [1 ]
Luo, Jun [2 ]
Pu, Huayan [2 ]
Zhao, Jinglei [2 ]
Wang, Liming [2 ]
Chu, Zhigang [2 ]
Wang, Xin [2 ,3 ]
Fang, Bin [1 ]
Shang, Zhaowei [1 ]
机构
[1] Chongqing Univ, Sch Comp Sci, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Sch Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[3] Chongqing Changan Automobile Co Ltd, Prod Dept, Chongqing 400020, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image quality; Visualization; Tensors; Task analysis; Perturbation methods; Quality assessment; Image quality assessment; deep feature; hypernetwork; Tucker decomposition; SIMILARITY; VISIBILITY;
D O I
10.1109/TBC.2024.3353573
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent methods that project images into deep feature spaces to evaluate quality degradation have produced inefficient results due to biased mappings; i.e., these projections are not aligned with the perceptions of humans. In this paper, we develop a hyperdebiasing framework to address such bias in full-reference image quality assessment. First, we perform orthogonal Tucker decomposition on the top of feature tensors extracted by a feature extraction network to project features into a robust content-agnostic space and effectively eliminate the bias caused by subtle image perturbations. Second, we propose a hypernetwork in which the content-aware parameters are produced for reprojecting features in a deep subspace for quality prediction. By leveraging the content diversity of large-scale blind-reference datasets, the perception rule between image content and image quality is established. Third, a quality prediction network is proposed by combining debiased content-aware and content-agnostic features to predict the final image quality score. To demonstrate the efficacy of our proposed method, we conducted numerous experiments on comprehensive databases. The experimental results validate that our method achieves state-of-the-art performance in predicting image quality.
引用
收藏
页码:545 / 554
页数:10
相关论文
共 50 条
  • [31] Full-Reference Image Quality Expression via Genetic Programming
    Bakurov, Illya
    Buzzelli, Marco
    Schettini, Raimondo
    Castelli, Mauro
    Vanneschi, Leonardo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1458 - 1473
  • [32] No-Reference Screen Content Image Quality Assessment With Unsupervised Domain Adaptation
    Chen, Baoliang
    Li, Haoliang
    Fan, Hongfei
    Wang, Shiqi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5463 - 5476
  • [33] A Multibranch Network With Multilayer Feature Fusion for No-Reference Image Quality Assessment
    Zhao, Wenqing
    Li, Mengwei
    Xu, Lijiao
    Sun, Yue
    Zhao, Zhenbing
    Zhai, Yongjie
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [34] Combining CNN and transformers for full-reference and no-reference image quality assessment
    Zeng, Chao
    Kwong, Sam
    NEUROCOMPUTING, 2023, 549
  • [35] Disparity Weighting Applied to Full-Reference and No Reference Stereoscopic Image Quality Assessment
    de Miranda Cardoso, Jose Vinicius
    Miranda Regis, Carlos Danilo
    de Alencar, Marcelo Sampaio
    2015 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2015, : 477 - 480
  • [36] Full Reference Image Quality Assessment from IQA Datasets: A Review
    Wasson, Vikas
    Kaur, Bikrampal
    PROCEEDINGS OF THE 2019 6TH INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT (INDIACOM), 2019, : 735 - 738
  • [37] Perceptual Gradient Similarity Deviation for Full Reference Image Quality Assessment
    Jin, Manyu
    Wang, Tao
    Ji, Zexuan
    Shen, Xiaobo
    CMC-COMPUTERS MATERIALS & CONTINUA, 2018, 56 (03): : 501 - 515
  • [38] Full-reference calibration-free image quality assessment
    Giannitrapani, Paolo
    Di Claudio, Elio D.
    Jacovitti, Giovanni
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2025, 130
  • [39] New Combined Metric for Full-Reference Image Quality Assessment
    Frackiewicz, Mariusz
    Machalica, Lukasz
    Palus, Henryk
    SYMMETRY-BASEL, 2024, 16 (12):
  • [40] Dual-Channel Multi-Task CNN for No-Reference Screen Content Image Quality Assessment
    Zhang, Chaofan
    Huang, Ziqing
    Liu, Shiguang
    Xiao, Jian
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5011 - 5025