HDIQA: A Hyper Debiasing Framework for Full Reference Image Quality Assessment

被引:6
|
作者
Zhou, Mingliang [1 ]
Wang, Heqiang [1 ]
Wei, Xuekai [1 ]
Feng, Yong [1 ]
Luo, Jun [2 ]
Pu, Huayan [2 ]
Zhao, Jinglei [2 ]
Wang, Liming [2 ]
Chu, Zhigang [2 ]
Wang, Xin [2 ,3 ]
Fang, Bin [1 ]
Shang, Zhaowei [1 ]
机构
[1] Chongqing Univ, Sch Comp Sci, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Sch Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[3] Chongqing Changan Automobile Co Ltd, Prod Dept, Chongqing 400020, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image quality; Visualization; Tensors; Task analysis; Perturbation methods; Quality assessment; Image quality assessment; deep feature; hypernetwork; Tucker decomposition; SIMILARITY; VISIBILITY;
D O I
10.1109/TBC.2024.3353573
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent methods that project images into deep feature spaces to evaluate quality degradation have produced inefficient results due to biased mappings; i.e., these projections are not aligned with the perceptions of humans. In this paper, we develop a hyperdebiasing framework to address such bias in full-reference image quality assessment. First, we perform orthogonal Tucker decomposition on the top of feature tensors extracted by a feature extraction network to project features into a robust content-agnostic space and effectively eliminate the bias caused by subtle image perturbations. Second, we propose a hypernetwork in which the content-aware parameters are produced for reprojecting features in a deep subspace for quality prediction. By leveraging the content diversity of large-scale blind-reference datasets, the perception rule between image content and image quality is established. Third, a quality prediction network is proposed by combining debiased content-aware and content-agnostic features to predict the final image quality score. To demonstrate the efficacy of our proposed method, we conducted numerous experiments on comprehensive databases. The experimental results validate that our method achieves state-of-the-art performance in predicting image quality.
引用
收藏
页码:545 / 554
页数:10
相关论文
共 50 条
  • [41] Attention-Guided Neural Networks for Full-Reference and No-Reference Audio-Visual Quality Assessment
    Cao, Yuqin
    Min, Xiongkuo
    Sun, Wei
    Zhai, Guangtao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1882 - 1896
  • [42] A Study of Why We Need to Reassess Full Reference Image Quality Assessment with Medical Images
    Breger, Anna
    Biguri, Ander
    Landman, Malena Sabate
    Selby, Ian
    Amberg, Nicole
    Brunner, Elisabeth
    Grohl, Janek
    Hatamikia, Sepideh
    Karner, Clemens
    Ning, Lipeng
    Dittmer, Soren
    Roberts, Michael
    Schonlieb, Carola-Bibiane
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2025,
  • [43] SEM Image Quality Assessment Based on Intuitive Morphology and Deep Semantic Features
    Wang, Haoran
    Li, Shiyin
    Ding, Jicun
    Li, Suyan
    Dong, Liang
    Lu, Zhaolin
    IEEE ACCESS, 2022, 10 : 111377 - 111388
  • [44] Hybrid Feature Similarity Approach to Full-Reference Image Quality Assessment
    Okarma, Krzysztof
    COMPUTER VISION AND GRAPHICS, 2012, 7594 : 212 - 219
  • [45] RVSIM: a feature similarity method for full-reference image quality assessment
    Guangyi Yang
    Deshi Li
    Fan Lu
    Yue Liao
    Wen Yang
    EURASIP Journal on Image and Video Processing, 2018
  • [46] Full-Reference Predictive Modeling of Subjective Image Quality Assessment with ANFIS
    El-Alfy, El-Sayed M.
    Riaz, Mohammed Rehan
    AGENTS AND ARTIFICIAL INTELLIGENCE, ICAART 2014, 2015, 8946 : 296 - 311
  • [47] RVSIM: a feature similarity method for full-reference image quality assessment
    Yang, Guangyi
    Li, Deshi
    Lu, Fan
    Liao, Yue
    Yang, Wen
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2018,
  • [48] New Full Reference Image Quality Assessment Method based on Edge Intensity
    Ahmad, Tarik
    Vurdu, Can Dogan
    Rahebi, Javad
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2018, 18 (03): : 82 - 85
  • [49] Full-Reference Image Quality Assessment Measure Based on Color Distortion
    Seghir, Zianou Ahmed
    Hachouf, Fella
    COMPUTER SCIENCE AND ITS APPLICATIONS, CIIA 2015, 2015, 456 : 66 - 77
  • [50] A PROPOSAL PROJECT FOR A BLIND IMAGE QUALITY ASSESSMENT BY LEARNING DISTORTIONS FROM THE FULL REFERENCE IMAGE QUALITY ASSESSMENTS
    Paris, Stefane
    2012 FOURTH INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2012, : 29 - 30