HDIQA: A Hyper Debiasing Framework for Full Reference Image Quality Assessment

被引:6
|
作者
Zhou, Mingliang [1 ]
Wang, Heqiang [1 ]
Wei, Xuekai [1 ]
Feng, Yong [1 ]
Luo, Jun [2 ]
Pu, Huayan [2 ]
Zhao, Jinglei [2 ]
Wang, Liming [2 ]
Chu, Zhigang [2 ]
Wang, Xin [2 ,3 ]
Fang, Bin [1 ]
Shang, Zhaowei [1 ]
机构
[1] Chongqing Univ, Sch Comp Sci, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Sch Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[3] Chongqing Changan Automobile Co Ltd, Prod Dept, Chongqing 400020, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image quality; Visualization; Tensors; Task analysis; Perturbation methods; Quality assessment; Image quality assessment; deep feature; hypernetwork; Tucker decomposition; SIMILARITY; VISIBILITY;
D O I
10.1109/TBC.2024.3353573
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent methods that project images into deep feature spaces to evaluate quality degradation have produced inefficient results due to biased mappings; i.e., these projections are not aligned with the perceptions of humans. In this paper, we develop a hyperdebiasing framework to address such bias in full-reference image quality assessment. First, we perform orthogonal Tucker decomposition on the top of feature tensors extracted by a feature extraction network to project features into a robust content-agnostic space and effectively eliminate the bias caused by subtle image perturbations. Second, we propose a hypernetwork in which the content-aware parameters are produced for reprojecting features in a deep subspace for quality prediction. By leveraging the content diversity of large-scale blind-reference datasets, the perception rule between image content and image quality is established. Third, a quality prediction network is proposed by combining debiased content-aware and content-agnostic features to predict the final image quality score. To demonstrate the efficacy of our proposed method, we conducted numerous experiments on comprehensive databases. The experimental results validate that our method achieves state-of-the-art performance in predicting image quality.
引用
收藏
页码:545 / 554
页数:10
相关论文
共 50 条
  • [21] A COMPREHENSIVE EVALUATION OF FULL REFERENCE IMAGE QUALITY ASSESSMENT ALGORITHMS
    Zhang, Lin
    Zhang, Lei
    Mou, Xuanqin
    Zhang, David
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 1477 - 1480
  • [22] Efficient full-reference assessment of image and video quality
    Ndjiki-Nya, Patrick
    Barrado, Mikel
    Wiegand, Thomas
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 689 - 692
  • [23] A structural coherence approach to full reference image quality assessment
    Capodiferro, Licia
    Di Claudio, Elio D.
    Jacovitti, Giovanni
    Bordoni, Fondazione U.
    PROCEEDINGS OF THE FOURTH IASTED INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, PATTERN RECOGNITION, AND APPLICATIONS, 2007, : 19 - +
  • [24] BLIND FULL REFERENCE QUALITY ASSESSMENT OF POISSON IMAGE DENOISING
    Zhang, Chen
    Hirakawa, Keigo
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 2719 - 2723
  • [25] Full reference image quality assessment based on dual-space multi-feature fusion
    Wu, Xinrong
    Shi, Zhiming
    MULTIMEDIA SYSTEMS, 2024, 30 (03)
  • [26] Federated learning based nonlinear two-stage framework for full-reference image quality assessment: An application for biometric
    Tianyi, Lan
    Riaz, Saleem
    Xuande, Zhang
    Mirza, Alina
    Afzal, Farkhanda
    Iqbal, Zeshan
    Khan, Muhammad Attique
    Alhaisoni, Majed
    Alqahtani, Abdullah
    IMAGE AND VISION COMPUTING, 2022, 128
  • [27] Full-Reference Image Quality Assessment Approach Based on Image Separation
    Wang, Bin
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON ADVANCED ENGINEERING MATERIALS AND TECHNOLOGY, 2015, 38 : 524 - 527
  • [28] Comparison of Full-Reference Image Quality Models for Optimization of Image Processing Systems
    Ding, Keyan
    Ma, Kede
    Wang, Shiqi
    Simoncelli, Eero P.
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (04) : 1258 - 1281
  • [29] Two-Dimensional Approach to Full-Reference Image Quality Assessment Based on Positional Structural Information
    Capodiferro, Licia
    Jacovitti, Giovanni
    Di Claudio, Elio D.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (02) : 505 - 516
  • [30] VCRNet: Visual Compensation Restoration Network for No-Reference Image Quality Assessment
    Pan, Zhaoqing
    Yuan, Feng
    Lei, Jianjun
    Fang, Yuming
    Shao, Xiao
    Kwong, Sam
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1613 - 1627