Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics

被引:1
|
作者
Ni, Zhangkai [1 ,2 ]
Liu, Yue [3 ]
Ding, Keyan [4 ]
Yang, Wenhan [5 ]
Wang, Hanli [1 ,2 ]
Wang, Shiqi [3 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[2] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 200092, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Zhejiang Univ, ZJU Hangzhou Global Sci & Technol Innovat Ctr, Hangzhou 311200, Peoples R China
[5] PengCheng Lab, Shenzhen 518066, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Training; Analytical models; Image quality; Data models; Predictive models; Computational modeling; Blind image quality assessment; feature statistics; multivariate Gaussian fitting; multi-scale deep features; DATABASE;
D O I
10.1109/TMM.2024.3405729
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deeplearning-based methods have significantly influenced the blind image quality assessment (BIQA) field, however, these methods often require training using large amounts of human rating data. In contrast, traditional knowledge-based methods are cost-effective for training but face challenges in effectively extracting features aligned with human visual perception. To bridge these gaps, we propose integrating deep features from pre-trained visual models with a statistical analysis model into a Multi-scale Deep Feature Statistics (MDFS) model for achieving opinion-unaware BIQA (OU-BIQA), thereby eliminating the reliance on human rating data and significantly improving training efficiency. Specifically, we extract patch-wise multi-scale features from pre-trained vision models, which are subsequently fitted into a multivariate Gaussian (MVG) model. The final quality score is determined by quantifying the distance between the MVG model derived from the test image and the benchmark MVG model derived from the high-quality image set. A comprehensive series of experiments conducted on various datasets show that our proposed model exhibits superior consistency with human visual perception compared to state-of-the-art BIQA models. Furthermore, it shows improved generalizability across diverse target-specific BIQA tasks.
引用
收藏
页码:10211 / 10224
页数:14
相关论文
共 50 条
  • [31] Multi-scale fidelity measure for image fusion quality assessment
    Martinez, Jorge
    Pistonesi, Silvina
    Cristina Maciel, Maria
    Georgina Flesia, Ana
    INFORMATION FUSION, 2019, 50 : 197 - 211
  • [32] Image Quality Assessment Based on Multi-scale Geometric Analysis
    Liu, Mingna
    Yang, Xin
    Shang, Yanfeng
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2009, PROCEEDINGS, 2009, 5716 : 807 - +
  • [33] A Multi-Scale Learning Local Phase and Amplitude Blind Image Quality Assessment for Multiply Distorted Images
    Li, Chaofeng
    Zhang, Yu
    Wu, Xiaojun
    Zheng, Yuhui
    IEEE ACCESS, 2018, 6 : 64577 - 64586
  • [34] BLIND STEREOSCOPIC IMAGE QUALITY ASSESSMENT BY DEEP NEURAL NETWORK OF MULTI-LEVEL FEATURE FUSION
    Yan, Jiebin
    Fang, Yuming
    Huang, Liping
    Min, Xiongkuo
    Yao, Yiru
    Zhai, Guangtao
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [35] Image-Based Pothole Detection Using Multi-Scale Feature Network and Risk Assessment
    Heo, Dong-Hoe
    Choi, Ji-Yoon
    Kim, Sang-Baeg
    Tak, Tae-Oh
    Zhang, Sheng-Peng
    ELECTRONICS, 2023, 12 (04)
  • [36] Reduced-reference image deblurring quality assessment based on multi-scale feature enhancement and aggregation
    Hu, Bo
    Wang, Shuaijian
    Gao, Xinbo
    Li, Leida
    Gan, Ji
    Nie, Xixi
    NEUROCOMPUTING, 2023, 547
  • [37] Space Plant Image Segmentation via Multi-Scale Deep Feature Fusion
    Cao, Jingkang
    Duan, Jiangyong
    Meng, Juan
    Li, Ye
    2018 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (CSSE 2018), 2018, : 12 - 22
  • [38] Innovative Approaches in Image Quality Assessment: A Deep Learning-Enabled Multi Level and Multi-Scale Perspective
    Sun, Hai
    TRAITEMENT DU SIGNAL, 2023, 40 (06) : 2661 - 2670
  • [39] Blind Image Quality Assessment Bases On Natural Scene Statistics And Deep Learning
    Ge, De
    Song, Jianxin
    PROCEEDINGS OF THE 2015 5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCES AND AUTOMATION ENGINEERING, 2016, 42 : 939 - 945
  • [40] Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment
    Chen, Baoliang
    Zhu, Hanwei
    Zhu, Lingyu
    Wang, Shiqi
    Kwong, Sam
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 3227 - 3241