Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics

被引:1
|
作者
Ni, Zhangkai [1 ,2 ]
Liu, Yue [3 ]
Ding, Keyan [4 ]
Yang, Wenhan [5 ]
Wang, Hanli [1 ,2 ]
Wang, Shiqi [3 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[2] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 200092, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Zhejiang Univ, ZJU Hangzhou Global Sci & Technol Innovat Ctr, Hangzhou 311200, Peoples R China
[5] PengCheng Lab, Shenzhen 518066, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Training; Analytical models; Image quality; Data models; Predictive models; Computational modeling; Blind image quality assessment; feature statistics; multivariate Gaussian fitting; multi-scale deep features; DATABASE;
D O I
10.1109/TMM.2024.3405729
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deeplearning-based methods have significantly influenced the blind image quality assessment (BIQA) field, however, these methods often require training using large amounts of human rating data. In contrast, traditional knowledge-based methods are cost-effective for training but face challenges in effectively extracting features aligned with human visual perception. To bridge these gaps, we propose integrating deep features from pre-trained visual models with a statistical analysis model into a Multi-scale Deep Feature Statistics (MDFS) model for achieving opinion-unaware BIQA (OU-BIQA), thereby eliminating the reliance on human rating data and significantly improving training efficiency. Specifically, we extract patch-wise multi-scale features from pre-trained vision models, which are subsequently fitted into a multivariate Gaussian (MVG) model. The final quality score is determined by quantifying the distance between the MVG model derived from the test image and the benchmark MVG model derived from the high-quality image set. A comprehensive series of experiments conducted on various datasets show that our proposed model exhibits superior consistency with human visual perception compared to state-of-the-art BIQA models. Furthermore, it shows improved generalizability across diverse target-specific BIQA tasks.
引用
收藏
页码:10211 / 10224
页数:14
相关论文
共 50 条
  • [1] REVISITING NATURAL SCENE STATISTICAL MODELING USING DEEP FEATURES FOR OPINION-UNAWARE IMAGE QUALITY ASSESSMENT
    Mahmoudpour, Saeed
    Schelkens, Peter
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1471 - 1475
  • [2] An Opinion-unaware Blind Quality Assessment Algorithm for Multiply Distorted Images
    Wang, Tongle
    Deng, Junchen
    ELEVENTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING SYSTEMS, 2019, 11384
  • [3] Recycling Discriminator: Towards Opinion-Unaware Image Quality Assessment Using Wasserstein GAN
    Zhu, Yunan
    Ma, Haichuan
    Peng, Jialun
    Liu, Dong
    Xiong, Zhiwei
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 116 - 125
  • [4] Opinion-unaware blind picture quality measurement using deep encoder-decoder architecture
    Zhou, Wujie
    Lin, Xinyang
    Zhou, Xi
    Lei, Jingsheng
    Yu, Lu
    Luo, Ting
    DIGITAL SIGNAL PROCESSING, 2020, 107
  • [5] EXPLORING OPINION-UNAWARE VIDEO QUALITY ASSESSMENT WITH SEMANTIC AFFINITY CRITERION
    Wu, Haoning
    Liao, Liang
    Hou, Jingwen
    Chen, Chaofeng
    Zhang, Erli
    Wang, Annan
    Sun, Wenxiu
    Yan, Qiong
    Lin, Weisi
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 366 - 371
  • [6] Opinion-Unaware Blind Quality Assessment of Multiply and Singly Distorted Images via Distortion Parameter Estimation
    Zhang, Yi
    Chandler, Damon M.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (11) : 5433 - 5448
  • [7] No-Reference Quality Assessment for Pansharpened Images via Opinion-Unaware Learning
    Zhou, Bingzhong
    Shao, Feng
    Meng, Xiangchao
    Fu, Randi
    Ho, Yo-Sung
    IEEE ACCESS, 2019, 7 : 40388 - 40401
  • [8] Blind Image Quality Assessment Based on Multi-scale KLT
    Yang, Chao
    Zhang, Xinfeng
    An, Ping
    Shen, Liquan
    Kuo, C. -C. Jay
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1557 - 1566
  • [9] OPINION-UNAWARE NO-REFERENCE IMAGE QUALITY ASSESSMENT OF SMARTPHONE CAMERA IMAGES BASED ON AESTHETICS AND HUMAN PERCEPTION
    Yuan, Zifeng
    Qi, Yi
    Hu, Menghan
    Li, Qingli
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [10] Towards a blind image quality evaluator using multi-scale second-order statistics
    Cai, Hao
    Li, Leida
    Yi, Zili
    Gong, Minglun
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 71 : 88 - 99