Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics

被引:1
|
作者
Ni, Zhangkai [1 ,2 ]
Liu, Yue [3 ]
Ding, Keyan [4 ]
Yang, Wenhan [5 ]
Wang, Hanli [1 ,2 ]
Wang, Shiqi [3 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[2] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 200092, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Zhejiang Univ, ZJU Hangzhou Global Sci & Technol Innovat Ctr, Hangzhou 311200, Peoples R China
[5] PengCheng Lab, Shenzhen 518066, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Training; Analytical models; Image quality; Data models; Predictive models; Computational modeling; Blind image quality assessment; feature statistics; multivariate Gaussian fitting; multi-scale deep features; DATABASE;
D O I
10.1109/TMM.2024.3405729
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deeplearning-based methods have significantly influenced the blind image quality assessment (BIQA) field, however, these methods often require training using large amounts of human rating data. In contrast, traditional knowledge-based methods are cost-effective for training but face challenges in effectively extracting features aligned with human visual perception. To bridge these gaps, we propose integrating deep features from pre-trained visual models with a statistical analysis model into a Multi-scale Deep Feature Statistics (MDFS) model for achieving opinion-unaware BIQA (OU-BIQA), thereby eliminating the reliance on human rating data and significantly improving training efficiency. Specifically, we extract patch-wise multi-scale features from pre-trained vision models, which are subsequently fitted into a multivariate Gaussian (MVG) model. The final quality score is determined by quantifying the distance between the MVG model derived from the test image and the benchmark MVG model derived from the high-quality image set. A comprehensive series of experiments conducted on various datasets show that our proposed model exhibits superior consistency with human visual perception compared to state-of-the-art BIQA models. Furthermore, it shows improved generalizability across diverse target-specific BIQA tasks.
引用
收藏
页码:10211 / 10224
页数:14
相关论文
共 50 条
  • [41] IMAGE DEBLURRING USING DEEP MULTI-SCALE DISTORTION PRIOR
    Kim, Irina
    Lim, Dongpan
    Seo, Youngil
    Lee, Jeongguk
    Choi, Wooseok
    Song, Seongwook
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 446 - 450
  • [42] Efficient Feature Selection for Blind Image Quality Assessment based on Natural Scene Statistics
    Nizami, Imran Fareed
    Majid, Muhammad
    Khurshid, Khawar
    PROCEEDINGS OF 2017 14TH INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGY (IBCAST), 2017, : 318 - 322
  • [43] Deep Blind Image Quality Assessment Using Dynamic Neural Model With Dual-Order Statistics
    Zhou, Zihan
    Li, Jing
    Zhong, Dexiang
    Xu, Yong
    Le Callet, Patrick
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6279 - 6290
  • [44] MMMNet: An End-to-End Multi-Task Deep Convolution Neural Network With Multi-Scale and Multi-Hierarchy Fusion for Blind Image Quality Assessment
    Li, Fan
    Zhang, Yangfan
    Cosman, Pamela C.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) : 4798 - 4811
  • [45] Image Inpainting Using Multi-Scale Feature Joint Attention Model
    Lin X.
    Zhou Y.
    Li D.
    Huang W.
    Sheng B.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (08): : 1260 - 1271
  • [46] Blind Image Quality Assessment via Deep Response Feature Decomposition and Aggregation
    Wang, Hui
    Wang, Guangcheng
    Xia, Wenjun
    Yang, Ziyuan
    Yu, Hui
    Fang, Leyuan
    Zhang, Yi
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (06) : 1165 - 1177
  • [47] Image quality assessment metrics based on multi-scale edge presentation
    Zhai, GT
    Zhang, WJ
    Yang, XK
    Xu, Y
    2005 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS - DESIGN AND IMPLEMENTATION (SIPS), 2005, : 331 - 336
  • [48] Image Enhancement by Wavelet Multi-scale Edge Statistics
    Liew, Alan Wee-Chung
    Jo, Jun
    Chun, Yong-Sik
    Ahn, Tae-Hong
    Chae, Tae Byong
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 2025 - 2028
  • [49] Image Quality Assessment Based on Multi-Scale Representation and Shifting Transformer
    Fu, Geng
    Wang, Ziyu
    Zhang, Cuijuan
    Qi, Zerong
    Hu, Mingzheng
    Fu, Shujun
    Zhang, Yunfeng
    IEEE ACCESS, 2025, 13 : 24276 - 24286
  • [50] Multi-scale differential error: A novel image quality assessment tool
    Kanters, Frans
    Florack, Luc
    Platel, Bram
    Romeny, Bart ter Haar
    PROCEEDINGS OF THE EIGHTH IASTED INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING, 2006, : 188 - +