A Multiscale Approach to Deep Blind Image Quality Assessment

被引:8
|
作者
Liu, Manni [1 ]
Huang, Jiabin [2 ]
Zeng, Delu [3 ]
Ding, Xinghao [4 ]
Paisley, John [5 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510006, Peoples R China
[2] Xiamen Univ, Sch Informat Sci & Technol, Xiamen 361005, Peoples R China
[3] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510006, Peoples R China
[4] Xiamen Univ, Sch Informat, Xiamen 361005, Peoples R China
[5] Columbia Univ, Dept Elect Engn, New York, NY 10027 USA
基金
中国国家自然科学基金;
关键词
Image quality; Feature extraction; Distortion; Sensitivity; Visualization; Task analysis; Predictive models; Blind image quality assessment; NR-IQA; multi-scale; deep learning; CNN; FIDELITY-CRITERION; NEURAL-NETWORKS; STATISTICS; NORMALIZATION; INFORMATION; SIMILARITY;
D O I
10.1109/TIP.2023.3245991
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Faithful measurement of perceptual quality is of significant importance to various multimedia applications. By fully utilizing reference images, full-reference image quality assessment (FR-IQA) methods usually achieve better prediction performance. On the other hand, no-reference image quality assessment (NR-IQA), also known as blind image quality assessment (BIQA), which does not consider the reference image, makes it a challenging but important task. Previous NR-IQA methods have focused on spatial measures at the expense of information in the available frequency bands. In this paper, we present a multiscale deep blind image quality assessment method (BIQA, M.D.) with spatial optimal-scale filtering analysis. Motivated by the multi-channel behavior of the human visual system and contrast sensitivity function, we decompose an image into a number of spatial frequency bands through multiscale filtering and extract features to map an image to its subjective quality score by applying convolutional neural network. Experimental results show that BIQA, M.D. compares well with existing NR-IQA methods and generalizes well across datasets.
引用
收藏
页码:1656 / 1667
页数:12
相关论文
共 50 条
  • [31] Attentive Deep Image Quality Assessment for Omnidirectional Stitching
    Duan, Huiyu
    Min, Xiongkuo
    Sun, Wei
    Zhu, Yucheng
    Zhang, Xiao-Ping
    Zhai, Guangtao
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (06) : 1150 - 1164
  • [32] SEM Image Quality Assessment Based on Intuitive Morphology and Deep Semantic Features
    Wang, Haoran
    Li, Shiyin
    Ding, Jicun
    Li, Suyan
    Dong, Liang
    Lu, Zhaolin
    IEEE ACCESS, 2022, 10 : 111377 - 111388
  • [33] Deep Objective Quality Assessment Driven Single Image Super-Resolution
    Yan, Bo
    Bare, Bahetiyaer
    Ma, Chenxi
    Li, Ke
    Tan, Weimin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (11) : 2957 - 2971
  • [34] Image Quality Assessment Using Contrastive Learning
    Madhusudana, Pavan C.
    Birkbeck, Neil
    Wang, Yilin
    Adsumilli, Balu
    Bovik, Alan C.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4149 - 4161
  • [35] Active Fine-Tuning From gMAD Examples Improves Blind Image Quality Assessment
    Wang, Zhihua
    Ma, Kede
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 4577 - 4590
  • [36] Deep Activation Pooling for Blind Image Quality Assessment
    Zhang, Zhong
    Wang, Hong
    Liu, Shuang
    Durrani, Tariq S.
    APPLIED SCIENCES-BASEL, 2018, 8 (04):
  • [37] Dehazed Image Quality Evaluation: From Partial Discrepancy to Blind Perception
    Zhou, Wei
    Zhang, Ruizeng
    Li, Leida
    Yue, Guanghui
    Gong, Jianwei
    Chen, Huiyan
    Liu, Hantao
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (02): : 3843 - 3858
  • [38] Blind Image Quality Measurement by Exploiting High-Order Statistics With Deep Dictionary Encoding Network
    Jiang, Qiuping
    Gao, Wei
    Wang, Shiqi
    Yue, Guanghui
    Shao, Feng
    Ho, Yo-Sung
    Kwong, Sam
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (10) : 7398 - 7410
  • [39] Blind Stereoscopic Image Quality Assessment Accounting for Human Monocular Visual Properties and Binocular Interactions
    Liu, Yun
    Yan, Weiqing
    Zheng, Zhi
    Huang, Baoqing
    Yu, Hongwei
    IEEE ACCESS, 2020, 8 : 33666 - 33678
  • [40] Two-Stream Convolutional Networks for Blind Image Quality Assessment
    Yan, Qingsen
    Gong, Dong
    Zhang, Yanning
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) : 2200 - 2211