A Multiscale Approach to Deep Blind Image Quality Assessment

被引:8
|
作者
Liu, Manni [1 ]
Huang, Jiabin [2 ]
Zeng, Delu [3 ]
Ding, Xinghao [4 ]
Paisley, John [5 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510006, Peoples R China
[2] Xiamen Univ, Sch Informat Sci & Technol, Xiamen 361005, Peoples R China
[3] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510006, Peoples R China
[4] Xiamen Univ, Sch Informat, Xiamen 361005, Peoples R China
[5] Columbia Univ, Dept Elect Engn, New York, NY 10027 USA
基金
中国国家自然科学基金;
关键词
Image quality; Feature extraction; Distortion; Sensitivity; Visualization; Task analysis; Predictive models; Blind image quality assessment; NR-IQA; multi-scale; deep learning; CNN; FIDELITY-CRITERION; NEURAL-NETWORKS; STATISTICS; NORMALIZATION; INFORMATION; SIMILARITY;
D O I
10.1109/TIP.2023.3245991
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Faithful measurement of perceptual quality is of significant importance to various multimedia applications. By fully utilizing reference images, full-reference image quality assessment (FR-IQA) methods usually achieve better prediction performance. On the other hand, no-reference image quality assessment (NR-IQA), also known as blind image quality assessment (BIQA), which does not consider the reference image, makes it a challenging but important task. Previous NR-IQA methods have focused on spatial measures at the expense of information in the available frequency bands. In this paper, we present a multiscale deep blind image quality assessment method (BIQA, M.D.) with spatial optimal-scale filtering analysis. Motivated by the multi-channel behavior of the human visual system and contrast sensitivity function, we decompose an image into a number of spatial frequency bands through multiscale filtering and extract features to map an image to its subjective quality score by applying convolutional neural network. Experimental results show that BIQA, M.D. compares well with existing NR-IQA methods and generalizes well across datasets.
引用
收藏
页码:1656 / 1667
页数:12
相关论文
共 50 条
  • [21] FOVQA: Blind Foveated Video Quality Assessment
    Jin, Yize
    Patney, Anjul
    Webb, Richard
    Bovik, Alan C.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4571 - 4584
  • [22] Attentional Feature Fusion for End-to-End Blind Image Quality Assessment
    Zhou, Mingliang
    Lang, Shujun
    Zhang, Taiping
    Liao, Xingran
    Shang, Zhaowei
    Xiang, Tao
    Fang, Bin
    IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (01) : 144 - 152
  • [23] Multi-Angle Projection Based Blind Omnidirectional Image Quality Assessment
    Jiang, Hao
    Jiang, Gangyi
    Yu, Mei
    Luo, Ting
    Xu, Haiyong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4211 - 4223
  • [24] No-Reference Image Quality Assessment by Hallucinating Pristine Features
    Chen, Baoliang
    Zhu, Lingyu
    Kong, Chenqi
    Zhu, Hanwei
    Wang, Shiqi
    Li, Zhu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6139 - 6151
  • [25] Blind Image Quality Assessment Based on Multiscale Salient Local Binary Patterns
    Freitas, Pedro Garcia
    Alamgeer, Sana
    Akamine, Welington Y. L.
    Farias, Mylene C. Q.
    PROCEEDINGS OF THE 9TH ACM MULTIMEDIA SYSTEMS CONFERENCE (MMSYS'18), 2018, : 52 - 63
  • [26] Deep Ordinal Regression Framework for No-Reference Image Quality Assessment
    Wang, Huasheng
    Tu, Yulin
    Liu, Xiaochang
    Tan, Hongchen
    Liu, Hantao
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 428 - 432
  • [27] No-Reference Image Quality Assessment: An Attention Driven Approach
    Chen, Diqi
    Wang, Yizhou
    Gao, Wen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6496 - 6506
  • [28] Fully Deep Blind Image Quality Predictor
    Kim, Jongyoo
    Lee, Sanghoon
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (01) : 206 - 220
  • [29] Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessment
    Zhou, Tianwei
    Tan, Songbai
    Zhou, Wei
    Luo, Yu
    Wang, Yuan-Gen
    Yue, Guanghui
    IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (03) : 833 - 843
  • [30] Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics
    Ni, Zhangkai
    Liu, Yue
    Ding, Keyan
    Yang, Wenhan
    Wang, Hanli
    Wang, Shiqi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10211 - 10224