A Multiscale Approach to Deep Blind Image Quality Assessment

被引:8
|
作者
Liu, Manni [1 ]
Huang, Jiabin [2 ]
Zeng, Delu [3 ]
Ding, Xinghao [4 ]
Paisley, John [5 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510006, Peoples R China
[2] Xiamen Univ, Sch Informat Sci & Technol, Xiamen 361005, Peoples R China
[3] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510006, Peoples R China
[4] Xiamen Univ, Sch Informat, Xiamen 361005, Peoples R China
[5] Columbia Univ, Dept Elect Engn, New York, NY 10027 USA
基金
中国国家自然科学基金;
关键词
Image quality; Feature extraction; Distortion; Sensitivity; Visualization; Task analysis; Predictive models; Blind image quality assessment; NR-IQA; multi-scale; deep learning; CNN; FIDELITY-CRITERION; NEURAL-NETWORKS; STATISTICS; NORMALIZATION; INFORMATION; SIMILARITY;
D O I
10.1109/TIP.2023.3245991
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Faithful measurement of perceptual quality is of significant importance to various multimedia applications. By fully utilizing reference images, full-reference image quality assessment (FR-IQA) methods usually achieve better prediction performance. On the other hand, no-reference image quality assessment (NR-IQA), also known as blind image quality assessment (BIQA), which does not consider the reference image, makes it a challenging but important task. Previous NR-IQA methods have focused on spatial measures at the expense of information in the available frequency bands. In this paper, we present a multiscale deep blind image quality assessment method (BIQA, M.D.) with spatial optimal-scale filtering analysis. Motivated by the multi-channel behavior of the human visual system and contrast sensitivity function, we decompose an image into a number of spatial frequency bands through multiscale filtering and extract features to map an image to its subjective quality score by applying convolutional neural network. Experimental results show that BIQA, M.D. compares well with existing NR-IQA methods and generalizes well across datasets.
引用
收藏
页码:1656 / 1667
页数:12
相关论文
共 50 条
  • [1] Blind Dehazed Image Quality Assessment: A Deep CNN-Based Approach
    Lv, Xiao
    Xiang, Tao
    Yang, Ying
    Liu, Hantao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 9410 - 9424
  • [2] Blind Image Quality Assessment Based on Perceptual Comparison
    Li, Aobo
    Wu, Jinjian
    Liu, Yongxu
    Li, Leida
    Dong, Weisheng
    Shi, Guangming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 9671 - 9682
  • [3] Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Token
    Shi, Jinsong
    Gao, Pan
    Smolic, Aljosa
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4641 - 4651
  • [4] A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer
    Lang, Shujun
    Liu, Xu
    Zhou, Mingliang
    Luo, Jun
    Pu, Huayan
    Zhuang, Xu
    Wang, Jason
    Wei, Xuekai
    Zhang, Taiping
    Feng, Yong
    Shang, Zhaowei
    IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (01) : 316 - 324
  • [5] Blind Image Quality Assessment With Active Inference
    Ma, Jupo
    Wu, Jinjian
    Li, Leida
    Dong, Weisheng
    Xie, Xuemei
    Shi, Guangming
    Lin, Weisi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3650 - 3663
  • [6] LIQA: Lifelong Blind Image Quality Assessment
    Liu, Jianzhao
    Zhou, Wei
    Li, Xin
    Xu, Jiahua
    Chen, Zhibo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5358 - 5373
  • [7] On the use of deep learning for blind image quality assessment
    Bianco, Simone
    Celona, Luigi
    Napoletano, Paolo
    Schettini, Raimondo
    SIGNAL IMAGE AND VIDEO PROCESSING, 2018, 12 (02) : 355 - 362
  • [8] DEEP LEARNING NETWORK FOR BLIND IMAGE QUALITY ASSESSMENT
    Gu, Ke
    Zhai, Guangtao
    Yang, Xiaokang
    Zhang, Wenjun
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 511 - 515
  • [9] DeepRN: A CONTENT PRESERVING DEEP ARCHITECTURE FOR BLIND IMAGE QUALITY ASSESSMENT
    Varga, Domonkos
    Saupe, Dietmar
    Sziranyi, Tamas
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2018,
  • [10] Multitask Deep Neural Network With Knowledge-Guided Attention for Blind Image Quality Assessment
    Zhou, Tianwei
    Tan, Songbai
    Zhao, Baoquan
    Yue, Guanghui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7577 - 7588