A Multiscale Approach to Deep Blind Image Quality Assessment

被引:8
|
作者
Liu, Manni [1 ]
Huang, Jiabin [2 ]
Zeng, Delu [3 ]
Ding, Xinghao [4 ]
Paisley, John [5 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510006, Peoples R China
[2] Xiamen Univ, Sch Informat Sci & Technol, Xiamen 361005, Peoples R China
[3] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510006, Peoples R China
[4] Xiamen Univ, Sch Informat, Xiamen 361005, Peoples R China
[5] Columbia Univ, Dept Elect Engn, New York, NY 10027 USA
基金
中国国家自然科学基金;
关键词
Image quality; Feature extraction; Distortion; Sensitivity; Visualization; Task analysis; Predictive models; Blind image quality assessment; NR-IQA; multi-scale; deep learning; CNN; FIDELITY-CRITERION; NEURAL-NETWORKS; STATISTICS; NORMALIZATION; INFORMATION; SIMILARITY;
D O I
10.1109/TIP.2023.3245991
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Faithful measurement of perceptual quality is of significant importance to various multimedia applications. By fully utilizing reference images, full-reference image quality assessment (FR-IQA) methods usually achieve better prediction performance. On the other hand, no-reference image quality assessment (NR-IQA), also known as blind image quality assessment (BIQA), which does not consider the reference image, makes it a challenging but important task. Previous NR-IQA methods have focused on spatial measures at the expense of information in the available frequency bands. In this paper, we present a multiscale deep blind image quality assessment method (BIQA, M.D.) with spatial optimal-scale filtering analysis. Motivated by the multi-channel behavior of the human visual system and contrast sensitivity function, we decompose an image into a number of spatial frequency bands through multiscale filtering and extract features to map an image to its subjective quality score by applying convolutional neural network. Experimental results show that BIQA, M.D. compares well with existing NR-IQA methods and generalizes well across datasets.
引用
收藏
页码:1656 / 1667
页数:12
相关论文
共 50 条
  • [41] Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild
    Zhang, Weixia
    Ma, Kede
    Zhai, Guangtao
    Yang, Xiaokang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3474 - 3486
  • [42] Viewport Perception Based Blind Stereoscopic Omnidirectional Image Quality Assessment
    Qi, Yubin
    Jiang, Gangyi
    Yu, Mei
    Zhang, Yun
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (10) : 3926 - 3941
  • [43] MaD-DLS: Mean and Deviation of Deep and Local Similarity for Image Quality Assessment
    Sim, Kyohoon
    Yang, Jiachen
    Lu, Wen
    Gao, Xinbo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 4037 - 4048
  • [44] Light Field Image Quality Assessment With Auxiliary Learning Based on Depthwise and Anglewise Separable Convolutions
    Qu, Qiang
    Chen, Xiaoming
    Chung, Vera
    Chen, Zhibo
    IEEE TRANSACTIONS ON BROADCASTING, 2021, 67 (04) : 837 - 850
  • [45] Blind Image Quality Assessment by Visual Neuron Matrix
    Chang, Hua-Wen
    Bi, Xiao-Dong
    Kai, Chen
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1803 - 1807
  • [46] Blind image quality assessment by simulating the visual cortex
    Cai, Rongtai
    Fang, Ming
    VISUAL COMPUTER, 2023, 39 (10) : 4639 - 4656
  • [47] From Pixels to Rich-Nodes: A Cognition-Inspired Framework for Blind Image Quality Assessment
    He, Tian
    Shi, Lin
    Xu, Wenjia
    Wang, Yu
    Qiu, Weijie
    Guo, Houbang
    Jiang, Zhuqing
    IEEE TRANSACTIONS ON BROADCASTING, 2025, 71 (01) : 229 - 239
  • [48] Deep Virtual Reality Image Quality Assessment With Human Perception Guider for Omnidirectional Image
    Kim, Hak Gu
    Lim, Heoun-Taek
    Ro, Yong Man
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (04) : 917 - 928
  • [49] Blind Image Quality Assessment via Deep Response Feature Decomposition and Aggregation
    Wang, Hui
    Wang, Guangcheng
    Xia, Wenjun
    Yang, Ziyuan
    Yu, Hui
    Fang, Leyuan
    Zhang, Yi
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (06) : 1165 - 1177
  • [50] Blind Image Quality Assessment for Authentic Distortions by Intermediary Enhancement and Iterative Training
    Song, Tianshu
    Li, Leida
    Chen, Pengfei
    Liu, Hantao
    Qian, Jiansheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7592 - 7604