GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment

被引:62
|
作者
Sun, Simeng [1 ]
Yu, Tao [1 ]
Xu, Jiahua [1 ]
Zhou, Wei [1 ]
Chen, Zhibo [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engineer & Informat Sci, Hefei 230026, Anhui, Peoples R China
关键词
Blind image quality assessment; graph representation learning; pre-training; STATISTICS;
D O I
10.1109/TMM.2022.3152942
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A good distortion representation is crucial for the success of deep blind image quality assessment (BIQA). However, most previous methods do not effectively model the relationship between distortions or the distribution of samples with the same distortion type but different distortion levels. In this work, we start from the analysis of the relationship between perceptual image quality and distortion-related factors, such as distortion types and levels. Then, we propose a Distortion Graph Representation (DGR) learning framework for IQA, named GraphIQA, in which each distortion is represented as a graph, i.e., DGR. One can distinguish distortion types by learning the contrast relationship between these different DGRs, and can infer the ranking distribution of samples from different levels in a DGR. Specifically, we develop two sub-networks to learn the DGRs: a) Type Discrimination Network (TDN) that aims to embed DGR into a compact code for better discriminating distortion types and learning the relationship between types; b) Fuzzy Prediction Network (FPN) that aims to extract the distributional characteristics of the samples in a DGR and predicts fuzzy degrees based on a Gaussian prior. Experiments show that our GraphIQA achieves state-of-the-art performance on many benchmark datasets of both synthetic and authentic distortions.
引用
收藏
页码:2912 / 2925
页数:14
相关论文
共 50 条
  • [21] Blind Stereoscopic Image Quality Assessment Based on Hierarchical Learning
    Liu, Tsung-Jung
    Lin, Ching-Ti
    Liu, Hsin-Hua
    Pei, Soo-Chang
    IEEE ACCESS, 2019, 7 : 8058 - 8069
  • [22] Learning without Human Scores for Blind Image Quality Assessment
    Xue, Wufeng
    Zhang, Lei
    Mou, Xuanqin
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 995 - 1002
  • [23] Image quality assessment based on meta-learning and distortion perception
    Wan, Bingchen
    Zhang, Xuande
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (11) : 1519 - 1531
  • [24] Blind Omnidirectional Image Quality Assessment With Viewport Oriented Graph Convolutional Networks
    Xu, Jiahua
    Zhou, Wei
    Chen, Zhibo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1724 - 1737
  • [25] Blind image quality assessment
    Li, X
    2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2002, : 449 - 452
  • [26] Distortion-specific feature selection algorithm for universal blind image quality assessment
    Imran Fareed Nizami
    Muhammad Majid
    Waleed Manzoor
    Khawar Khurshid
    Byeungwoo Jeon
    EURASIP Journal on Image and Video Processing, 2019
  • [27] Distortion-specific feature selection algorithm for universal blind image quality assessment
    Nizami, Imran Fareed
    Majid, Muhammad
    Manzoor, Waleed
    Khurshid, Khawar
    Jeon, Byeungwoo
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2019, 2019 (1)
  • [28] CPDINet: Blind image quality assessment via a content perception and distortion inference network
    Shao, Xiao
    Liu, Mengqing
    Li, Zihan
    Zhang, Peiyun
    IET IMAGE PROCESSING, 2022, 16 (07) : 1973 - 1987
  • [29] Joint Distortion Restoration and Quality Feature Learning for No-reference Image Quality Assessment
    Yang, Jifan
    Wang, Zhongyuan
    Huang, Baojin
    Ai, Jiaxin
    Yang, Yuhong
    Xiong, Zixiang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (07)
  • [30] Blind image quality assessment based on hierarchical dependency learning and quality aggregation
    Xia, Jili
    He, Lihuo
    Gao, Xinbo
    Hu, Bo
    NEUROCOMPUTING, 2024, 585