Graph-Represented Distribution Similarity Index for Full-Reference Image Quality Assessment

被引:15
作者
Shen, Wenhao [1 ]
Zhou, Mingliang [1 ]
Luo, Jun [2 ]
Li, Zhengguo [3 ]
Kwong, Sam [4 ]
机构
[1] Chongqing Univ, Sch Comp Sci, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Sch Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[3] Agcy Sci Technol & Res, Inst Infocomm Res, Singapore 138632, Singapore
[4] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Distortion; Image quality; Distortion measurement; Visualization; Indexes; Image edge detection; Task analysis; Image quality assessment; full reference; graph convolutional neural network; graph distribution; STRUCTURAL SIMILARITY; DIFFERENCE; DEVIATION; NETWORK; DEEP;
D O I
10.1109/TIP.2024.3390565
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a graph-represented image distribution similarity (GRIDS) index for full-reference (FR) image quality assessment (IQA), which can measure the perceptual distance between distorted and reference images by assessing the disparities between their distribution patterns under a graph-based representation. First, we transform the input image into a graph-based representation, which is proven to be a versatile and effective choice for capturing visual perception features. This is achieved through the automatic generation of a vision graph from the given image content, leading to holistic perceptual associations for irregular image regions. Second, to reflect the perceived image distribution, we decompose the undirected graph into cliques and then calculate the product of the potential functions for the cliques to obtain the joint probability distribution of the undirected graph. Finally, we compare the distances between the graph feature distributions of the distorted and reference images at different stages; thus, we combine the distortion distribution measurements derived from different graph model depths to determine the perceived quality of the distorted images. The empirical results obtained from an extensive array of experiments underscore the competitive nature of our proposed method, which achieves performance on par with that of the state-of-the-art methods, demonstrating its exceptional predictive accuracy and ability to maintain consistent and monotonic behaviour in image quality prediction tasks. The source code is publicly available at the following website https://github.com/Land5cape/GRIDS.
引用
收藏
页码:3075 / 3089
页数:15
相关论文
共 82 条
[1]   From Sparse Coding Significance to Perceptual Quality: A New Approach for Image Quality Assessment [J].
Ahar, Ayyoub ;
Barri, Adriaan ;
Schelkens, Peter .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (02) :879-893
[2]   Deep Learning-based Distortion Sensitivity Prediction for Full-Reference Image Quality Assessment [J].
Ahn, Sewoong ;
Choi, Yeji ;
Yoon, Kwangjin .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :344-353
[3]   TOWARDS A POINT CLOUD STRUCTURAL SIMILARITY METRIC [J].
Alexiou, Evangelos ;
Ebrahimi, Touradj .
2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
[4]   A Novel Image Quality Assessment With Globally and Locally Consilient Visual Quality Perception [J].
Bae, Sung-Ho ;
Kim, Munchurl .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (05) :2392-2406
[5]   Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment [J].
Bosse, Sebastian ;
Maniry, Dominique ;
Mueller, Klaus-Robert ;
Wiegand, Thomas ;
Samek, Wojciech .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :206-219
[6]  
Bruna J, 2014, Arxiv, DOI arXiv:1312.6203
[7]   Incorporating Semi-Supervised and Positive-Unlabeled Learning for Boosting Full Reference Image Quality Assessment [J].
Cao, Yue ;
Wan, Zhaolin ;
Ren, Dongwei ;
Yan, Zifei ;
Zuo, Wangmeng .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5841-5851
[8]   Gradient-based structural similarity for image quality assessment [J].
Chen, Guan-Hao ;
Yang, Chun-Ling ;
Xie, Sheng-Li .
2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, :2929-+
[9]   ProxIQA: A Proxy Approach to Perceptual Optimization of Learned Image Compression [J].
Chen, Li-Heng ;
Bampis, Christos G. ;
Li, Zhi ;
Norkin, Andrey ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :360-373
[10]   Perceptual Image Quality Assessment with Transformers [J].
Cheon, Manri ;
Yoon, Sung-Jun ;
Kang, Byungyeon ;
Lee, Junwoo .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :433-442