Contrastive distortion-level learning-based no-reference image-quality assessment

被引:14
作者
Wei, Xuekai [1 ]
Li, Jing [2 ]
Zhou, Mingliang [1 ]
Wang, Xianmin [2 ,3 ]
机构
[1] Chongqing Univ, Sch Comp Sci, Chongqing, Peoples R China
[2] Guangzhou Univ, Sch Comp Sci & Cyber Engn, Guangzhou 510002, Peoples R China
[3] Guangzhou Univ, Inst Artificial Intelligence & Blockchain, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
contrastive learning; no-reference image-quality assessment; representation learning; unsupervised learning; DEEP;
D O I
10.1002/int.22965
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A contrastive distortion-level learning-based no-reference image-quality assessment (NR-IQA) framework is proposed in this study to further effectively model various distortion types with the same or different distortion levels. The proposed method aims to improve the prediction accuracy of NR-IQA. The proposed method consists of three parts: multiscale distortion-level representation learning, single-image NR-IQA, and a representation affinity module, which can reduce NR-IQA computational complexity while maintaining a low-distortion representation of high-distortion inputs. The proposed NR-IQA method aims to extract distributional features of samples in real distorted images and predict ambiguity based on distortion-level learning. Experimental results show that by comparing on many NR-IQA data sets the proposed method can outperform state-of-the-art methods.
引用
收藏
页码:8730 / 8746
页数:17
相关论文
共 61 条
[1]   Contrastive Feature Loss for Image Prediction [J].
Andonian, Alex ;
Park, Taesung ;
Russell, Bryan ;
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhang, Richard .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :1934-1943
[2]   Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment [J].
Bosse, Sebastian ;
Maniry, Dominique ;
Mueller, Klaus-Robert ;
Wiegand, Thomas ;
Samek, Wojciech .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :206-219
[3]   Full-reference Screen Content Image Quality Assessment by Fusing Multilevel Structure Similarity [J].
Chen, Chenglizhao ;
Zhao, Hongmeng ;
Yang, Huan ;
Yu, Teng ;
Peng, Chong ;
Qin, Hong .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (03)
[4]  
Chen T., 2020, ARXIV PREPRINT ARXIV
[5]   Perceptual Image Quality Assessment with Transformers [J].
Cheon, Manri ;
Yoon, Sung-Jun ;
Kang, Byungyeon ;
Lee, Junwoo .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :433-442
[6]  
Ding K., 2021, LOCALLY ADAPTIVE STR, P2483, DOI [10.1145/3474085.3475419, DOI 10.1145/3474085.3475419]
[7]   Image Quality Assessment: Unifying Structure and Texture Similarity [J].
Ding, Keyan ;
Ma, Kede ;
Wang, Shiqi ;
Simoncelli, Eero P. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (05) :2567-2581
[8]   Intrinsic Image Popularity Assessment [J].
Ding, Keyan ;
Ma, Kede ;
Wang, Shiqi .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :1979-1987
[9]  
Elsayed Gamaleldin, 2018, Advances in neural information processing systems
[10]   MAS-Encryption and its Applications in Privacy-Preserving Classifiers [J].
Gao, Chong-zhi ;
Li, Jin ;
Xia, Shibing ;
Choo, Kim-Kwang Raymond ;
Lou, Wenjing ;
Dong, Changyu .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (05) :2306-2323