Saliency-Guided Quality Assessment of Screen Content Images

被引:248
作者
Gu, Ke [1 ,2 ]
Wang, Shiqi [3 ]
Yang, Huan [1 ]
Lin, Weisi [1 ]
Zhai, Guangtao [2 ]
Yang, Xiaokang [2 ]
Zhang, Wenjun [2 ]
机构
[1] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[2] Shanghai Jiao Tong Univ, Inst Image Commun & Informat Proc, Shanghai 200240, Peoples R China
[3] Peking Univ, Inst Digital Media, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
基金
美国国家科学基金会;
关键词
Image quality assessment (IQA); screen content images (SCI); visual saliency; VISUAL-ATTENTION; NEURAL MECHANISMS; MODEL; INFORMATION;
D O I
10.1109/TMM.2016.2547343
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the widespread adoption of multidevice communication, such as telecommuting, screen content images (SCIs) have become more closely and frequently related to our daily lives. For SCIs, the tasks of accurate visual quality assessment, high-efficiency compression, and suitable contrast enhancement have thus currently attracted increased attention. In particular, the quality evaluation of SCIs is important due to its good ability for instruction and optimization in various processing systems. Hence, in this paper, we develop a new objective metric for research on perceptual quality assessment of distorted SCIs. Compared to the classical MSE, our method, which mainly relies on simple convolution operators, first highlights the degradations in structures caused by different types of distortions and then detects salient areas where the distortions usually attract more attention. A comparison of our algorithm with the most popular and state-of-the-art quality measures is performed on two new SCI databases (SIQAD and SCD). Extensive results are provided to verify the superiority and efficiency of the proposed IQA technique.
引用
收藏
页码:1098 / 1110
页数:13
相关论文
共 52 条
[1]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[2]  
[Anonymous], 2012, BT50013 ITU
[3]  
[Anonymous], 2000, Final report from the video quality experts group on the validation of objective models of video quality assessment
[4]  
[Anonymous], 2007, PROC IEEE C COMPUT V, DOI 10.1109/CVPR.2007.383267
[5]   State-of-the-Art in Visual Attention Modeling [J].
Borji, Ali ;
Itti, Laurent .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :185-207
[6]   Saliency, attention, and visual search: An information theoretic approach [J].
Bruce, Neil D. B. ;
Tsotsos, John K. .
JOURNAL OF VISION, 2009, 9 (03)
[7]   VSNR: A wavelet-based visual signal-to-noise ratio for natural images [J].
Chandler, Damon M. ;
Hemami, Sheila S. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (09) :2284-2298
[8]   Image quality assessment based on a degradation model [J].
Damera-Venkata, N ;
Kite, TD ;
Geisler, WS ;
Evans, BL ;
Bovik, AC .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (04) :636-650
[9]   Neural Mechanisms of Selective Visual Attention [J].
Moore, Tirin ;
Zirnsak, Marc .
ANNUAL REVIEW OF PSYCHOLOGY, VOL 68, 2017, 68 :47-72
[10]   Visual Attention in Quality Assessment [J].
Engelke, Ulrich ;
Kaprykowsky, Hagen ;
Zepernick, Hans-Jurgen ;
Ndjiki-Nya, Patrick .
IEEE SIGNAL PROCESSING MAGAZINE, 2011, 28 (06) :50-59