Visual quality assessment algorithms: what does the future hold?

被引:82
作者
Moorthy, Anush Krishna [1 ]
Bovik, Alan Conrad [1 ]
机构
[1] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
基金
美国国家科学基金会;
关键词
Quality assessment; Objective quality assessment; Subjective quality assessment; Perceived quality; VIDEO QUALITY; IMAGE SHARPNESS; AUDIO QUALITY; STATISTICS; AESTHETICS; VISIBILITY; BLUR;
D O I
10.1007/s11042-010-0640-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Creating algorithms capable of predicting the perceived quality of a visual stimulus defines the field of objective visual quality assessment (QA). The field of objective QA has received tremendous attention in the recent past, with many successful algorithms being proposed for this purpose. Our concern here is not with the past however; in this paper we discuss our vision for the future of visual quality assessment research. We first introduce the area of quality assessment and state its relevance. We describe current standards for gauging algorithmic performance and define terms that we will use through this paper. We then journey through 2D image and video quality assessment. We summarize recent approaches to these problems and discuss in detail our vision for future research on the problems of full-reference and no-reference 2D image and video quality assessment. From there, we move on to the currently popular area of 3D QA. We discuss recent databases, algorithms and 3D quality of experience. This yet-nascent technology provides for tremendous scope in terms of research activities and we summarize each of them. We then move on to more esoteric topics such as algorithmic assessment of aesthetics in natural images and in art. We discuss current research and hypothesize about possible paths to tread. Towards the end of this article, we discuss some other areas of interest including high-definition (HD) quality assessment, immersive environments and so on before summarizing interesting avenues for future work in multimedia (i.e., audio-visual) quality assessment. © 2010 Springer Science+Business Media, LLC.
引用
收藏
页码:675 / 696
页数:22
相关论文
共 92 条
[81]  
Wang Z, 2002, IEEE IMAGE PROC, P477
[82]  
WANG Z, 2006, MODERN IMAGE QUALITY, V2
[83]   Video quality assessment using a statistical model of human visual speed perception [J].
Wang, Zhou ;
Li, Qiang .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2007, 24 (12) :B61-B69
[84]   Quality-aware images [J].
Wang, Zhou ;
Wu, Guixing ;
Sheikh, Hamid Rahim ;
Simoncelli, Eero P. ;
Yang, En-Hui ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (06) :1680-1689
[85]   Maximum differentiation (MAD) competition: A methodology for comparing computational models of perceptual quantities [J].
Wang, Zhou ;
Simoncelli, Eero P. .
JOURNAL OF VISION, 2008, 8 (12)
[86]   Mean Squared Error: Love It or Leave It? A new look at signal fidelity measures [J].
Wang, Zhou ;
Bovik, Alan C. .
IEEE SIGNAL PROCESSING MAGAZINE, 2009, 26 (01) :98-117
[87]   Video quality evaluation for mobile applications [J].
Winkler, S ;
Dufaux, F .
VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2003, PTS 1-3, 2003, 5150 :593-603
[88]  
Winkler S., 2001, P INT S WIRELESS PER, P547
[89]   Perceptual temporal quality metric for compressed video [J].
Yang, Kai-Chieh ;
Guest, Clark C. ;
El-Maleh, Khaled ;
Das, Pankaj K. .
IEEE TRANSACTIONS ON MULTIMEDIA, 2007, 9 (07) :1528-1535
[90]  
Yarbus A. L., 1967, Eye movements and vision