Perceptual Quality Assessment of Video Considering Both Frame Rate and Quantization Artifacts

被引:119
作者
Ou, Yen-Fu [1 ]
Ma, Zhan [1 ]
Liu, Tao [2 ]
Wang, Yao [1 ]
机构
[1] NYU, Polytech Inst, Brooklyn, NY 11201 USA
[2] Dial Res Inc, Eatontown, NJ 07724 USA
基金
美国国家科学基金会;
关键词
Content features; frame rate; scalable video; video quality model; BIT-RATE; IMPACT;
D O I
10.1109/TCSVT.2010.2087833
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we explore the impact of frame rate and quantization on perceptual quality of a video. We propose to use the product of a spatial quality factor that assesses the quality of decoded frames without considering the frame rate effect and a temporal correction factor, which reduces the quality assigned by the first factor according to the actual frame rate. We find that the temporal correction factor follows closely an inverted falling exponential function, whereas the quantization effect on the coded frames can be captured accurately by a sigmoid function of the peak signal-to-noise ratio. The proposed model is analytically simple, with each function requiring only a single content-dependent parameter. The proposed overall metric has been validated using both our subjective test scores as well as those reported by others. For all seven data sets examined, our model yields high Pearson correlation (higher than 0.9) with measured mean opinion score (MOS). We further investigate how to predict parameters of our proposed model using content features derived from the original videos. Using predicted parameters from content features, our model still fits with measured MOS with high correlation.
引用
收藏
页码:286 / 298
页数:13
相关论文
共 22 条
[1]  
[Anonymous], P910 ITUR
[2]  
[Anonymous], MatLab and octave functions for computer vision and image processing
[3]  
[Anonymous], 2020, INT TELECOMMUNICATIO
[4]   Review of low frame rate effects on human performance [J].
Chen, Jessie Y. C. ;
Thropp, Jennifer E. .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2007, 37 (06) :1063-1076
[5]   Video quality metric for bit rate, control via joint adjustment of quantization and frame rate [J].
Feghali, Rosario ;
Speranza, Filippo ;
Wang, Demin ;
Vincent, Andre .
IEEE TRANSACTIONS ON BROADCASTING, 2007, 53 (01) :441-446
[6]   Temporal aspect of perceived quality in mobile video broadcasting [J].
Huynh-Thu, Quan ;
Ghanbari, Mohammed .
IEEE TRANSACTIONS ON BROADCASTING, 2008, 54 (03) :641-651
[7]  
*ISO IEC MPEG JVT, 2007, JVTX202DOC ISOIEC MP
[8]   MPEG-7 visual motion descriptors [J].
Jeannin, S ;
Divakaran, A .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2001, 11 (06) :720-724
[9]   Quality measurement modeling on scalable video applications [J].
Jin, Sung Ho ;
Kim, Cheon Seog ;
Seo, Dong Jun ;
Ro, Yong Man .
2007 IEEE NINTH WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 2007, :131-134
[10]   Measuring the negative impact of frame dropping on perceptual visual quality [J].
Lu, ZK ;
Lin, W ;
Seng, BC ;
Kato, S ;
Yao, S ;
Ong, E ;
Yang, XK .
HUMAN VISION AND ELECTRONIC IMAGING X, 2005, 5666 :554-562