A Completely Blind Video Integrity Oracle

被引:290
作者
Mittal, Anish [1 ,2 ]
Saad, Michele A. [1 ,2 ]
Bovik, Alan C. [1 ,2 ]
机构
[1] Intel Corp, HERE, Santa Clara, CA 95051 USA
[2] Univ Texas Austin, Dept Elect & Comp Engn, Lab Image & Video Engn, Austin, TX 78712 USA
关键词
Intrinsic video statistics; quality assessment; temporal self similarity; spatial domain; IMAGE QUALITY ASSESSMENT; NO-REFERENCE VIDEO; AREA V2; RESPONSES; NEURONS; REPRESENTATION; PREDICTION; SPACE; V1;
D O I
10.1109/TIP.2015.2502725
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Considerable progress has been made toward developing still picture perceptual quality analyzers that do not require any reference picture and that are not trained on human opinion scores of distorted images. However, there do not yet exist any such completely blind video quality assessment (VQA) models. Here, we attempt to bridge this gap by developing a new VQA model called the video intrinsic integrity and distortion evaluation oracle (VIIDEO). The new model does not require the use of any additional information other than the video being quality evaluated. VIIDEO embodies models of intrinsic statistical regularities that are observed in natural vidoes, which are used to quantify disturbances introduced due to distortions. An algorithm derived from the VIIDEO model is thereby able to predict the quality of distorted videos without any external knowledge about the pristine source, anticipated distortions, or human judgments of video quality. Even with such a paucity of information, we are able to show that the VIIDEO algorithm performs much better than the legacy full reference quality measure MSE on the LIVE VQA database and delivers performance comparable with a leading human judgment trained blind VQA model. We believe that the VIIDEO algorithm is a significant step toward making real-time monitoring of completely blind video quality possible. The software release of VIIDEO can be obtained online (http://live.ece.utexas.edu/research/quality/VIIDEO_release.zip).
引用
收藏
页码:289 / 300
页数:12
相关论文
共 51 条
[41]   Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing [J].
Soundararajan, Rajiv ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2013, 23 (04) :684-694
[42]   Perceptual quality metric for digital video coding [J].
Suthaharan, S .
ELECTRONICS LETTERS, 2003, 39 (05) :431-433
[43]   Blockiness detection for MPEG2-coded video [J].
Tan, KT ;
Ghanbari, M .
IEEE SIGNAL PROCESSING LETTERS, 2000, 7 (08) :213-215
[44]   Detection of blocking artifacts in compressed video [J].
Vlachos, T .
ELECTRONICS LETTERS, 2000, 36 (13) :1106-1108
[45]  
Vu P. V., 2011, 2011 18th IEEE International Conference on Image Processing (ICIP 2011), P2505, DOI 10.1109/ICIP.2011.6116171
[46]  
Wang Z, 2003, CONF REC ASILOMAR C, P1398
[47]   Democratizing Signal Processing [J].
Wang, Z. Jane ;
Deng, Li .
IEEE SIGNAL PROCESSING MAGAZINE, 2011, 28 (02) :2-4
[48]   Neural Representation of Natural Images in Visual Area V2 [J].
Willmore, Ben D. B. ;
Prenger, Ryan J. ;
Gallant, Jack L. .
JOURNAL OF NEUROSCIENCE, 2010, 30 (06) :2102-2114
[49]   Comprehensive evaluation system for coal quality impacts on boiler performance [J].
Yamashita, Toru ;
Cheng, Qingning ;
Asotani, Toshimitsu .
PROCEEDINGS OF THE 6TH INTERNATIONAL SYMPOSIUM ON COAL COMBUSTION, 2007, :288-293
[50]   A novel objective no-reference metric for digital video quality assessment [J].
Yang, FZ ;
Wan, SA ;
Chang, YL ;
Wu, HR .
IEEE SIGNAL PROCESSING LETTERS, 2005, 12 (10) :685-688