A Completely Blind Video Integrity Oracle

被引:290
作者
Mittal, Anish [1 ,2 ]
Saad, Michele A. [1 ,2 ]
Bovik, Alan C. [1 ,2 ]
机构
[1] Intel Corp, HERE, Santa Clara, CA 95051 USA
[2] Univ Texas Austin, Dept Elect & Comp Engn, Lab Image & Video Engn, Austin, TX 78712 USA
关键词
Intrinsic video statistics; quality assessment; temporal self similarity; spatial domain; IMAGE QUALITY ASSESSMENT; NO-REFERENCE VIDEO; AREA V2; RESPONSES; NEURONS; REPRESENTATION; PREDICTION; SPACE; V1;
D O I
10.1109/TIP.2015.2502725
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Considerable progress has been made toward developing still picture perceptual quality analyzers that do not require any reference picture and that are not trained on human opinion scores of distorted images. However, there do not yet exist any such completely blind video quality assessment (VQA) models. Here, we attempt to bridge this gap by developing a new VQA model called the video intrinsic integrity and distortion evaluation oracle (VIIDEO). The new model does not require the use of any additional information other than the video being quality evaluated. VIIDEO embodies models of intrinsic statistical regularities that are observed in natural vidoes, which are used to quantify disturbances introduced due to distortions. An algorithm derived from the VIIDEO model is thereby able to predict the quality of distorted videos without any external knowledge about the pristine source, anticipated distortions, or human judgments of video quality. Even with such a paucity of information, we are able to show that the VIIDEO algorithm performs much better than the legacy full reference quality measure MSE on the LIVE VQA database and delivers performance comparable with a leading human judgment trained blind VQA model. We believe that the VIIDEO algorithm is a significant step toward making real-time monitoring of completely blind video quality possible. The software release of VIIDEO can be obtained online (http://live.ece.utexas.edu/research/quality/VIIDEO_release.zip).
引用
收藏
页码:289 / 300
页数:12
相关论文
共 51 条
[21]   MULTISCALE SKEWED HEAVY TAILED MODEL FOR TEXTURE ANALYSIS [J].
Lasmar, Nour-Eddine ;
Stitou, Youssef ;
Berthoumieu, Yannick .
2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, :2281-2284
[22]   Image analysis for video artifact estimation and measurement [J].
Lu, JH .
MACHINE VISION APPLICATIONS IN INDUSTRIAL INSPECTION IX, 2001, 4301 :166-174
[23]   No reference video quality estimation based on human visual system for 2.5/36 devices [J].
Massidda, F ;
Giusto, DD ;
Perra, C .
HUMAN VISION AND ELECTRONIC IMAGING X, 2005, 5666 :168-179
[24]   Making a "Completely Blind" Image Quality Analyzer [J].
Mittal, Anish ;
Soundararajan, Rajiv ;
Bovik, Alan C. .
IEEE SIGNAL PROCESSING LETTERS, 2013, 20 (03) :209-212
[25]   No-Reference Image Quality Assessment in the Spatial Domain [J].
Mittal, Anish ;
Moorthy, Anush Krishna ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (12) :4695-4708
[26]   Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies [J].
Moorthy, Anush Krishna ;
Choi, Lark Kwon ;
Bovik, Alan Conrad ;
de Veciana, Gustavo .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2012, 6 (06) :652-671
[27]   Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality [J].
Moorthy, Anush Krishna ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (12) :3350-3364
[28]  
Muijs R., 2005, 2005 13th European Signal Processing Conference, P1
[29]   NO-REFERENCE MODELING OF THE CHANNEL INDUCED DISTORTION AT THE DECODER FOR H.264/AVC VIDEO CODING [J].
Naccari, Matteo ;
Tagliasacchi, Marco ;
Pereira, Fernando ;
Tubaro, Stefano .
2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, :2324-2327
[30]   VIDEO QUALITY MONITORING OF STREAMED VIDEOS [J].
Ong, Ee Ping ;
Wu, Shiqian ;
Loke, Mei Hwan ;
Rahardja, Susanto ;
Tay, Jason ;
Tan, Cheng Kok ;
Huang, Lei .
2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, :1153-+