Study of the Subjective and Objective Quality of High Motion Live Streaming Videos

被引:28
作者
Shang, Zaixi [1 ]
Ebenezer, Joshua Peter [1 ]
Wu, Yongjun [2 ]
Wei, Hai [2 ]
Sethuraman, Sriram [2 ]
Bovik, Alan C. [1 ]
机构
[1] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[2] Amazon Com Inc, Amazon Prime Video, Seattle, WA 98108 USA
基金
美国国家科学基金会;
关键词
Videos; Databases; Distortion; Image coding; Sports; Quality assessment; Streaming media; Live Streaming; video quality assessment; video quality database; objective VQA algorithm evaluation; DATABASE; MODEL;
D O I
10.1109/TIP.2021.3136723
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video livestreaming is gaining prevalence among video streaming service s, especially for the delivery of live, high motion content such as sport ing events. The quality of the se livestreaming videos can be adversely affected by any of a wide variety of events, including capture artifacts, and distortions incurred during coding and transmission. High motion content can cause or exacerbate many kinds of distortion, such as motion blur and stutter. Because of this, the development of objective Video Quality Assessment (VQA) algorithms that can predict the perceptual quality of high motion, live streamed videos is greatly desired. Important resources for developing these algorithms are appropriate databases that exemplify the kinds of live streaming video distortions encountered in practice. Towards making progress in this direction, we built a video quality database specifically designed for live streaming VQA research. The new video database is called the Laboratory for Image and Video Engineering (LIVE) Livestream Database. The LIVE Livestream Database includes 315 videos of 45 source sequences from 33 original contents impaired by 6 types of distortions. We also performed a subjective quality study using the new database, whereby more than 12,000 human opinions were gathered from 40 subjects. We demonstrate the usefulness of the new resource by performing a holistic evaluation of the performance of current state-of-the-art (SOTA) VQA models. We envision that researchers will find the dataset to be useful for the development, testing, and comparison of future VQA models. The LIVE Livestream database is being made publicly available for these purposes at https://live.ece. utexas.edu/research/LIVE_APV_Study/apv_index.html
引用
收藏
页码:1027 / 1041
页数:15
相关论文
共 50 条
[31]   Quality Assessment of Free-Viewpoint Videos by Quantifying the Elastic Changes of Multi-Scale Motion Trajectories [J].
Ling, Suiyi ;
Li, Jing ;
Che, Zhaohui ;
Min, Xiongkuo ;
Zhai, Guangtao ;
Le Callet, Patrick .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :517-531
[32]   Study on the Assessment of the Quality of Experience of Streaming Video [J].
Ivchenko, A., V ;
Kononyuk, P. A. ;
Dvorkovich, A., V ;
Antiufrieva, L. A. .
2020 SYSTEMS OF SIGNAL SYNCHRONIZATION, GENERATING AND PROCESSING IN TELECOMMUNICATIONS (SYNCHROINFO), 2020,
[33]   Subjective and objective study of sharpness enhanced UGC video quality [J].
Wang, Haiqiang ;
Liu, Shan .
APPLICATIONS OF DIGITAL IMAGE PROCESSING XLIV, 2021, 11842
[34]   Subjective and Objective Quality Assessment for Stereoscopic Image Retargeting [J].
Fu, Zhenqi ;
Shao, Feng ;
Jiang, Qiuping ;
Meng, Xiangchao ;
Ho, Yo-Sung .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :2100-2113
[35]   Subjective and Objective Quality Assessment of Audio Source Separation [J].
Emiya, Valentin ;
Vincent, Emmanuel ;
Harlander, Niklas ;
Hohmann, Volker .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2011, 19 (07) :2046-2057
[36]   Subjective Quality Database and Objective Study of Compressed Point Clouds With 6DoF Head-Mounted Display [J].
Wu, Xinju ;
Zhang, Yun ;
Fan, Chunling ;
Hou, Junhui ;
Kwong, Sam .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) :4630-4644
[37]   Subjective and Objective Quality Assessment of MPEG-2, H.264 and H.265 Videos [J].
Bajcinovci, Viliams ;
Vranjes, Mario ;
Babic, Danijel ;
Kovacevic, Branimir .
PROCEEDINGS OF 2017 INTERNATIONAL SYMPOSIUM ELMAR, 2017, :73-77
[38]   On the Subjective Assessment of the Perceived Quality of Medical Images and Videos [J].
Leveque, Lucie ;
Liu, Hantao ;
Barakovic, Sabina ;
Husic, Jasmina Barakovic ;
Martini, Maria ;
Outtas, Meriem ;
Zhang, Lu ;
Kumcu, Asli ;
Platisa, Ljiljana ;
Rodrigues, Rafael ;
Pinheiro, Antonio ;
Skodras, Athanassios .
2018 TENTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2018, :258-263
[39]   Wireless Video Quality Assessment: A Study of Subjective Scores and Objective Algorithms [J].
Moorthy, Anush Krishna ;
Seshadrinathan, Kalpana ;
Soundararajan, Rajiv ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2010, 20 (04) :587-599
[40]   Subjective and Objective Analysis of Indian Social Media Video Quality [J].
Mishra, Sandeep ;
Jha, Mukul ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 :140-153