Study of the Subjective and Objective Quality of High Motion Live Streaming Videos

被引:28
作者
Shang, Zaixi [1 ]
Ebenezer, Joshua Peter [1 ]
Wu, Yongjun [2 ]
Wei, Hai [2 ]
Sethuraman, Sriram [2 ]
Bovik, Alan C. [1 ]
机构
[1] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[2] Amazon Com Inc, Amazon Prime Video, Seattle, WA 98108 USA
基金
美国国家科学基金会;
关键词
Videos; Databases; Distortion; Image coding; Sports; Quality assessment; Streaming media; Live Streaming; video quality assessment; video quality database; objective VQA algorithm evaluation; DATABASE; MODEL;
D O I
10.1109/TIP.2021.3136723
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video livestreaming is gaining prevalence among video streaming service s, especially for the delivery of live, high motion content such as sport ing events. The quality of the se livestreaming videos can be adversely affected by any of a wide variety of events, including capture artifacts, and distortions incurred during coding and transmission. High motion content can cause or exacerbate many kinds of distortion, such as motion blur and stutter. Because of this, the development of objective Video Quality Assessment (VQA) algorithms that can predict the perceptual quality of high motion, live streamed videos is greatly desired. Important resources for developing these algorithms are appropriate databases that exemplify the kinds of live streaming video distortions encountered in practice. Towards making progress in this direction, we built a video quality database specifically designed for live streaming VQA research. The new video database is called the Laboratory for Image and Video Engineering (LIVE) Livestream Database. The LIVE Livestream Database includes 315 videos of 45 source sequences from 33 original contents impaired by 6 types of distortions. We also performed a subjective quality study using the new database, whereby more than 12,000 human opinions were gathered from 40 subjects. We demonstrate the usefulness of the new resource by performing a holistic evaluation of the performance of current state-of-the-art (SOTA) VQA models. We envision that researchers will find the dataset to be useful for the development, testing, and comparison of future VQA models. The LIVE Livestream database is being made publicly available for these purposes at https://live.ece. utexas.edu/research/LIVE_APV_Study/apv_index.html
引用
收藏
页码:1027 / 1041
页数:15
相关论文
共 50 条
[41]   SUBJECTIVE AND OBJECTIVE QUALITY EVALUATION OF LAR CODED ART IMAGES [J].
Strauss, C. ;
Pasteau, F. ;
Autrusseau, F. ;
Babel, M. ;
Bedat, L. ;
Deforges, O. .
ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, :674-+
[42]   Quality-of-Experience for Adaptive Streaming Videos: An Expectation Confirmation Theory Motivated Approach [J].
Duanmu, Zhengfang ;
Ma, Kede ;
Wang, Zhou .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (12) :6135-6146
[43]   A Bayesian Quality-of-Experience Model for Adaptive Streaming Videos [J].
Duanmu, Zhengfang ;
Liu, Wentao ;
Chen, Diqi ;
Li, Zhuoran ;
Wang, Zhou ;
Wang, Yizhou ;
Gao, Wen .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (03)
[44]   On the Effect of Standing and Seated Viewing of 360° Videos on Subjective Quality Assessment: A Pilot Study [J].
Hu, Yan ;
Elwardy, Majed ;
Zepernick, Hans-Jurgen .
COMPUTERS, 2021, 10 (06)
[45]   High cardiac vagal control is related to better subjective and objective sleep quality [J].
Werner, Gabriela G. ;
Ford, Brett Q. ;
Mauss, Iris B. ;
Schabus, Manuel ;
Blechert, Jens ;
Wilhelm, Frank H. .
BIOLOGICAL PSYCHOLOGY, 2015, 106 :79-85
[46]   A Novel Objective Quality Assessment Method for Transcoded Videos From H.264/AVC to H.265/HEVC Utilizing Probability Theory [J].
Shang, Xiwu ;
Zhao, Haiwu ;
Wang, Guozhong ;
Zhao, Xiaoli ;
Zuo, Yifan .
IEEE TRANSACTIONS ON BROADCASTING, 2019, 65 (04) :777-781
[47]   OBJECTIVE QUALITY ASSESSMENT OF TONE-MAPPED VIDEOS [J].
Yeganeh, Hojatollah ;
Wang, Shiqi ;
Zeng, Kai ;
Eisapour, Mahzar ;
Wang, Zhou .
2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, :899-903
[48]   Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos [J].
Seshadrinathan, Kalpana ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (02) :335-350
[49]   Improving Perceived Quality of Live Adaptative Video Streaming [J].
Maffini Santos, Carlos Eduardo ;
Gouvea da Silva, Carlos Alexandre ;
Pedroso, Carlos Marcelo .
ENTROPY, 2021, 23 (08)
[50]   A Subjective Study on Videos at Various Bit Depths [J].
Mackin, Alex ;
Ma, Di ;
Zhang, Fan ;
Bull, David .
2021 PICTURE CODING SYMPOSIUM (PCS), 2021, :281-285