Study of the Subjective and Objective Quality of High Motion Live Streaming Videos

被引:27
作者
Shang, Zaixi [1 ]
Ebenezer, Joshua Peter [1 ]
Wu, Yongjun [2 ]
Wei, Hai [2 ]
Sethuraman, Sriram [2 ]
Bovik, Alan C. [1 ]
机构
[1] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[2] Amazon Com Inc, Amazon Prime Video, Seattle, WA 98108 USA
基金
美国国家科学基金会;
关键词
Videos; Databases; Distortion; Image coding; Sports; Quality assessment; Streaming media; Live Streaming; video quality assessment; video quality database; objective VQA algorithm evaluation; DATABASE; MODEL;
D O I
10.1109/TIP.2021.3136723
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video livestreaming is gaining prevalence among video streaming service s, especially for the delivery of live, high motion content such as sport ing events. The quality of the se livestreaming videos can be adversely affected by any of a wide variety of events, including capture artifacts, and distortions incurred during coding and transmission. High motion content can cause or exacerbate many kinds of distortion, such as motion blur and stutter. Because of this, the development of objective Video Quality Assessment (VQA) algorithms that can predict the perceptual quality of high motion, live streamed videos is greatly desired. Important resources for developing these algorithms are appropriate databases that exemplify the kinds of live streaming video distortions encountered in practice. Towards making progress in this direction, we built a video quality database specifically designed for live streaming VQA research. The new video database is called the Laboratory for Image and Video Engineering (LIVE) Livestream Database. The LIVE Livestream Database includes 315 videos of 45 source sequences from 33 original contents impaired by 6 types of distortions. We also performed a subjective quality study using the new database, whereby more than 12,000 human opinions were gathered from 40 subjects. We demonstrate the usefulness of the new resource by performing a holistic evaluation of the performance of current state-of-the-art (SOTA) VQA models. We envision that researchers will find the dataset to be useful for the development, testing, and comparison of future VQA models. The LIVE Livestream database is being made publicly available for these purposes at https://live.ece. utexas.edu/research/LIVE_APV_Study/apv_index.html
引用
收藏
页码:1027 / 1041
页数:15
相关论文
共 50 条
[21]   SUBJECTIVE AND OBJECTIVE QUALITY ASSESSMENT OF PANORAMIC VIDEOS IN VIRTUAL REALITY ENVIRONMENTS [J].
Zhang, Bo ;
Zhao, Lunzhe ;
Yang, Shu ;
Zhang, Yang ;
Wang, Jing ;
Fei, Zesong .
2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2017,
[22]   LiveSense: Contextual Advertising in Live Streaming Videos [J].
Chen, Xiang ;
Nguyen, Tam V. ;
Shen, Zhiqi ;
Kankanhalli, Mohan .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :392-400
[23]   Improving quality of experience in adaptive low latency live streaming [J].
Tomasz Lyko ;
Matthew Broadbent ;
Nicholas Race ;
Mike Nilsson ;
Paul Farrow ;
Steve Appleby .
Multimedia Tools and Applications, 2024, 83 :15957-15983
[24]   Subjective and Objective Quality Assessment of Multi-Attribute Retouched Face Images [J].
Yue, Guanghui ;
Wu, Honglv ;
Yan, Weiqing ;
Zhou, Tianwei ;
Liu, Hantao ;
Zhou, Wei .
IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (02) :570-583
[25]   Subjective and Objective Quality Assessment of Non-Uniformly Distorted Omnidirectional Images [J].
Yan, Jiebin ;
Rao, Jiale ;
Liu, Xuelin ;
Fang, Yuming ;
Zuo, Yifan ;
Liu, Weide .
IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 :2695-2707
[26]   Improving quality of experience in adaptive low latency live streaming [J].
Lyko, Tomasz ;
Broadbent, Matthew ;
Race, Nicholas ;
Nilsson, Mike ;
Farrow, Paul ;
Appleby, Steve .
MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) :15957-15983
[27]   Tweeting Videos: Coordinate Live Streaming and Storage Sharing [J].
Cheng, Xu ;
Liu, Jiangchuan .
NOSSDAV 2010: PROCEEDINGS OF THE 20TH INTERNATIONAL WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO, 2010, :15-20
[28]   Study of Subjective and Objective Quality Assessment of Video [J].
Seshadrinathan, Kalpana ;
Soundararajan, Rajiv ;
Bovik, Alan Conrad ;
Cormack, Lawrence K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (06) :1427-1441
[29]   Blindly Assess Quality of In-the-Wild Videos via Quality-Aware Pre-Training and Motion Perception [J].
Li, Bowen ;
Zhang, Weixia ;
Tian, Meng ;
Zhai, Guangtao ;
Wang, Xianpei .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) :5944-5958
[30]   Estimation techniques to measure subjective quality on live video streaming in Cloud Mobile Media services [J].
Garcia-Pineda, Miguel ;
Segura-Garcia, Jaume ;
Felici-Castell, Santiago .
COMPUTER COMMUNICATIONS, 2018, 118 :27-39