TVG-Streaming: Learning User Behaviors for QoE-Optimized 360-Degree Video Streaming

被引:23
作者
Hu, Miao [1 ,2 ]
Chen, Jiawen [1 ,2 ]
Wu, Di [1 ,2 ,3 ]
Zhou, Yipeng [3 ,4 ]
Wang, Yi [5 ]
Dai, Hong-Ning [6 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Guangdong Key Lab Big Data Anal & Proc, Guangzhou 510006, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518000, Peoples R China
[4] Macquarie Univ, Fac Sci & Engn, Sydney, NSW 2109, Australia
[5] Southern Univ Sci & Technol, SUSTech Inst Future Networks, Shenzhen 518055, Peoples R China
[6] Macau Univ Sci & Technol, Fac Informat Technol, Taipa, Macao, Peoples R China
基金
中国国家自然科学基金;
关键词
Streaming media; Quality of experience; Bandwidth; Bit rate; Linear regression; Switches; Predictive models; 360-degree video; streaming; tile-view graph;
D O I
10.1109/TCSVT.2020.3046242
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
360-degree video streaming shows great potential to revolutionize the streaming market, by providing much better immersive experience than standard video streams. However, its wide adoption is hindered by the surging demand of network bandwidth due to multi-screen video transmission. To reduce the bandwidth cost, one promising approach is to predict a user's field of view (FoV), and then prefetch video tiles that a user will view a few seconds ahead. The challenge lies in that user behaviors cannot be properly captured with very limited information, especially the viewing time spent on each tile and the FoV switching behavior are hard to predict. In this paper, we propose a novel 360-degree video streaming algorithm called TVG-Streaming to optimize user experiences by learning user view behaviors. Different from previous approaches, our idea is to exploit tile-view graphs (TVGs) generated by real user behaviors and accurately estimate the probability that each tile falls in the FoV. With the tile view probability, we can determine the bitrate of each tile for delivery and buffering with limited bandwidth budget so as to maximize users' quality of experience (QoE). For evaluation, we conduct extensive experiments using real traces and the results show that our proposed TVG-Streaming algorithm significantly outperforms other algorithms by at least 20% improvement in terms of users' QoE.
引用
收藏
页码:4107 / 4120
页数:14
相关论文
共 42 条
[1]   Characterization of 360-degree Videos [J].
Afzal, Shahryar ;
Chen, Jiasi ;
Ramakrishnan, K. K. .
VR/AR NETWORK '17: PROCEEDINGS OF THE 2017 WORKSHOP ON VIRTUAL REALITY AND AUGMENTED REALITY NETWORK, 2017, :1-6
[2]   Interactive Omnidirectional Video Delivery: A Bandwidth-Effective Approach [J].
Alface, Patrice Rondao ;
Macq, Jean-Francois ;
Verzijp, Nico .
BELL LABS TECHNICAL JOURNAL, 2012, 16 (04) :135-147
[3]  
[Anonymous], 2016, PROC 5 WORKSHOP THIN, DOI DOI 10.1145/2980055.2980056
[4]  
[Anonymous], 2018, AIAA Paper 2018-1769, DOI [10.2514/6.2018-1769, DOI 10.2514/6.2018-4688]
[5]  
[Anonymous], 2008, P 31 ANN INT ACM SIG
[6]   MA360: MULTI-AGENT DEEP REINFORCEMENT LEARNING BASED LIVE 360-DEGREE VIDEO STREAMING ON EDGE [J].
Ban, Yixuan ;
Zhang, Yuanxing ;
Zhang, Haodan ;
Zhang, Xinggong ;
Guo, Zongming .
2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
[7]   SR360: Boosting 360-Degree Video Streaming with Super-Resolution [J].
Chen, Jiawen ;
Hu, Miao ;
Luo, Zhenxiao ;
Wang, Zelong ;
Wu, Di .
NOSSDAV '20: PROCEEDINGS OF THE 2020 WORKSHOP ON NETWORK AND OPERATING SYSTEM SUPPORT FOR DIGITAL AUDIO AND VIDEO, 2020, :1-6
[8]   Sparkle: User-Aware Viewport Prediction in 360-Degree Video Streaming [J].
Chen, Jinyu ;
Luo, Xianzhuo ;
Hu, Miao ;
Wu, Di ;
Zhou, Yipeng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :3853-3866
[9]   Adaptive Streaming of HEVC Tiled Videos Using MPEG-DASH [J].
Concolato, Cyril ;
Le Feuvre, Jean ;
Denoual, Franck ;
Maze, Frederic ;
Nassor, Eric ;
Ouedraogo, Nael ;
Taquet, Jonathan .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (08) :1981-1992
[10]   360-Degree Video Head Movement Dataset [J].
Corbillon, Xavier ;
De Simone, Francesca ;
Simon, Gwendal .
PROCEEDINGS OF THE 8TH ACM MULTIMEDIA SYSTEMS CONFERENCE (MMSYS'17), 2017, :199-204