Viewport-Adaptive Scalable Multi-User Virtual Reality Mobile-Edge Streaming

被引:48
作者
Chakareski, Jacob [1 ]
机构
[1] New Jersey Inst Technol, Ying Wu Coll Comp, Newark, NJ 07103 USA
关键词
Mobile virtual reality; scalable 360 degrees video tiling; mobile edge computing and streaming; resource allocation; 5G small cell systems; statistical VR navigation analysis; multiple knapsack problem with multiple constraints; branch-and-prune fully-polynomial time approximation method; MULTIVIEW VIDEO;
D O I
10.1109/TIP.2020.2986547
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Virtual reality (VR) holds tremendous potential to advance our society, expected to make impact on quality of life, energy conservation, and the economy. To bring us closer to this vision, the present paper investigates a novel communications system that integrates for the first time scalable multi-layer 360 degrees video tiling, viewport-adaptive rate-distortion optimal resource allocation, and VR-centric edge computing and caching, to enable next generation high-quality untethered VR streaming. Our system comprises a collection of 5G small cells that can pool their communication, computing, and storage resources to collectively deliver scalable 360 degrees video content to mobile VR clients at much higher quality. The major contributions of the paper are the rigorous design of multi-layer 360 degrees tiling and related models of statistical user navigation, analysis and optimization of edge-based multi-user VR streaming that integrates viewport adaptation and server cooperation, and base station 360 degrees video packet scheduling. We also explore the possibility of network coded data operation and its implications for the analysis, optimization, and system performance we pursue in this setting. The advances introduced by our framework over the state-of-the-art comprise considerable gains in delivered immersion fidelity, featuring much higher 360 degrees viewport peak signal to noise ratio (PSNR) and VR video frame rates and spatial resolutions.
引用
收藏
页码:6330 / 6342
页数:13
相关论文
共 51 条
[51]  
Zhou M, 2012, PROCEEDINGS OF THE FIFTH INTERNATIONAL SYMPOSIUM - EDUCATION MANAGEMENT AND KNOWLEDGE INNOVATION ENGINEERING, P255