WiFi-VLC Dual Connectivity Streaming System for 6DOF Multi-User Virtual Reality

被引:6
作者
Chakareski, Jacob [1 ]
Khan, Mahmudur [2 ]
机构
[1] New Jersey Inst Technol, Newark, NJ 07102 USA
[2] York Coll Penn, York, PA USA
来源
PROCEEDINGS OF THE 31ST ACM WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO (NOSSDAV '21) | 2021年
关键词
6DOF Virtual Reality; Visible Light Communication; WiFi-VLC Dual Connectivity Wireless Streaming; Scalable 360 degrees Video Tiling;
D O I
10.1145/3458306.3460999
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We investigate a future WiFi-VLC dual connectivity streaming system for 6DOF multi-user virtual reality that enables reliable highfidelity remote scene immersion. The system integrates an edge server that uses scalable 360 degrees tiling to adaptively split the present 360 degrees view of a VR user into a panoramic baseline content layer and a viewport-specific enhancement content layer. The user is then served the two content layers over complementary WiFi and VLC wireless links such that the delivered viewport quality is maximized for the given WiFi and VLC transmission resources. We formally characterize the actions of the server using rate-distortion optimization that we solve at low complexity. To account for the users' mobility as they explore different 360 degrees viewpoints of the 6DOF remote scene content and maintain reliable high-quality VLC connectivity, we explore dynamic VLC transmitter steering and assignment in the system as graph bottleneck matching that aims to maximize the received VLC SNR across all users. We formulate an effective low-complexity solution to this discrete combinatorial optimization problem of high complexity. The paper also contributes a first actual 6DOF body and head movement VR navigation dataset that we collected and facilitate to assess the performance of our system via simulation experiments. These demonstrate enhanced VLC transmission performance and an up to 7 dB gain in viewport quality over a state-of-the-art VLC cellular system (LiFi), and an up to 10 dB gain in viewport quality over a state-of-the-art traditional wireless streaming method, for 12K-120fps 360 degrees 6DOF VR content. Moreover, the synergistic WiFi-VLC dual connectivity of the proposed system augments its reliability over the reference method LiFi that comprises only VLC links. These outcomes motivate further exploration and prototype implementation of our system.
引用
收藏
页码:107 / 113
页数:7
相关论文
共 25 条
[1]  
[Anonymous], 2016, Forbes Magazine
[2]   Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding Standard [J].
Boyce, Jill M. ;
Ye, Yan ;
Chen, Jianle ;
Ramasubramonian, Adarsh K. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (01) :20-34
[3]  
Boyd S., 2009, Convex Optimization, DOI DOI 10.1017/CBO9780511804441
[4]   Linear diversity combining techniques [J].
Brennan, DG .
PROCEEDINGS OF THE IEEE, 2003, 91 (02) :331-356
[5]   Rate-distortion optimized video streaming with rich acknowledgments [J].
Chakareski, J ;
Girod, B .
VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2004, PTS 1 AND 2, 2004, 5308 :661-668
[6]  
Chakareski J, 2004, 2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL V, PROCEEDINGS, P1001
[7]   Distributed collaboration for enhanced sender-driven video streaming [J].
Chakareski, Jacob ;
Frossard, Pascal .
IEEE TRANSACTIONS ON MULTIMEDIA, 2008, 10 (05) :858-870
[8]   Viewport-Adaptive Scalable Multi-User Virtual Reality Mobile-Edge Streaming [J].
Chakareski, Jacob .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :6330-6342
[9]   UAV-IoT for Next Generation Virtual Reality [J].
Chakareski, Jacob .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (12) :5977-5990
[10]   VR/AR Immersive Communication: Caching, Edge Computing, and Transmission Trade-Offs [J].
Chakareski, Jacob .
VR/AR NETWORK '17: PROCEEDINGS OF THE 2017 WORKSHOP ON VIRTUAL REALITY AND AUGMENTED REALITY NETWORK, 2017, :36-41