JET: Joint source and channel coding for error resilient virtual reality video wireless transmission

被引:28
作者
Liu, Zhi [1 ]
Ishihara, Susumu [1 ]
Cui, Ying [2 ]
Ji, Yusheng [3 ]
Tanaka, Yoshiaki [4 ]
机构
[1] Shizuoka Univ, 3-5-1 Johoku, Hamamatsu, Shizuoka 4328561, Japan
[2] Shanghai Jiao Tong Univ, 800 Dongchuan Rd, Minhang Qu 200240, Peoples R China
[3] Natl Inst Informat, Chiyoda Ku, 2-1-2 Hitotsubashi, Tokyo 1018430, Japan
[4] Waseda Univ, Shinjuku Ku, 3-4-1 Okubo, Tokyo 1698555, Japan
关键词
Virtual reality; VR; 360; video; Source and channel coding; Video streaming; Error resilient;
D O I
10.1016/j.sigpro.2018.01.009
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Virtual reality (VR) provides users extraordinary viewing experience and draws more and more attentions from both industry and academia. In this paper, we propose JET: Joint source and channel coding for Error resilient virtual reality video wireless Transmission, where we jointly investigate how to conquer the problem of source video's huge size, how to efficiently satisfy a user's view switch request and how to handle packet loss. Specifically, we first divide a VR video into smaller video tiles. Upon a user's view switch request, the tiles corresponding to the part that the user is requesting, referred to as the field of view (FoV), and the part that the user may switch to before new video can be received, are delivered over a wireless network. We consider unequal error protection (UEP) for FoV and the rest part and formulate the inherent error resilient VR video transmission problem into a joint source and channel coding problem. In particular, we optimize the tile partition, quantization parameter and Forward Error Correction (FEC) packet allocation to maximize a user's received video quality. We also propose a low-complexity heuristic algorithm to solve this optimization problem. Extensive simulations are conducted and simulation results verify the superior performance. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:154 / 162
页数:9
相关论文
共 40 条
  • [1] Anderson Kelly R, 2015, Arch Phys Med Rehabil, V96, P973, DOI 10.1016/j.apmr.2014.09.008
  • [2] [Anonymous], 2013, VIRTUAL AUGMENTED RE
  • [3] [Anonymous], 2017, ARXIV170408215
  • [4] [Anonymous], 2016, MOBILE NETW APPL, DOI DOI 10.1007/S11036-018-1136-6
  • [5] Chen M., 2017, ARXIV170304209
  • [6] Cheung G., 2017, IEEE INT C IM PROC
  • [7] Rate-distortion optimized streaming of packetized media
    Chou, PA
    Miao, ZR
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2006, 8 (02) : 390 - 404
  • [8] Earnshaw RaeA., 2014, VIRTUAL REALITY SYST
  • [9] El-Ganainy T., 2016, ARXIV161208350, P1
  • [10] Visual Attention Modeling for Stereoscopic Video: A Benchmark and Computational Model
    Fang, Yuming
    Zhang, Chi
    Li, Jing
    Lei, Jianjun
    Da Silva, Matthieu Perreira
    Le Callet, Patrick
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (10) : 4684 - 4696