A survey on 360-degree video: Coding, quality of experience and streaming

被引:32
作者
Chiariotti, Federico [1 ]
机构
[1] Aalborg Univ, Fredrik Bajers Vej 7C, DK-9220 Aalborg, Denmark
关键词
Video streaming; Virtual Reality; Quality of Experience; VIRTUAL-REALITY; OMNIDIRECTIONAL VIDEO; SALIENCY PREDICTION; CONTROL SCHEMES; IMAGE; HEAD; VR; DELIVERY; MODEL; OPTIMIZATION;
D O I
10.1016/j.comcom.2021.06.029
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The commercialization of Virtual Reality (VR) headsets has made immersive and 360-degree video streaming the subject of intense interest in the industry and research communities. While the basic principles of video streaming are the same, immersive video presents a set of specific challenges that need to be addressed. In this survey, we present the latest developments in the relevant literature on four of the most important ones: (i) omnidirectional video coding and compression, (ii) subjective and objective Quality of Experience (QoE) and the factors that can affect it, (iii) saliency measurement and viewport prediction, and (iv) the adaptive streaming of immersive 360-degree videos. The final objective of the survey is to provide an overview of the research on all the elements of an immersive video streaming system, giving the reader an understanding of their interplay and performance.
引用
收藏
页码:133 / 155
页数:23
相关论文
共 324 条
[71]   Toward Low-Latency and Ultra-Reliable Virtual Reality [J].
Elbamby, Mohammed S. ;
Perfecto, Cristina ;
Bennis, Mehdi ;
Doppler, Klaus .
IEEE NETWORK, 2018, 32 (02) :78-84
[72]   Optimizing Fixation Prediction Using Recurrent Neural Networks for 360° Video Streaming in Head-Mounted Virtual Reality [J].
Fan, Ching-Ling ;
Yen, Shou-Cheng ;
Huang, Chun-Ying ;
Hsu, Cheng-Hsin .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (03) :744-759
[73]   A Survey on 360° Video Streaming: Acquisition, Transmission, and Display [J].
Fan, Ching-Ling ;
Lo, Wen-Chih ;
Pai, Yu-Tung ;
Hsu, Cheng-Hsin .
ACM COMPUTING SURVEYS, 2019, 52 (04)
[74]   A novel superpixel-based saliency detection model for 360-degree images [J].
Fang, Yuming ;
Zhang, Xiaoqiang ;
Imamoglu, Nevrez .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 69 :1-7
[75]   AVTrack360: An open Dataset and Software recording people's Head Rotations watching 360° Videos on an HMD [J].
Fremerey, Stephan ;
Singla, Ashutosh ;
Meseberg, Kay ;
Raake, Alexander .
PROCEEDINGS OF THE 9TH ACM MULTIMEDIA SYSTEMS CONFERENCE (MMSYS'18), 2018, :403-408
[76]   The Rhombic Dodecahedron Map: An Efficient Scheme for Encoding Panoramic Video [J].
Fu, Chi-Wing ;
Wan, Liang ;
Wong, Tien-Tsin ;
Leung, Chi-Sing .
IEEE TRANSACTIONS ON MULTIMEDIA, 2009, 11 (04) :634-644
[77]   360SRL: A SEQUENTIAL REINFORCEMENT LEARNING APPROACH FOR ABR TILE-BASED 360 VIDEO STREAMING [J].
Fu, Jun ;
Chen, Xiaoming ;
Zhang, Zhizheng ;
Wu, Shilin ;
Chen, Zhibo .
2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, :290-295
[78]  
Fuiihashi T., 2018, 2018 IEEE GLOB COMM, P1
[79]  
Gabin F., 2018, J ICT STAND, V6, P117
[80]  
Gao P., 2020, IEEE T MULTIMED