Game Theory-driven Rate Control for 360-Degree Video Coding

被引:8
作者
Zhao, Tiesong [1 ,2 ]
Lin, Jielian [1 ]
Song, Yanjie [1 ]
Wang, Xu [3 ]
Niu, Yuzhen [1 ]
机构
[1] Fuzhou Univ, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou, Peoples R China
[2] Peng Cheng Lab, Shenzhen, Peoples R China
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021 | 2021年
基金
中国国家自然科学基金;
关键词
Rate Control (RC); rate allocation; video coding; 360-degree video; omnidirectional video; perceptual quality; LEVEL RATE CONTROL; OPTIMAL BIT ALLOCATION; OPTIMIZATION; QUALITY; ALGORITHM;
D O I
10.1145/3474085.3475657
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The 360-degree video (omnidirectional video) has become popular recently due to its capability of providing immersive experience, which is generally achieved via spherical moving pictures with freedom of viewpoint changing. Nevertheless, the support of fullview visual contents has inevitably reshaped its perceptual quality metric and dramatically increased its bitrate output after video coding. Therefore in 360-degree video coding, the Rate Control (RC) problem, which aims to maximize the resulted perceptual quality under bitrate constraint, has become a challenging task yet to be addressed. In this paper, we observe a latitude-based bitrate discrepancy in equirectangular-projected 360-degree video coding and further utilize this feature in bitrate allocation under panoramic vision. We introduce game theory to find optimal inter/intra-frame bit allocations that maximize the overall RC performance in terms of utility function. Finally, an overall framework is proposed that is capable of providing both an improved bitrate accuracy and an enhanced perceptual quality. Experimental results demonstrate the efficiency of proposed method, with promising RC performances for 4K and 8K 360-degree videos.
引用
收藏
页码:3998 / 4006
页数:9
相关论文
共 52 条
[1]   On using game theory to optimize the rate control in video coding [J].
Ahmad, I ;
Luo, JC .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (02) :209-219
[2]  
[Anonymous], 2017, BIOMED RES INT
[3]  
[Anonymous], 2016, 2016 VIS COMM IM PRO
[4]  
Bialkova S, 2019, 2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), P1443, DOI 10.1109/VR.2019.8797805
[5]   Optimal Bitrate Allocation in the Scalable HEVC Extension for the Deployment of UHD Services [J].
Biatek, Thibaud ;
Hamidouche, Wassim ;
Travers, Jean-Francois ;
Deforges, Olivier .
IEEE TRANSACTIONS ON BROADCASTING, 2016, 62 (04) :826-841
[6]  
Bjontegaard G., 2001, document VCEG-M33
[7]   Omnidirectional Multicamera Video Stitching Using Depth Maps [J].
Bosch, Josep ;
Istenic, Klemen ;
Gracias, Nuno ;
Garcia, Rafael ;
Ridao, Pere .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2020, 45 (04) :1337-1352
[8]  
Boyce J., 2017, JVET document, JVET-F1030-v4
[9]  
Bross Benjamin, 2017, JCTVCJ1003 JVET
[10]  
Chen S., 2018, Journal of Food and Drug Analysis, DOI [10.1016/j.jfda.2018.01.012, DOI 10.3760/CMA.J]