FOV-BASED CODING OPTIMIZATION FOR 360-DEGREE VIRTUAL REALITY VIDEOS

被引：1

作者：

Xu, Yuanyuan ^{[1
]}

Yang, Taoyu

Tan, Zengjie

Lan, Haolun

机构：

[1] Hohai Univ, Key Lab Water Big Data Technol, Minist Water Resources, Nanjing, Peoples R China

来源：

2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2022年

基金：

中国国家自然科学基金;

关键词：

360-degree video; video coding optimization; field of view (FoV); virtual reality;

D O I：

10.1109/ICASSP43922.2022.9746379

中图分类号：

O42 [声学];

学科分类号：

070206 ; 082403 ;

摘要：

Panoramic or 360-degree virtual reality videos have high resolution, frame rate, and visual quality that demand efficient coding. Although a user watching a 360-degree video can switch viewing angles, only a portion of the video in the user's Field of View (FoV) is displayed at any time. In this paper, we propose an FoV-based coding scheme for 360-degree videos, which allocates more bits to tiles of the predicted FoV area than other tiles. Taking possible FoV prediction error into account, the proposed scheme aims to minimize the expected weighted distortion of the FoV region, where different weights are given to tiles at different locations representing the influence of projection from spherical domain to the 2D plane. Accordingly, an adaptive tile-level quantization parameter (QP) selection scheme is derived. Simulation results demonstrate the effectiveness of the proposed scheme.

引用

页码：1640 / 1644

页数：5

共 15 条

[1]

[Anonymous], VIEWPORT ADAPTATION

[2]

Bjontegaard G., 2001, ITU T VCEG M

[3] Recent advances in omnidirectional video coding for virtual reality: Projection and evaluation [J].

Chen, Zhenzhong ;

Li, Yiming ;

Zhang, Yingxue .

SIGNAL PROCESSING, 2018, 146 :66-78

[4]

Li B, 2013, IEEE INT SYMP CIRC S, P477, DOI 10.1109/ISCAS.2013.6571884

[5] λ-Domain Perceptual Rate Control for 360-Degree Video Compression [J].

Li, Li ;

Yan, Ning ;

Li, Zhu ;

Liu, Shan ;

Li, Houqiang .

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (01) :130-145

[6]

Li YM, 2017, IEEE INT CON MULTI, P709, DOI 10.1109/ICME.2017.8019492

[7]

Liu Y., 2020, P 28 ACM INT C MULT, P3696

[8]

Liu YY, 2019, ASIAPAC SIGN INFO PR, P992, DOI 10.1109/APSIPAASC47483.2019.9023222

[9] Spatial-Random-Access-Enabled Video Coding for Interactive Virtual Pan/Tilt/Zoom Functionality [J].

Mavlankar, Aditya ;

Girod, Bernd .

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2011, 21 (05) :577-588

[10]

Mavlankar A, 2010, SIGNALS COMMUN TECHN, P431, DOI 10.1007/978-3-642-12802-8_19

← 1 2 →