Fast Rate-Distortion Optimization for Depth Maps in 3-D Video Coding

被引:11
作者
Huo, Junyan [1 ]
Zhou, Xile [1 ]
Yuan, Hui [2 ]
Wan, Shuai [3 ,4 ]
Yang, Fuzheng [1 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[3] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
[4] RMIT Univ, Sch Engn, Melbourne, Vic 3001, Australia
基金
中国国家自然科学基金;
关键词
Encoding; Costs; Video coding; Three-dimensional displays; Complexity theory; Rate-distortion; Distortion; 3D video coding; rate-distortion optimization; 3D-HEVC; depth maps; rate-distortion cost; MULTIVIEW VIDEO; VIEW; PREDICTION; EXTENSIONS; 3D-HEVC; AVC;
D O I
10.1109/TBC.2022.3192992
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To ensure the fidelity of virtual views, rate-distortion optimization (RDO) criterion for the 3D extension of the High Efficiency Video Coding (3D-HEVC) is well designed, in which the synthesized view distortion (SVD) is introduced to derive the rate-distortion (RD) cost. To obtain accurate SVDs, the rendering operation is employed which demands a fairly high computational complexity. To address this problem, a fast RDO method for depth maps is proposed, which checks the RD cost during its calculation process. Specifically, given a coding mode, the RD cost is composed of several cumulative items. If the accumulated RD cost is equal to or exceeds the minimum RD cost of previously coded modes, it will not be necessary to continue the RD cost calculation for the mode. To reduce the encoding complexity, existing methods usually aim at reducing the number of tested modes or block partitions. To the best of our knowledge, it is the first time that the latent redundant complexity in the RD cost calculation is investigated and removed. Experimental results demonstrate that, compared with the 3D-HEVC reference software, the proposed method can save 28.1% of depth coding time with a small coding gain (0.04% BD-rate saving). An additional test is designed to evaluate four typical fast coding methods with/without the proposed method. Extensive results verify that the proposed method can be seamlessly combined with the state-of-the-art methods.
引用
收藏
页码:21 / 32
页数:12
相关论文
共 46 条
[21]  
Liu HB, 2014, IEEE IMAGE PROC, P3219, DOI 10.1109/ICIP.2014.7025651
[22]   Low Complexity Adaptive View Synthesis Optimization in HEVC Based 3D Video Coding [J].
Ma, Siwei ;
Wang, Shiqi ;
Gao, Wen .
IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (01) :266-271
[23]   Depth Intra Coding for 3D Video Based on Geometric Primitives [J].
Merkle, Philipp ;
Mueller, Karsten ;
Marpe, Detlev ;
Wiegand, Thomas .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (03) :570-582
[24]   Initialization, Limitation, and Predictive Coding of the Depth and Texture Quadtree in 3D-HEVC [J].
Mora, Elie Gabriel ;
Jung, Joel ;
Cagnazzo, Marco ;
Pesquet-Popescu, Beatrice .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (09) :1554-1565
[25]   3D High-Efficiency Video Coding for Multi-View Video and Depth Data [J].
Mueller, Karsten ;
Schwarz, Heiko ;
Marpe, Detlev ;
Bartnik, Christian ;
Bosse, Sebastian ;
Brust, Heribert ;
Hinz, Tobias ;
Lakshman, Haricharan ;
Merkle, Philipp ;
Rhee, Franz Hunn ;
Tech, Gerhard ;
Winken, Martin ;
Wiegand, Thomas .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (09) :3366-3378
[26]   View Synthesis Distortion Estimation for AVC- and HEVC-Compatible 3-D Video Coding [J].
Oh, Byung Tae ;
Oh, Kwan-Jung .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (06) :1006-1015
[27]   Efficient Multiview Video Coding Using 3-D Coding and Saliency-Based Bit Allocation [J].
Paul, Manoranjan .
IEEE TRANSACTIONS ON BROADCASTING, 2018, 64 (02) :235-246
[28]  
Peng KK, 2016, IEEE IMAGE PROC, P1126, DOI 10.1109/ICIP.2016.7532533
[29]  
Rusanovskyy D., 2012, JCT3VA1100
[30]   Fast 3D-HEVC Depth Map Encoding Using Machine Learning [J].
Saldanha, Mario ;
Sanchez, Gustavo ;
Marcon, Cesar ;
Agostini, Luciano Volcan .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (03) :850-861