Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points

被引:20
作者
Fu, Chang-Hong [1 ,2 ]
Chan, Yui-Lam [1 ]
Zhang, Hong-Bin [1 ,2 ]
Tsang, Sik Ho [1 ]
Xu, Meng-Ting [2 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Elect & Opt Engn, Nanjing 210019, Peoples R China
基金
中国国家自然科学基金;
关键词
3D-HEVC; depth map; depth modeling mode; multi-view video plus depth; intra coding; corner detection; VIDEO; MULTIVIEW; ALGORITHM; DECISION;
D O I
10.1109/TIP.2020.3046866
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To improve the coding performance of depth maps, 3D-HEVC includes several new depth intra coding tools at the expense of increased complexity due to a flexible quadtree Coding Unit/Prediction Unit (CU/PU) partitioning structure and a huge number of intra mode candidates. Compared to natural images, depth maps contain large plain regions surrounded by sharp edges at the object boundaries. Our observation finds that the features proposed in the literature either speed up the CU/PU size decision or intra mode decision and they are also difficult to make proper predictions for CUs/PUs with the multi-directional edges in depth maps. In this work, we reveal that the CUs with multi-directional edges are highly correlated with the distribution of corner points (CPs) in the depth map. CP is proposed as a good feature that can guide to split the CUs with multi-directional edges into smaller units until only single directional edge remains. This smaller unit can then be well predicted by the conventional intra mode. Besides, a fast intra mode decision is also proposed for non-CP PUs, which prunes the conventional HEVC intra modes, skips the depth modeling mode decision, and early determines segment-wise depth coding. Furthermore, a two-step adaptive corner point selection technique is designed to make the proposed algorithm adaptive to frame content and quantization parameters, with the capability of providing the flexible tradeoff between the synthesized view quality and complexity. Simulation results show that the proposed algorithm can provide about 66% time reduction of the 3D-HEVC intra encoder without incurring noticeable performance degradation for synthesized views and it also outperforms the previous state-of-the-art algorithms in term of time reduction and Delta BDBR.
引用
收藏
页码:1608 / 1622
页数:15
相关论文
共 46 条
[1]  
[Anonymous], 2012, INT C 3D IMAGING
[2]  
[Anonymous], 2014, ITU T SG 16 WP 3 ISO
[3]  
[Anonymous], 2011, DOCUMENT ISO IEC SC2
[4]  
[Anonymous], 2014, Doc. JCT3V-G1100
[5]  
Bjontegaard G., 2001, ITU-T SG.16 Q.6 VCEG-M33
[6]  
da Silva TL, 2014, 2014 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING CONFERENCE, P229, DOI 10.1109/VCIP.2014.7051546
[7]  
Fu CH, 2015, 2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), P477, DOI 10.1109/ICDSP.2015.7251918
[8]  
Gu Z., 2013, DOCUMENT JCT3V E0238
[9]  
Gu Z. Y., 2014, ITUT SG 16 WP 3 ISO
[10]  
Gu ZY, 2014, IEEE INT CON MULTI