Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points

被引:16
|
作者
Fu, Chang-Hong [1 ,2 ]
Chan, Yui-Lam [1 ]
Zhang, Hong-Bin [1 ,2 ]
Tsang, Sik Ho [1 ]
Xu, Meng-Ting [2 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Elect & Opt Engn, Nanjing 210019, Peoples R China
基金
中国国家自然科学基金;
关键词
3D-HEVC; depth map; depth modeling mode; multi-view video plus depth; intra coding; corner detection; VIDEO; MULTIVIEW; ALGORITHM; DECISION;
D O I
10.1109/TIP.2020.3046866
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To improve the coding performance of depth maps, 3D-HEVC includes several new depth intra coding tools at the expense of increased complexity due to a flexible quadtree Coding Unit/Prediction Unit (CU/PU) partitioning structure and a huge number of intra mode candidates. Compared to natural images, depth maps contain large plain regions surrounded by sharp edges at the object boundaries. Our observation finds that the features proposed in the literature either speed up the CU/PU size decision or intra mode decision and they are also difficult to make proper predictions for CUs/PUs with the multi-directional edges in depth maps. In this work, we reveal that the CUs with multi-directional edges are highly correlated with the distribution of corner points (CPs) in the depth map. CP is proposed as a good feature that can guide to split the CUs with multi-directional edges into smaller units until only single directional edge remains. This smaller unit can then be well predicted by the conventional intra mode. Besides, a fast intra mode decision is also proposed for non-CP PUs, which prunes the conventional HEVC intra modes, skips the depth modeling mode decision, and early determines segment-wise depth coding. Furthermore, a two-step adaptive corner point selection technique is designed to make the proposed algorithm adaptive to frame content and quantization parameters, with the capability of providing the flexible tradeoff between the synthesized view quality and complexity. Simulation results show that the proposed algorithm can provide about 66% time reduction of the 3D-HEVC intra encoder without incurring noticeable performance degradation for synthesized views and it also outperforms the previous state-of-the-art algorithms in term of time reduction and Delta BDBR.
引用
收藏
页码:1608 / 1622
页数:15
相关论文
共 50 条
  • [1] Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points
    Fu, Chang-Hong
    Chan, Yui-Lam
    Zhang, Hong-Bin
    Tsang, Sik Ho
    Xu, Meng-Ting
    IEEE Transactions on Image Processing, 2021, 30 : 1608 - 1622
  • [2] Single depth intra coding mode in 3D-HEVC
    Chen, Yi-Wen
    Lin, Jian-Liang
    Huang, Yu-Wen
    Lei, Shawmin
    2015 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2015, : 1130 - 1133
  • [3] Acceleration of Depth Intra Coding for 3D-HEVC by Efficient Early Termination Algorithm
    Hsu, Yu-Chih
    Lin, Jie-Ru
    Chen, Mei-Juan
    Yeh, Chia-Hung
    Lin, Min-Hui
    Lu, Wei-Chieh
    2018 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2018), 2018, : 127 - 130
  • [4] Optimization of depth modeling modes in 3D-HEVC depth intra coding
    Zhang, Yuhua
    Wang, Yong
    Zhu, Ce
    Lin, Yongbing
    Zheng, Jianhua
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2017, 13 (01) : 85 - 100
  • [5] Optimization of depth modeling modes in 3D-HEVC depth intra coding
    Yuhua Zhang
    Yong Wang
    Ce Zhu
    Yongbing Lin
    Jianhua Zheng
    Journal of Real-Time Image Processing, 2017, 13 : 85 - 100
  • [6] Fast intra mode decision for depth coding in 3D-HEVC
    Qiuwen Zhang
    Yongshuang Yang
    Huawen Chang
    Weiwei Zhang
    Yong Gan
    Multidimensional Systems and Signal Processing, 2017, 28 : 1203 - 1226
  • [7] Performance Analysis of Depth Intra-Coding in 3D-HEVC
    Sanchez, Gustavo
    Silveira, Jarbas
    Agostini, Luciano V.
    Marcon, Cesar
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (08) : 2509 - 2520
  • [8] Fast intra mode decision for depth coding in 3D-HEVC
    Zhang, Qiuwen
    Yang, Yongshuang
    Chang, Huawen
    Zhang, Weiwei
    Gan, Yong
    MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2017, 28 (04) : 1203 - 1226
  • [9] Low Complexity Depth Intra Coding in 3D-HEVC Based on Depth Classification
    Zheng, Huijie
    Zhu, Jianqing
    Zeng, Huanqiang
    Chen, Jing
    Cai, Canhui
    Ma, Kai-Kuang
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [10] An Efficient Distortion Model Configuration for Depth Coding in 3D-HEVC
    Li, Chenyang
    Jin, Xin
    Dai, Qionghai
    2014 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS), 2014, : 9 - 12