Fast Depth Intra Coding Based on Depth Edge Classification Network in 3D-HEVC

被引:21
|
作者
Liu, Chang [1 ,2 ]
Jia, Kebin [1 ,2 ]
Liu, Pengyu [1 ,2 ]
机构
[1] Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Adv Informat Networks, Beijing 100124, Peoples R China
基金
北京市自然科学基金;
关键词
Encoding; Complexity theory; Image edge detection; Three-dimensional displays; Standards; Feature extraction; Convolutional neural networks; 3D-HEVC; CNN; depth map; edge classification; VIDEO; MULTIVIEW; DECISION;
D O I
10.1109/TBC.2021.3106143
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As the extension of high efficiency video coding (HEVC) standard, three dimensional-HEVC (3D-HEVC) is the latest 3D video coding standard. 3D-HEVC adopts many complicated coding algorithms to generate additional intermediate views for 3D video representation, which result in extremely high coding complexity. Therefore, this paper proposed a fast depth intra coding approach to reduce the 3D-HEVC complexity, which is based on convolutional neural network (CNN). First, we established a database based on the independent view of the depth map, which includes coding unit (CU) partition data of the depth map. Second, we constructed a depth edge classification CNN (DEC-CNN) framework to classify the edges for the depth map and embedded the network into a 3D-HEVC test platform. Finally, we utilized the pixel value of the binarized depth image to correct the above classification results. The experimental results demonstrated that our approach can reduce the intra coding time by 72.5% on average under negligible degradation of coding performance. This result outperforms the other state-of-the-art methods to reduce the coding complexity of 3D-HEVC.
引用
收藏
页码:97 / 109
页数:13
相关论文
共 50 条
  • [41] Tunable early CU size decision for depth map intra coding in 3D-HEVC using unsupervised learning
    Li, Yue
    Yang, Gaobo
    Qu, Aiping
    Zhu, Yapei
    DIGITAL SIGNAL PROCESSING, 2022, 123
  • [42] Fast Inter-frame Prediction Based Array Processor for Depth Maps in 3D-HEVC
    Zhu, Yun
    Jiang, Lin
    Song, Hui
    Xie, Xiaoyan
    Wang, Anqi
    Shen, Xubang
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 118 - 125
  • [43] GENERIC SEGMENT-WISE DC FOR 3D-HEVC DEPTH INTRA CODING
    Liu, Hongbin
    Chen, Ying
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 3219 - 3222
  • [44] High-Throughput Hardware for 3D-HEVC Depth-Map Intra Prediction
    Ucker, Mariana
    Afonso, Vladimir
    Saldanha, Mario
    Audibert, Luan
    Conceicao, Ruhan
    Susin, Altamiro
    Porto, Marcelo
    Zatt, Bruno
    Agostini, Luciano
    IEEE DESIGN & TEST, 2020, 37 (03) : 7 - 14
  • [45] Fast 3D-HEVC Depth Map Encoding Using Machine Learning
    Saldanha, Mario
    Sanchez, Gustavo
    Marcon, Cesar
    Agostini, Luciano Volcan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (03) : 850 - 861
  • [46] Fast 3D-HEVC PU size decision algorithm for depth map intra-video coding
    Hamout, Hamza
    Elyousfi, Abderrahmane
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2020, 17 (05) : 1285 - 1299
  • [47] Low complexity intra prediction mode decision for 3D-HEVC depth coding
    Jaballah, Sami
    Larabi, Mohamed-Chaker
    Tahar, Jamel Belhadj
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 67 : 34 - 47
  • [48] Fast 3D-HEVC PU size decision algorithm for depth map intra-video coding
    Hamza Hamout
    Abderrahmane Elyousfi
    Journal of Real-Time Image Processing, 2020, 17 : 1285 - 1299
  • [49] FAST TEXTURE INTRA SIZE CODING BASED ON BIG DATA CLUSTERING FOR 3D-HEVC
    Hamout, Hamza
    Elyousfi, Abderrahmane
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1728 - 1732
  • [50] UNIFIED WEDGELET GENENRATION FOR DEPTH CODING IN 3D-HEVC
    Zhao, Xin
    Zhang, Li
    Chen, Ying
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 121 - 124