Fast Depth Intra Coding Based on Depth Edge Classification Network in 3D-HEVC

被引:21
|
作者
Liu, Chang [1 ,2 ]
Jia, Kebin [1 ,2 ]
Liu, Pengyu [1 ,2 ]
机构
[1] Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Adv Informat Networks, Beijing 100124, Peoples R China
基金
北京市自然科学基金;
关键词
Encoding; Complexity theory; Image edge detection; Three-dimensional displays; Standards; Feature extraction; Convolutional neural networks; 3D-HEVC; CNN; depth map; edge classification; VIDEO; MULTIVIEW; DECISION;
D O I
10.1109/TBC.2021.3106143
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As the extension of high efficiency video coding (HEVC) standard, three dimensional-HEVC (3D-HEVC) is the latest 3D video coding standard. 3D-HEVC adopts many complicated coding algorithms to generate additional intermediate views for 3D video representation, which result in extremely high coding complexity. Therefore, this paper proposed a fast depth intra coding approach to reduce the 3D-HEVC complexity, which is based on convolutional neural network (CNN). First, we established a database based on the independent view of the depth map, which includes coding unit (CU) partition data of the depth map. Second, we constructed a depth edge classification CNN (DEC-CNN) framework to classify the edges for the depth map and embedded the network into a 3D-HEVC test platform. Finally, we utilized the pixel value of the binarized depth image to correct the above classification results. The experimental results demonstrated that our approach can reduce the intra coding time by 72.5% on average under negligible degradation of coding performance. This result outperforms the other state-of-the-art methods to reduce the coding complexity of 3D-HEVC.
引用
收藏
页码:97 / 109
页数:13
相关论文
共 50 条
  • [31] Acceleration of Depth Intra Coding for 3D-HEVC by Efficient Early Termination Algorithm
    Hsu, Yu-Chih
    Lin, Jie-Ru
    Chen, Mei-Juan
    Yeh, Chia-Hung
    Lin, Min-Hui
    Lu, Wei-Chieh
    2018 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2018), 2018, : 127 - 130
  • [32] Fast CU partition algorithm based on swin-transformer for depth intra coding in 3D-HEVC
    Liu S.
    Cui S.
    Li T.
    Liu H.
    Yang Q.
    Yang H.
    Multimedia Tools and Applications, 2024, 83 (42) : 90315 - 90329
  • [33] Efficient inter-prediction depth coding algorithm based on depth map segmentation for 3D-HEVC
    Liao, Yi-Wen
    Chen, Mei-Juan
    Yeh, Chia-Hung
    Lin, Jie-Ru
    Chen, Chih-Wei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (08) : 10181 - 10205
  • [34] Fast 3D-HEVC intra-prediction for depth map based on a self-organizing map and efficient features
    Hamout, Hamza
    Hammani, Amal
    Elyousfi, Abderrahmane
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2289 - 2296
  • [35] Sum-of-gradient based fast intra coding in 3D-HEVC for depth map sequence (SOG-FDIC)
    Chen, Jing
    Wang, Bohan
    Zeng, Huanqiang
    Cai, Canhui
    Ma, Kai-Kuang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 48 : 329 - 339
  • [36] EFFICIENT DEPTH INTRA MODE DECISION BY REFERENCE PIXELS CLASSIFICATION IN 3D-HEVC
    Zhang, Hong-Bin
    Fu, Chang-Hong
    Chan, Yui-Lam
    Tsang, Sik-Ho
    Siu, Wan-Chi
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 961 - 965
  • [37] Fast 3D-HEVC encoder algorithm for multiview video plus depth coding
    Zhang, Qiuwen
    Zhang, Zhifeng
    Jiang, Bin
    Zhao, Xiaoxin
    Gan, Yong
    OPTIK, 2016, 127 (20): : 8864 - 8873
  • [38] Advanced texture and depth coding in 3D-HEVC
    Lin, Jian-Liang
    Chen, Yi-Wen
    Chang, Yu -Lin
    An, Jicheng
    Zhang, Kai
    Huang, Yu-Wen
    Lei, Shawmin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 50 : 83 - 92
  • [39] Fast mode decision and PU size decision algorithm for intra depth coding in 3D-HEVC
    He, Gang
    Hu, Jing
    Li, Yunsong
    Yu, Wenxin
    Yang, Zhuo
    Liu, Peikun
    Guo, Ruixue
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 49 : 303 - 314
  • [40] Fast Intra Mode Decision for 3D-HEVC Depth Map Coding using Decision Trees
    Moura, Christopher
    Saldanha, Mario
    Sanchez, Gustavo
    Marcon, Cesar
    Porto, Marcelo
    Agostini, Luciano
    2020 27TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2020,