Learning-based Intra-Prediction For Point Cloud Attribute Transform Coding

被引:2
|
作者
Hou, Lizhi [1 ]
Gao, Linyao [1 ]
Xu, Yiling [1 ]
Li, Zhu [2 ]
Xu, Xiaozhong [3 ]
Liu, Shan [3 ]
机构
[1] Shanghai Jiao Tong Univ, Cooperat MediaNet Innovat Ctr, Shanghai, Peoples R China
[2] Univ Missouri Kansas, Dept CSEE, Kansas City, KS USA
[3] Tencent, Media Lab, Shenzhen, Peoples R China
来源
2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP) | 2022年
基金
中国国家自然科学基金;
关键词
Point cloud attribute compression; region adaptive hierarchical transform; intra-prediction; MLP-based neural network; REGION; COMPRESSION;
D O I
10.1109/MMSP55362.2022.9949997
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The attached attributes of each point in point cloud are fairly valuable but aggravate the burden for storage and transmission. In this paper, we propose a learning-based introprediction method for region adaptive hierarchical transform (RAHT) to compress point cloud attributes efficiently. First, we design an adaptive neighbor selection (ANS) module to produce the most correlated neighbors for child nodes. Then, the correlated neighbors obtained by ANS, the corresponding distance weights, and some additional auxiliary information are concatenated and fed to a multi-layer perception (MLP) based network to estimate the child node attributes precisely. Besides, residual learning is introduced to accelerate the network convergence. The predicted child node attributes are finally transformed by RAHT, and the residual of transform coefficients are then quantized and entropy coded. Experimental results demonstrate that our proposed methods can significantly improve attribute coding efficiency with average 10.2% BD-Rate gains compared with MPEG G-PCC reference software TMC13v14.0 on MPEG PCC dataset.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Intra-Prediction and Generalized Graph Fourier Transform for Image Coding
    Hu, Wei
    Cheung, Gene
    Ortega, Antonio
    IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (11) : 1913 - 1917
  • [2] Adaptive Deep Learning-Based Point Cloud Geometry Coding
    Guarda, Andre F. R.
    Rodrigues, Nuno M. M.
    Pereira, Fernando
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (02) : 415 - 430
  • [3] Deep Learning-based Point Cloud Coding for Immersive Experiences
    Pereira, Fernando
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 7368 - 7370
  • [4] Point Cloud Attribute Compression via Clustering and Intra Prediction
    Zhang, Ke
    Zhu, Wenjie
    Xu, Yiling
    Liu, Ning
    2018 13TH IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2018,
  • [5] A unified architecture for fast HEVC intra-prediction coding
    Ruiz, Damian
    Fernandez-Escribano, Gerardo
    Luis Martinez, Jose
    Cuenca, Pedro
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2019, 16 (05) : 1825 - 1844
  • [6] A unified architecture for fast HEVC intra-prediction coding
    Damian Ruiz
    Gerardo Fernández-Escribano
    José Luis Martínez
    Pedro Cuenca
    Journal of Real-Time Image Processing, 2019, 16 : 1825 - 1844
  • [7] Edges based Intra-prediction in High Efficiency Video Coding (HEVC) Standard
    Patel, Dhruti B.
    Chauhan, Divya M.
    Pathak, Ketki C.
    PROCEEDINGS OF 2ND IEEE INTERNATIONAL CONFERENCE ON ENGINEERING & TECHNOLOGY ICETECH-2016, 2016, : 995 - 1000
  • [8] GRAPH-BASED TRANSFORM BASED ON NEURAL NETWORKS FOR INTRA-PREDICTION OF IMAGING DATA
    Roy, Debaleena
    Guha, Tanaya
    Sanchez, Victor
    2021 IEEE 31ST INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2021,
  • [9] HEVC Information-Hiding Algorithm Based on Intra-Prediction and Matrix Coding
    Liu, Yong
    Xu, Dawen
    INTERNATIONAL JOURNAL OF DIGITAL CRIME AND FORENSICS, 2021, 13 (06)
  • [10] Combined Intra-Prediction for High-Efficiency Video Coding
    Gabriellini, Andrea
    Flynn, David
    Mrak, Marta
    Davies, Thomas
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2011, 5 (07) : 1282 - 1289