Geometric Prior Based Deep Human Point Cloud Geometry Compression

被引:0
作者
Wu, Xinju [1 ]
Zhang, Pingping [1 ]
Wang, Meng [1 ]
Chen, Peilin [1 ]
Wang, Shiqi [1 ]
Kwong, Sam [2 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; neural network; geometric prior;
D O I
10.1109/TCSVT.2024.3379518
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The emergence of digital avatars has prompted an exponential increase in the demand for human point clouds with realistic and intricate details. The compression of such data becomes challenging due to massive amounts of data comprising millions of points. Herein, we leverage the human geometric prior in the geometry redundancy removal of point clouds to greatly promote compression performance. More specifically, the prior provides topological constraints as geometry initialization, allowing adaptive adjustments with a compact parameter set that can be represented with only a few bits. Therefore, we propose representing high-resolution human point clouds as a combination of a geometric prior and structural deviations. The prior is first derived with an aligned point cloud. Subsequently, the difference in features is compressed into a compact latent code. The proposed framework can operate in a plug-and-play fashion with existing learning-based point cloud compression methods. Extensive experimental results show that our approach significantly improves the compression performance without deteriorating the quality, demonstrating its promise in serving a variety of applications.
引用
收藏
页码:8794 / 8807
页数:14
相关论文
共 73 条
  • [1] D'Eon E., Harrison B., Myers T., Chou P.A., 8i Voxelized Full Bodies (A Voxelized Point Cloud Dataset), (2017)
  • [2] Graziosi D., Nakagami O., Kuma S., Zaghetto A., Suzuki T., Tabatabai A., An overview of ongoing point cloud compression standardization activities: Video-based (V-PCC) and geometry-based (G-PCC), Apsipa Trans. Signal Inf. Process., 9, 1, (2020)
  • [3] Schwarz S., Et al., Emerging MPEG standards for point cloud compression, IEEE J. Emerg. Sel. Topics Circuits Syst., 9, 1, pp. 133-148, (2019)
  • [4] V-PCC Codec Description, (2020)
  • [5] G-PCC Codec Description, (2021)
  • [6] Sullivan G.J., Ohm J.-R., Han W.-J., Wiegand T., Overview of the high efficiency video coding (HEVC) standard, IEEE Trans. Circuits Syst. Video Technol., 22, 12, pp. 1649-1668, (2012)
  • [7] Balle J., Laparra V., Simoncelli E.P., End-To-end optimized image compression, Proc. 5th Int. Conf. Learn. Represent. (ICLR), pp. 1-12, (2017)
  • [8] Balle J., Minnen D., Singh S., Hwang S.J., Johnston N., Variational image compression with a scale hyperprior, Proc. 6th Int. Conf. Learn. Represent. (ICLR), pp. 1-13, (2018)
  • [9] Wang J., Ding D., Li Z., Ma Z., Multiscale point cloud geometry compression, Proc. Data Compress. Conf. (DCC), pp. 73-82, (2021)
  • [10] Quach M., Valenzise G., Dufaux F., Learning convolutional transforms for lossy point cloud geometry compression, Proc. IEEE Int. Conf. Image Process. (ICIP), pp. 4320-4324, (2019)