TransPCGC: Point Cloud Geometry Compression Based on Transformers

被引:0
作者
Lu, Shiyu [1 ]
Yang, Huamin [1 ]
Han, Cheng [1 ]
机构
[1] Changchun Univ Sci & Technol, Sch Comp Sci & Technol, Changchun 130022, Peoples R China
基金
国家重点研发计划;
关键词
point cloud geometry compression; transformers; convolution;
D O I
10.3390/a16100484
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the often substantial size of the real-world point cloud data, efficient transmission and storage have become critical concerns. Point cloud compression plays a decisive role in addressing these challenges. Recognizing the importance of capturing global information within point cloud data for effective compression, many existing point cloud compression methods overlook this crucial aspect. To tackle this oversight, we propose an innovative end-to-end point cloud compression method designed to extract both global and local information. Our method includes a novel Transformer module to extract rich features from the point cloud. Utilization of a pooling operation that requires no learnable parameters as a token mixer for computing long-distance dependencies ensures global feature extraction while significantly reducing both computations and parameters. Furthermore, we employ convolutional layers for feature extraction. These layers not only preserve the spatial structure of the point cloud, but also offer the advantage of parameter independence from the input point cloud size, resulting in a substantial reduction in parameters. Our experimental results demonstrate the effectiveness of the proposed TransPCGC network. It achieves average Bjontegaard Delta Rate (BD-Rate) gains of 85.79% and 80.24% compared to Geometry-based Point Cloud Compression (G-PCC). Additionally, in comparison to the Learned-PCGC network, our approach attains an average BD-Rate gain of 18.26% and 13.83%. Moreover, it is accompanied by a 16% reduction in encoding and decoding time, along with a 50% reduction in model size.
引用
收藏
页数:14
相关论文
共 65 条
  • [61] A Method Based on Curvature and Hierarchical Strategy for Dynamic Point Cloud Compression in Augmented and Virtual Reality System
    Yu, Siyang
    Sun, Si
    Yan, Wei
    Liu, Guangshuai
    Li, Xurui
    [J]. SENSORS, 2022, 22 (03)
  • [62] MetaFormer is Actually What You Need for Vision
    Yu, Weihao
    Luo, Mi
    Zhou, Pan
    Si, Chenyang
    Zhou, Yichen
    Wang, Xinchao
    Feng, Jiashi
    Yan, Shuicheng
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 10809 - 10819
  • [63] Point Transformer
    Zhao, Hengshuang
    Jiang, Li
    Jia, Jiaya
    Torr, Philip
    Koltun, Vladlen
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 16239 - 16248
  • [64] NICE-SLAM: Neural Implicit Scalable Encoding for SLAM
    Zhu, Zihan
    Peng, Songyou
    Larsson, Viktor
    Xu, Weiwei
    Bao, Hujun
    Cui, Zhaopeng
    Oswald, Martin R.
    Pollefeys, Marc
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12776 - 12786
  • [65] Variable Rate Point Cloud Geometry Compression Method
    Zhuang, Lehui
    Tian, Jin
    Zhang, Yujin
    Fang, Zhijun
    [J]. SENSORS, 2023, 23 (12)