Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation

被引:0
|
作者
He, Xiang [1 ]
Li, Xu [1 ]
Ni, Peizhou [1 ]
Xu, Wang [1 ]
Xu, Qimin [1 ]
Liu, Xixiang [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Laser radar; Semantic segmentation; Transformers; Convolution; Three-dimensional displays; Kernel; Accuracy; Topology; Semantics; LiDAR semantic segmentation; long-range features; point cloud; Transformer;
D O I
10.1109/TGRS.2024.3492008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semantic segmentation of large-scale outdoor point cloud captured by light detection and ranging (LiDAR) sensors can provide fine-grain and stereoscopic comprehension for the surrounding environment. However, limited by the receptive field of convolution kernel and ignoration of specific spatial properties inherent to the large-scale outdoor point cloud, the existing advanced LiDAR semantic segmentation methods inevitably abandon the unique radial long-range topological relationships. To this end, from the LiDAR perspective, we propose a novel Radial Transformer that can naturally and efficiently exploit the radial long-range dependencies exclusive to the outdoor point cloud for accurate LiDAR semantic segmentation. Specifically, we first develop a radial window partition to generate a series of candidate point sequences and then construct the long-range interactions among the densely continuous point sequences by the self-attention mechanism. Moreover, considering the varying-distance distribution of point cloud in 3-D space, a spatial-adaptive position encoding is particularly designed to elaborate the relative position. Furthermore, we fusion radial balanced attention for a better structure representation of real-world scenes and distant points. Extensive experiments demonstrate the effectiveness and superiority of our method, which achieves 67.5% and 77.7% mean intersection-over-union (mIoU) on two recognized large-scale outdoor LiDAR point cloud datasets SemanticKITTI and nuScenes, respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Point and voxel cross perception with lightweight cosformer for large-scale point cloud semantic segmentation
    Zhang, Shuai
    Wang, Biao
    Chen, Yiping
    Zhang, Shuhang
    Zhang, Wuming
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 131
  • [22] Regional-to-Local Point-Voxel Transformer for Large-Scale Indoor 3D Point Cloud Semantic Segmentation
    Li, Shuai
    Li, Hongjun
    REMOTE SENSING, 2023, 15 (19)
  • [23] DCNet: Large-Scale Point Cloud Semantic Segmentation With Discriminative and Efficient Feature Aggregation
    Yin, Fukun
    Huang, Zilong
    Chen, Tao
    Luo, Guozhong
    Yu, Gang
    Fu, Bin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 4083 - 4095
  • [24] Retrieval-and-alignment based large-scale indoor point cloud semantic segmentation
    Zongyi Xu
    Xiaoshui Huang
    Bo Yuan
    Yangfu Wang
    Qianni Zhang
    Weisheng Li
    Xinbo Gao
    Science China Information Sciences, 2024, 67
  • [25] Retrieval-and-alignment based large-scale indoor point cloud semantic segmentation
    Zongyi XU
    Xiaoshui HUANG
    Bo YUAN
    Yangfu WANG
    Qianni ZHANG
    Weisheng LI
    Xinbo GAO
    Science China(Information Sciences), 2024, 67 (04) : 164 - 180
  • [26] Retrieval-and-alignment based large-scale indoor point cloud semantic segmentation
    Xu, Zongyi
    Huang, Xiaoshui
    Yuan, Bo
    Wang, Yangfu
    Zhang, Qianni
    Li, Weisheng
    Gao, Xinbo
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (04)
  • [27] FPS-Net: A convolutional fusion network for large-scale LiDAR point cloud segmentation
    Xiao, Aoran
    Yang, Xiaofei
    Lu, Shijian
    Guan, Dayan
    Huang, Jiaxing
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 176 : 237 - 249
  • [28] THE INFLUENCE OF CHANGING FEATURES ON THE ACCURACY OF DEEP LEARNING-BASED LARGE-SCALE OUTDOOR LIDAR SEMANTIC SEGMENTATION
    Liu, Chang
    Zhang, Qi
    Shirowzhan, Sara
    Bai, Ting
    Sheng, Ziheng
    Wu, Yunhao
    Kuang, Jianming
    Ge, Linlin
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 4443 - 4446
  • [29] RAAFNet: Reverse Attention Adaptive Fusion Network for Large-Scale Point Cloud Semantic Segmentation
    Wang, Kai
    Zhang, Huanhuan
    MATHEMATICS, 2024, 12 (16)
  • [30] Semantic Segmentation of Large-Scale Laser Point Cloud in Mines Based on Local Feature Enhancement
    Dong, Hongxiang
    Yi, An
    Xie, Lirong
    Yang, Zhiyong
    Kai, Zhang
    CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2024, 51 (17):