Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation

被引:0
|
作者
He, Xiang [1 ]
Li, Xu [1 ]
Ni, Peizhou [1 ]
Xu, Wang [1 ]
Xu, Qimin [1 ]
Liu, Xixiang [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Point cloud compression; Laser radar; Semantic segmentation; Transformers; Convolution; Three-dimensional displays; Kernel; Accuracy; Topology; Semantics; LiDAR semantic segmentation; long-range features; point cloud; Transformer;
D O I
10.1109/TGRS.2024.3492008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semantic segmentation of large-scale outdoor point cloud captured by light detection and ranging (LiDAR) sensors can provide fine-grain and stereoscopic comprehension for the surrounding environment. However, limited by the receptive field of convolution kernel and ignoration of specific spatial properties inherent to the large-scale outdoor point cloud, the existing advanced LiDAR semantic segmentation methods inevitably abandon the unique radial long-range topological relationships. To this end, from the LiDAR perspective, we propose a novel Radial Transformer that can naturally and efficiently exploit the radial long-range dependencies exclusive to the outdoor point cloud for accurate LiDAR semantic segmentation. Specifically, we first develop a radial window partition to generate a series of candidate point sequences and then construct the long-range interactions among the densely continuous point sequences by the self-attention mechanism. Moreover, considering the varying-distance distribution of point cloud in 3-D space, a spatial-adaptive position encoding is particularly designed to elaborate the relative position. Furthermore, we fusion radial balanced attention for a better structure representation of real-world scenes and distant points. Extensive experiments demonstrate the effectiveness and superiority of our method, which achieves 67.5% and 77.7% mean intersection-over-union (mIoU) on two recognized large-scale outdoor LiDAR point cloud datasets SemanticKITTI and nuScenes, respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Leveraging Smooth Deformation Augmentation for LiDAR Point Cloud Semantic Segmentation
    Qiu, Shoumeng
    Chen, Jie
    Lai, Chenghang
    Lu, Hong
    Xue, Xiangyang
    Pu, Jian
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (02): : 3316 - 3329
  • [22] QPCR: Weakly Supervised Semantic Segmentation of Large-Scale Point Cloud via Gradual Query Points Component Reasoning
    Zhan, Lixin
    Li, Wei
    Jiang, Jie
    Zhou, Tianjian
    Wen, Chenglu
    Wang, Cheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [23] Large-Scale ALS Point Cloud Segmentation via Projection-Based Context Embedding
    Dai, Hengming
    Hu, Xiangyun
    Zhang, Jinming
    Shu, Zhen
    Xu, Jiabo
    Du, Juan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [24] DCNet: Large-Scale Point Cloud Semantic Segmentation With Discriminative and Efficient Feature Aggregation
    Yin, Fukun
    Huang, Zilong
    Chen, Tao
    Luo, Guozhong
    Yu, Gang
    Fu, Bin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 4083 - 4095
  • [25] MCTNet: Multiscale Cross-Attention-Based Transformer Network for Semantic Segmentation of Large-Scale Point Cloud
    Guo, Bo
    Deng, Liwei
    Wang, Ruisheng
    Guo, Wenchao
    Ng, Alex Hay-Man
    Bai, Wenfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [26] Learning Semantic Segmentation of Large-Scale Point Clouds With Random Sampling
    Hu, Qingyong
    Yang, Bo
    Xie, Linhai
    Rosa, Stefano
    Guo, Yulan
    Wang, Zhihua
    Trigoni, Niki
    Markham, Andrew
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) : 8338 - 8354
  • [27] FPS-Net: A convolutional fusion network for large-scale LiDAR point cloud segmentation
    Xiao, Aoran
    Yang, Xiaofei
    Lu, Shijian
    Guan, Dayan
    Huang, Jiaxing
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 176 : 237 - 249
  • [28] THE INFLUENCE OF CHANGING FEATURES ON THE ACCURACY OF DEEP LEARNING-BASED LARGE-SCALE OUTDOOR LIDAR SEMANTIC SEGMENTATION
    Liu, Chang
    Zhang, Qi
    Shirowzhan, Sara
    Bai, Ting
    Sheng, Ziheng
    Wu, Yunhao
    Kuang, Jianming
    Ge, Linlin
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 4443 - 4446
  • [29] Hybrid Offset Position Encoding for Large-Scale Point Cloud Semantic Segmentation
    Xiao, Yu
    Wu, Hui
    Chen, Yisheng
    Chen, Chongcheng
    Dong, Ruihai
    Lin, Ding
    REMOTE SENSING, 2025, 17 (02)
  • [30] FlyCore: Fast Low-Frequency Coarse Registration of Large-Scale Outdoor LiDAR Point Clouds
    Li, Zikuan
    Zhang, Kaijun
    Wang, Zhoutao
    Wu, Sibo
    Zhang, Xiao-Ping
    Wei, Mingqiang
    Wang, Jun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62