Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation

被引:0
|
作者
He, Xiang [1 ]
Li, Xu [1 ]
Ni, Peizhou [1 ]
Xu, Wang [1 ]
Xu, Qimin [1 ]
Liu, Xixiang [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Laser radar; Semantic segmentation; Transformers; Convolution; Three-dimensional displays; Kernel; Accuracy; Topology; Semantics; LiDAR semantic segmentation; long-range features; point cloud; Transformer;
D O I
10.1109/TGRS.2024.3492008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semantic segmentation of large-scale outdoor point cloud captured by light detection and ranging (LiDAR) sensors can provide fine-grain and stereoscopic comprehension for the surrounding environment. However, limited by the receptive field of convolution kernel and ignoration of specific spatial properties inherent to the large-scale outdoor point cloud, the existing advanced LiDAR semantic segmentation methods inevitably abandon the unique radial long-range topological relationships. To this end, from the LiDAR perspective, we propose a novel Radial Transformer that can naturally and efficiently exploit the radial long-range dependencies exclusive to the outdoor point cloud for accurate LiDAR semantic segmentation. Specifically, we first develop a radial window partition to generate a series of candidate point sequences and then construct the long-range interactions among the densely continuous point sequences by the self-attention mechanism. Moreover, considering the varying-distance distribution of point cloud in 3-D space, a spatial-adaptive position encoding is particularly designed to elaborate the relative position. Furthermore, we fusion radial balanced attention for a better structure representation of real-world scenes and distant points. Extensive experiments demonstrate the effectiveness and superiority of our method, which achieves 67.5% and 77.7% mean intersection-over-union (mIoU) on two recognized large-scale outdoor LiDAR point cloud datasets SemanticKITTI and nuScenes, respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] PointNAT: Large-Scale Point Cloud Semantic Segmentation via Neighbor Aggregation With Transformer
    Zeng, Ziyin
    Qiu, Huan
    Zhou, Jian
    Dong, Zhen
    Xiao, Jinsheng
    Li, Bijun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 18
  • [2] A reversible transformer for LiDAR point cloud semantic segmentation
    Akwensi, Perpertual Hope
    Wang, Ruisheng
    2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, : 19 - 28
  • [3] Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud
    Zhang, Yachao
    Li, Zonghao
    Xie, Yuan
    Qu, Yanyun
    Li, Cuihua
    Mei, Tao
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 3421 - 3429
  • [4] Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs
    Landrieu, Loic
    Simonovsky, Martin
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4558 - 4567
  • [5] pCTFusion: Point Convolution-Transformer Fusion with Semantic Aware Loss for Outdoor LiDAR Point Cloud Segmentation
    Kuriyal A.
    Kumar V.
    Lohani B.
    SN Computer Science, 5 (3)
  • [6] Radial awareness with adaptive hybrid CNN-Transformer range-view representation for outdoor LiDAR point cloud semantic segmentation
    He, Xiang
    Li, Xu
    Xu, Qimin
    Hu, Yue
    Sun, Zhengliang
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 271
  • [7] HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registration
    Lu, Fan
    Chen, Guang
    Liu, Yinlong
    Zhang, Lijun
    Qu, Sanqing
    Liu, Shu
    Gu, Rongqi
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15994 - 16003
  • [8] RailPC: A large-scale railway point cloud semantic segmentation dataset
    Jiang, Tengping
    Li, Shiwei
    Zhang, Qinyu
    Wang, Guangshuai
    Zhang, Zequn
    Zeng, Fankun
    An, Peng
    Jin, Xin
    Liu, Shan
    Wang, Yongjun
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (06) : 1548 - 1560
  • [9] Cascaded Contextual Reasoning for Large-Scale Point Cloud Semantic Segmentation
    Zhang, Fengyi
    Xia, Xiuyu
    IEEE ACCESS, 2023, 11 : 20755 - 20768
  • [10] TempNet: Online Semantic Segmentation on Large-scale Point Cloud Series
    Zhou, Yunsong
    Zhu, Hongzi
    Li, Chunqin
    Cui, Tiankai
    Chang, Shan
    Guo, Minyi
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7098 - 7107