Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation

被引:0
|
作者
He, Xiang [1 ]
Li, Xu [1 ]
Ni, Peizhou [1 ]
Xu, Wang [1 ]
Xu, Qimin [1 ]
Liu, Xixiang [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Point cloud compression; Laser radar; Semantic segmentation; Transformers; Convolution; Three-dimensional displays; Kernel; Accuracy; Topology; Semantics; LiDAR semantic segmentation; long-range features; point cloud; Transformer;
D O I
10.1109/TGRS.2024.3492008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semantic segmentation of large-scale outdoor point cloud captured by light detection and ranging (LiDAR) sensors can provide fine-grain and stereoscopic comprehension for the surrounding environment. However, limited by the receptive field of convolution kernel and ignoration of specific spatial properties inherent to the large-scale outdoor point cloud, the existing advanced LiDAR semantic segmentation methods inevitably abandon the unique radial long-range topological relationships. To this end, from the LiDAR perspective, we propose a novel Radial Transformer that can naturally and efficiently exploit the radial long-range dependencies exclusive to the outdoor point cloud for accurate LiDAR semantic segmentation. Specifically, we first develop a radial window partition to generate a series of candidate point sequences and then construct the long-range interactions among the densely continuous point sequences by the self-attention mechanism. Moreover, considering the varying-distance distribution of point cloud in 3-D space, a spatial-adaptive position encoding is particularly designed to elaborate the relative position. Furthermore, we fusion radial balanced attention for a better structure representation of real-world scenes and distant points. Extensive experiments demonstrate the effectiveness and superiority of our method, which achieves 67.5% and 77.7% mean intersection-over-union (mIoU) on two recognized large-scale outdoor LiDAR point cloud datasets SemanticKITTI and nuScenes, respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Context-Aware Network for Semantic Segmentation Toward Large-Scale Point Clouds in Urban Environments
    Liu, Chun
    Zeng, Doudou
    Akbar, Akram
    Wu, Hangbin
    Jia, Shoujun
    Xu, Zeran
    Yue, Han
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [42] A dual projection method for semantic segmentation of large-scale point clouds
    Zhao, Haoying
    Zhou, Aimin
    VISUAL COMPUTER, 2025,
  • [43] GSIP: Green Semantic Segmentation of Large-Scale Indoor Point Clouds
    Zhang, Min
    Kadam, Pranav
    Liu, Shan
    Kuo, C. -C. Jay
    PATTERN RECOGNITION LETTERS, 2022, 164 : 9 - 15
  • [44] Large-Scale Unsupervised Semantic Segmentation
    Gao, Shanghua
    Li, Zhong-Yu
    Yang, Ming-Hsuan
    Cheng, Ming-Ming
    Han, Junwei
    Torr, Philip
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7457 - 7476
  • [45] Geometry-Injected Image-Based Point Cloud Semantic Segmentation
    Shuai, Hui
    Liu, Qingshan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [46] ELMF-Net: Semantic Segmentation of Large-Scale Point Clouds via Efficient Local Feature Learner and Multiscale Fusion
    Sun, Maomao
    Rui, Ting
    Wang, Dong
    Yang, Chengsong
    Zheng, Nan
    IEEE SENSORS JOURNAL, 2025, 25 (07) : 11392 - 11404
  • [47] Hybrid Cross-Transformer-KPConv for Point Cloud Segmentation
    Wen, Shuhuan
    Li, Pengjiang
    Zhang, Hong
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 126 - 130
  • [48] Online Semantic-Assisted Topological Map Building With LiDAR in Large-Scale Outdoor Environments: Toward Robust Place Recognition
    He, Guojian
    Zhang, Qinhan
    Zhuang, Yan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [49] TCFAP-Net: Transformer-based Cross-feature Fusion and Adaptive Perception Network for large-scale point cloud semantic segmentation
    Zhang, Jianjun
    Jiang, Zhipeng
    Qiu, Qinjun
    Liu, Zheng
    PATTERN RECOGNITION, 2024, 154
  • [50] An Unsupervised Learning Network for Large-Scale LiDAR Point Clouds Registration
    Liu, Jingbin
    Lv, Xuanfan
    Gong, Xiaodong
    Liang, Yifan
    Hyyppa, Juha
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (11) : 16187 - 16200