Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation

被引:0
|
作者
He, Xiang [1 ]
Li, Xu [1 ]
Ni, Peizhou [1 ]
Xu, Wang [1 ]
Xu, Qimin [1 ]
Liu, Xixiang [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Point cloud compression; Laser radar; Semantic segmentation; Transformers; Convolution; Three-dimensional displays; Kernel; Accuracy; Topology; Semantics; LiDAR semantic segmentation; long-range features; point cloud; Transformer;
D O I
10.1109/TGRS.2024.3492008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semantic segmentation of large-scale outdoor point cloud captured by light detection and ranging (LiDAR) sensors can provide fine-grain and stereoscopic comprehension for the surrounding environment. However, limited by the receptive field of convolution kernel and ignoration of specific spatial properties inherent to the large-scale outdoor point cloud, the existing advanced LiDAR semantic segmentation methods inevitably abandon the unique radial long-range topological relationships. To this end, from the LiDAR perspective, we propose a novel Radial Transformer that can naturally and efficiently exploit the radial long-range dependencies exclusive to the outdoor point cloud for accurate LiDAR semantic segmentation. Specifically, we first develop a radial window partition to generate a series of candidate point sequences and then construct the long-range interactions among the densely continuous point sequences by the self-attention mechanism. Moreover, considering the varying-distance distribution of point cloud in 3-D space, a spatial-adaptive position encoding is particularly designed to elaborate the relative position. Furthermore, we fusion radial balanced attention for a better structure representation of real-world scenes and distant points. Extensive experiments demonstrate the effectiveness and superiority of our method, which achieves 67.5% and 77.7% mean intersection-over-union (mIoU) on two recognized large-scale outdoor LiDAR point cloud datasets SemanticKITTI and nuScenes, respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] SectorGSnet: Sector Learning for Efficient Ground Segmentation of Outdoor LiDAR Point Clouds
    He, Dong
    Abid, Furqan
    Kim, Young-Min
    Kim, Jong-Hwan
    IEEE ACCESS, 2022, 10 : 11938 - 11946
  • [32] Large-scale point cloud semantic segmentation via local perception and global descriptor vector
    Zeng, Ziyin
    Xu, Yongyang
    Xie, Zhong
    Tang, Wei
    Wan, Jie
    Wu, Weichao
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 246
  • [33] Semantic segmentation of large-scale point clouds by integrating attention mechanisms and transformer models
    Yuan, Tiebiao
    Yu, Yangyang
    Wang, Xiaolong
    IMAGE AND VISION COMPUTING, 2024, 146
  • [34] A Fast and Accurate Segmentation Method for Ordered LiDAR Point Cloud of Large-Scale Scenes
    Zhou, Ying
    Wang, Dan
    Xie, Xiang
    Ren, Yiyi
    Li, Guolin
    Deng, Yangdong
    Wang, Zhihua
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2014, 11 (11) : 1981 - 1985
  • [35] Semantic Segmentation of Spectral LiDAR Point Clouds Based on Neural Architecture Search
    Zhang, Qi
    Peng, Yuanxi
    Zhang, Zhiwen
    Li, Teng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [36] UM2Former: U-Shaped Multimixed Transformer Network for Large-Scale Hyperspectral Image Semantic Segmentation
    Xu, Aijun
    Xue, Zhaohui
    Li, Ziyu
    Cheng, Shun
    Su, Hongjun
    Xia, Junshi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [37] FAR-Net: Semantic Segmentation of Large-Scale Point Clouds Based on Feature Aggregation and Recoding for Aerial Computing
    Zhang, Jianlong
    Chen, Huangwei
    Wang, Bin
    Fang, Guangzu
    Zhou, Yang
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (06): : 5217 - 5227
  • [38] A large-scale point cloud semantic segmentation network via local dual features and global correlations
    Zhao, Yiqiang
    Ma, Xingyi
    Hu, Bin
    Zhang, Qi
    Ye, Mao
    Zhou, Guoqing
    COMPUTERS & GRAPHICS-UK, 2023, 111 : 133 - 144
  • [39] Learning Hybrid Semantic Affinity for Point Cloud Segmentation
    Song, Zhanjie
    Zhao, Linqing
    Zhou, Jie
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4599 - 4612
  • [40] 3D Large-Scale Point Cloud Semantic Segmentation Using Optimal Feature Description Vector Network: OFDV-Net
    Jian Li
    Quan Sun
    Chen, Keru
    Hao Cui
    Kuan Huangfu
    Chen, Xiaolong
    IEEE ACCESS, 2020, 8 (08): : 226285 - 226296