Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation

被引:0
|
作者
He, Xiang [1 ]
Li, Xu [1 ]
Ni, Peizhou [1 ]
Xu, Wang [1 ]
Xu, Qimin [1 ]
Liu, Xixiang [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Laser radar; Semantic segmentation; Transformers; Convolution; Three-dimensional displays; Kernel; Accuracy; Topology; Semantics; LiDAR semantic segmentation; long-range features; point cloud; Transformer;
D O I
10.1109/TGRS.2024.3492008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semantic segmentation of large-scale outdoor point cloud captured by light detection and ranging (LiDAR) sensors can provide fine-grain and stereoscopic comprehension for the surrounding environment. However, limited by the receptive field of convolution kernel and ignoration of specific spatial properties inherent to the large-scale outdoor point cloud, the existing advanced LiDAR semantic segmentation methods inevitably abandon the unique radial long-range topological relationships. To this end, from the LiDAR perspective, we propose a novel Radial Transformer that can naturally and efficiently exploit the radial long-range dependencies exclusive to the outdoor point cloud for accurate LiDAR semantic segmentation. Specifically, we first develop a radial window partition to generate a series of candidate point sequences and then construct the long-range interactions among the densely continuous point sequences by the self-attention mechanism. Moreover, considering the varying-distance distribution of point cloud in 3-D space, a spatial-adaptive position encoding is particularly designed to elaborate the relative position. Furthermore, we fusion radial balanced attention for a better structure representation of real-world scenes and distant points. Extensive experiments demonstrate the effectiveness and superiority of our method, which achieves 67.5% and 77.7% mean intersection-over-union (mIoU) on two recognized large-scale outdoor LiDAR point cloud datasets SemanticKITTI and nuScenes, respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Outdoor LiDAR Point Cloud Building Segmentation: Progress and Challenge
    Gamal, Ahmad
    Husodo, Ario Yudo
    Jati, Grafika
    Alhamidi, Machmud R.
    Ma'sum, M. Anwar
    Ardhianto, Ronni
    Jatmiko, Wisnu
    13TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER SCIENCE AND INFORMATION SYSTEMS (ICACSIS 2021), 2021, : 1 - 6
  • [42] Robust Point Cloud Based Reconstruction of Large-Scale Outdoor Scenes
    Lan, Ziquan
    Yew, Zi Jian
    Lee, Gim Hee
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9682 - 9690
  • [43] Semantic Segmentation of Large-Scale Outdoor Point Clouds by Encoder-Decoder Shared MLPs with Multiple Losses
    Rim, Beanbonyka
    Lee, Ahyoung
    Hong, Min
    REMOTE SENSING, 2021, 13 (16)
  • [44] TOWARDS ACCURATE INSTANCE SEGMENTATION IN LARGE-SCALE LIDAR POINT CLOUDS
    Xiang, Binbin
    Peters, Torben
    Kontogianni, Theodora
    Vetterli, Frawa
    Puliti, Stefano
    Astrup, Rasmus
    Schindler, Konrad
    GEOSPATIAL WEEK 2023, VOL. 10-1, 2023, : 605 - 612
  • [45] 3D semantic segmentation using deep learning for large-scale indoor point cloud
    Chen Hui
    Xu Peng
    Zuo Yipeng
    Wang Weina
    PROCEEDINGS OF 2019 14TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), 2019, : 1650 - 1655
  • [46] A large-scale point cloud semantic segmentation network via local dual features and global correlations
    Zhao, Yiqiang
    Ma, Xingyi
    Hu, Bin
    Zhang, Qi
    Ye, Mao
    Zhou, Guoqing
    COMPUTERS & GRAPHICS-UK, 2023, 111 : 133 - 144
  • [47] Multistage Scene-Level Constraints for Large-Scale Point Cloud Weakly Supervised Semantic Segmentation
    Su, Yanfei
    Cheng, Ming
    Yuan, Zhimin
    Liu, Weiquan
    Zeng, Wankang
    Wang, Cheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [48] Reflective Noise Filtering of Large-Scale Point Cloud Using Transformer
    Gao, Rui
    Li, Mengyu
    Yang, Seung-Jun
    Cho, Kyungeun
    REMOTE SENSING, 2022, 14 (03)
  • [49] LessNet: Lightweight and efficient semantic segmentation for large-scale point clouds
    Feng, Guoqiang
    Li, Weilong
    Zhao, Xiaolin
    Yang, Xuemeng
    Kong, Xin
    Huang, TianXin
    Cui, Jinhao
    IET CYBER-SYSTEMS AND ROBOTICS, 2022, 4 (02) : 107 - 115
  • [50] BushNet: Effective semantic segmentation of bush in large-scale point clouds
    Wei, Hejun
    Xu, Enyong
    Zhang, Jinlai
    Meng, Yanmei
    Wei, Jin
    Dong, Zhen
    Li, Zhengqiang
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 193