Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation

被引:0
|
作者
He, Xiang [1 ]
Li, Xu [1 ]
Ni, Peizhou [1 ]
Xu, Wang [1 ]
Xu, Qimin [1 ]
Liu, Xixiang [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Laser radar; Semantic segmentation; Transformers; Convolution; Three-dimensional displays; Kernel; Accuracy; Topology; Semantics; LiDAR semantic segmentation; long-range features; point cloud; Transformer;
D O I
10.1109/TGRS.2024.3492008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semantic segmentation of large-scale outdoor point cloud captured by light detection and ranging (LiDAR) sensors can provide fine-grain and stereoscopic comprehension for the surrounding environment. However, limited by the receptive field of convolution kernel and ignoration of specific spatial properties inherent to the large-scale outdoor point cloud, the existing advanced LiDAR semantic segmentation methods inevitably abandon the unique radial long-range topological relationships. To this end, from the LiDAR perspective, we propose a novel Radial Transformer that can naturally and efficiently exploit the radial long-range dependencies exclusive to the outdoor point cloud for accurate LiDAR semantic segmentation. Specifically, we first develop a radial window partition to generate a series of candidate point sequences and then construct the long-range interactions among the densely continuous point sequences by the self-attention mechanism. Moreover, considering the varying-distance distribution of point cloud in 3-D space, a spatial-adaptive position encoding is particularly designed to elaborate the relative position. Furthermore, we fusion radial balanced attention for a better structure representation of real-world scenes and distant points. Extensive experiments demonstrate the effectiveness and superiority of our method, which achieves 67.5% and 77.7% mean intersection-over-union (mIoU) on two recognized large-scale outdoor LiDAR point cloud datasets SemanticKITTI and nuScenes, respectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Large-scale point cloud semantic segmentation via local perception and global descriptor vector
    Zeng, Ziyin
    Xu, Yongyang
    Xie, Zhong
    Tang, Wei
    Wan, Jie
    Wu, Weichao
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 246
  • [32] A 3D Semantic Segmentation Method for Large-Scale Point Cloud on Deep Learning
    Liu, Sihan
    Zhang, Wenyu
    Zhang, Yujun
    Wang, Zhijian
    Gao, Dongxiang
    ENGINEERING LETTERS, 2023, 31 (04) : 1667 - 1674
  • [33] Perturbed Self-Distillation: Weakly Supervised Large-Scale Point Cloud Semantic Segmentation
    Zhang, Yachao
    Qu, Yanyun
    Xie, Yuan
    Li, Zonghao
    Zheng, Shanshan
    Li, Cuihua
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15500 - 15508
  • [34] DALES: A Large-scale Aerial LiDAR Data Set for Semantic Segmentation
    Varney, Nina
    Asari, Vijayan K.
    Graehling, Quinn
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 717 - 726
  • [35] Pyramid Point Cloud Transformer for Large-Scale Place Recognition
    Hui, Le
    Yang, Hang
    Cheng, Mingmei
    Xie, Jin
    Yang, Jian
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6078 - 6087
  • [36] Semantic segmentation of large-scale point clouds with neighborhood uncertainty
    Bao, Yong
    Wen, Haibiao
    Zhang, Baoqing
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (21) : 60949 - 60964
  • [37] Semantic segmentation of surface from lidar point cloud
    Mukherjee, Aritra
    Das, Sourya Dipta
    Ghosh, Jasorsi
    Chowdhury, Ananda S.
    Saha, Sanjoy Kumar
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (28-29) : 35171 - 35191
  • [38] Camera and LiDAR Fusion for Point Cloud Semantic Segmentation
    Abdelkader, Ali
    Moustafa, Mohamed
    PROCEEDINGS OF SEVENTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2022, VOL. 3, 2023, 464 : 499 - 508
  • [39] Semantic segmentation of surface from lidar point cloud
    Aritra Mukherjee
    Sourya Dipta Das
    Jasorsi Ghosh
    Ananda S. Chowdhury
    Sanjoy Kumar Saha
    Multimedia Tools and Applications, 2021, 80 : 35171 - 35191
  • [40] Semantic Segmentation of Lidar Point Cloud in Rural Area
    Bayu, Azady
    Wibisono, Ari
    Wisesa, Hanif Arief
    Intizhami, Naili Suri
    Jatmiko, Wisnu
    Gamal, Ahmad
    2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION, NETWORKS AND SATELLITE (COMNETSAT), 2019, : 73 - 78