Scene-Adaptive 3D Semantic Segmentation Based on Multi-Level Boundary-Semantic-Enhancement for Intelligent Vehicles

被引:10
作者
Ni, Peizhou [1 ]
Li, Xu [1 ]
Kong, Dong [1 ]
Yin, Xiaoqing [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2024年 / 9卷 / 01期
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Three-dimensional displays; Feature extraction; Point cloud compression; Semantic segmentation; Laser radar; Semantics; Real-time systems; Attentional fusion; boundary enhancement; discriminator; LiDAR semantic segmentation; scene-adaptivity; semantic enhancement; AWARE; LIDAR; OBJECT;
D O I
10.1109/TIV.2023.3274949
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D semantic segmentation is a key technology of scene understanding in the self-driving field, which remains challenging problems. Recent 3D segmentation methods have achieved competitive results in indoor or typical urban traffic scenes. However, in complex and changeable scenarios where structured features are sparse and irregular, few of these methods could achieve well segmentation results, especially causing blurry and inaccurate boundary distinctions between inter-class objects, drivable areas, and backgrounds. In order to fully harvest boundary information and accurately distinguish the category of points on road and object boundaries in real-time, we present an efficient multi-level boundary-semantic-enhanced model for LiDAR semantic segmentation, which comprehensively discover boundary features in three aspects: first, boundary channels are extracted directly from LiDAR range images as the inputs of boundary-branch; second, the boundary attention module is designed to deeply fuse boundary information into the main segmentation branch; third, a modified discriminator is utilized to raise the perception of boundary information by minimizing the gap between the predicted and true boundaries. Besides, we add a semantic-enhanced module using the similar discriminator to optimize semantic segmentation results in the output end. Quantitative and qualitative evaluations are performed on both structured and unstructured real-world datasets including urban dataset SemanticKITTI, off-road dataset Rellis3D and our unstructured test set. The experimental results validate the effectiveness of the proposed methodology in improving efficiency, accuracy and scene-adaptivity.
引用
收藏
页码:1722 / 1732
页数:11
相关论文
共 45 条
  • [1] Aishwarya L., 2020, P IEEE 11 INT C COMP, P1, DOI [10.1109/ICCCNT49239.2020.9225268, DOI 10.1109/ICCCNT49239.2020.9225268]
  • [2] SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
    Behley, Jens
    Garbade, Martin
    Milioto, Andres
    Quenzel, Jan
    Behnke, Sven
    Stachniss, Cyrill
    Gall, Juergen
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9296 - 9306
  • [3] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
    Chen, Liang-Chieh
    Papandreou, George
    Kokkinos, Iasonas
    Murphy, Kevin
    Yuille, Alan L.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 834 - 848
  • [4] RangeSeg: Range-Aware Real Time Segmentation of 3D LiDAR Point Clouds
    Chen, Tzu-Hsuan
    Chang, Tian Sheuan
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2022, 7 (01): : 93 - 101
  • [5] 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
    Choy, Christopher
    Gwak, JunYoung
    Savarese, Silvio
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3070 - 3079
  • [6] Cortinhal Tiago, 2020, Advances in Visual Computing. 15th International Symposium, ISVC 2020. Proceedings. Lecture Notes in Computer Science (LNCS 12510), P207, DOI 10.1007/978-3-030-64559-5_16
  • [7] Gao B, 2019, IEEE INT VEH SYM, P1505, DOI 10.1109/IVS.2019.8814143
  • [8] Gong JY, 2021, AAAI CONF ARTIF INTE, V35, P1424
  • [9] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [10] An Analytic Model for Negative Obstacle Detection with Lidar and Numerical Validation Using Physics-Based Simulation
    Goodin, Christopher
    Carrillo, Justin
    Monroe, J. Gabriel
    Carruth, Daniel W.
    Hudson, Christopher R.
    [J]. SENSORS, 2021, 21 (09)