Scene-Adaptive 3D Semantic Segmentation Based on Multi-Level Boundary-Semantic-Enhancement for Intelligent Vehicles

被引:12
作者
Ni, Peizhou [1 ]
Li, Xu [1 ]
Kong, Dong [1 ]
Yin, Xiaoqing [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2024年 / 9卷 / 01期
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Three-dimensional displays; Feature extraction; Point cloud compression; Semantic segmentation; Laser radar; Semantics; Real-time systems; Attentional fusion; boundary enhancement; discriminator; LiDAR semantic segmentation; scene-adaptivity; semantic enhancement; AWARE; LIDAR; OBJECT;
D O I
10.1109/TIV.2023.3274949
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D semantic segmentation is a key technology of scene understanding in the self-driving field, which remains challenging problems. Recent 3D segmentation methods have achieved competitive results in indoor or typical urban traffic scenes. However, in complex and changeable scenarios where structured features are sparse and irregular, few of these methods could achieve well segmentation results, especially causing blurry and inaccurate boundary distinctions between inter-class objects, drivable areas, and backgrounds. In order to fully harvest boundary information and accurately distinguish the category of points on road and object boundaries in real-time, we present an efficient multi-level boundary-semantic-enhanced model for LiDAR semantic segmentation, which comprehensively discover boundary features in three aspects: first, boundary channels are extracted directly from LiDAR range images as the inputs of boundary-branch; second, the boundary attention module is designed to deeply fuse boundary information into the main segmentation branch; third, a modified discriminator is utilized to raise the perception of boundary information by minimizing the gap between the predicted and true boundaries. Besides, we add a semantic-enhanced module using the similar discriminator to optimize semantic segmentation results in the output end. Quantitative and qualitative evaluations are performed on both structured and unstructured real-world datasets including urban dataset SemanticKITTI, off-road dataset Rellis3D and our unstructured test set. The experimental results validate the effectiveness of the proposed methodology in improving efficiency, accuracy and scene-adaptivity.
引用
收藏
页码:1722 / 1732
页数:11
相关论文
共 45 条
[21]   Patchwork: Concentric Zone-Based Region-Wise Ground Segmentation With Ground Likelihood Estimation Using a 3D LiDAR Sensor [J].
Lim, Hyungtae ;
Oh, Minho ;
Myung, Hyun .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) :6458-6465
[22]  
Liu ZJ, 2019, ADV NEUR IN, V32
[23]  
Long J, 2015, PROC CVPR IEEE, P3431, DOI 10.1109/CVPR.2015.7298965
[24]   Boundary-Aware graph Markov neural network for semiautomated object segmentation from point clouds [J].
Luo, Huan ;
Zheng, Quan ;
Fang, Lina ;
Guo, Yingya ;
Guo, Wenzhong ;
Wang, Cheng ;
Li, Jonathan .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 104
[25]   Boundary-Aware and Semiautomatic Segmentation of 3-D Object in Point Clouds [J].
Luo, Huan ;
Zheng, Quan ;
Wang, Cheng ;
Guo, Wenzhong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) :910-914
[26]   Incorporating Human Domain Knowledge in 3-D LiDAR-Based Semantic Segmentation [J].
Mei, Jilin ;
Zhao, Huijing .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2020, 5 (02) :178-187
[27]   Adversarial Learning and Self-Teaching Techniques for Domain Adaptation in Semantic Segmentation [J].
Michieli, Umberto ;
Biasetton, Matteo ;
Agresti, Gianluca ;
Zanuttigh, Pietro .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2020, 5 (03) :508-518
[28]   Image Segmentation Using Deep Learning: A Survey [J].
Minaee, Shervin ;
Boykov, Yuri Y. ;
Porikli, Fatih ;
Plaza, Antonio J. ;
Kehtarnavaz, Nasser ;
Terzopoulos, Demetri .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) :3523-3542
[29]   PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation [J].
Qi, Charles R. ;
Su, Hao ;
Mo, Kaichun ;
Guibas, Leonidas J. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :77-85
[30]   RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds [J].
Hu, Qingyong ;
Yang, Bo ;
Xie, Linhai ;
Rosa, Stefano ;
Guo, Yulan ;
Wang, Zhihua ;
Trigoni, Niki ;
Markham, Andrew .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11105-11114