Semantic Segmentation Method of On-board Lidar Point Cloud Based on Sparse Convolutional Neural Network

被引：0
作者：
Xia X. [1 ]
Wang D. [1 ]
Cao J. [1 ]
Zhao G. [1 ]
Zhang J. [1 ]
机构：
[1] School of Automotive Engineering, Harbin Institute of Technology, Weihai
来源：
Qiche Gongcheng/Automotive Engineering | 2022年 / 44卷 / 01期
关键词：
Autonomous driving; Point cloud; Semantic segmentation; Sparse convolution neural network;
D O I：
10.19562/j.chinasae.qcgc.2022.01.004
中图分类号：
学科分类号：
摘要：
The semantic segmentation of point cloud obtained by on-board lidar scanning is one of the important means for ensuring driving safety and enhancing the driver's understanding of surrounding environment. Due to memory limitation and the sparse characteristics of large-scale point cloud scenes, directly continue to apply the traditional neural network approach to the large-scale point cloud scenario does not work well. Therefore, taking the advantage of the sparseness of large-scale point cloud, sparse convolutional neural network (sparse CNN) is used to extract the characteristics of voxel cloud in this paper. With consideration of the information loss cause by density inconsistence in point-wise processing sub-branch suppressed point cloud data, additional 3D-CA and 3D-SA modules are designed to improve the characteristics extraction of sparse CNN. The results of experiment show that compared with traditional convolutional neural network method and point cloud projection on plane method, the sparse CNN method for the semantic segmentation of large scale point cloud can have 4.1% and 3.4% higher IOU respectively, demonstrating the effectiveness of the method adopted. © 2022, Society of Automotive Engineers of China. All right reserved.
引用
收藏
页码：26 / 35
页数：9
相关论文
共 25 条
  • [1] HE H., Research on semantic segmentation of 3D point cloud, (2020)
  • [2] GUO Y, WANG H, HU Q, Et al., Deep learning for 3D point clouds: a survey, IEEE Transactions on Pattern Analysis and Machine Intelligence, (2020)
  • [3] SU H, MAJI S, KALOGERAKIS E, Et al., Multi-view convolutional neural networks for 3D shape recognition, Proceedings of the IEEE international conference on computer vision, pp. 945-953, (2015)
  • [4] WU B, WAN A, YUE X, Et al., SqueezeSeg: convolutional neural nets with recurrent CRF for real-time road-object segmentation from 3D LiDAR point cloud, 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 1887-1893, (2018)
  • [5] IANDOLA F N, HAN S, MOSKEWICZ M W, Et al., SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size, (2016)
  • [6] WU B, ZHOU X, ZHAO S, Et al., SqueezeSegV2: improved model structure and unsupervised domain adaptation for road-object segmentation from a LiDAR point cloud, 2019 International Conference on Robotics and Automation (ICRA), pp. 4376-4382, (2019)
  • [7] XU C, WU B, WANG Z, Et al., SqueezeSegV3: Spatially-adaptive convolution for efficient point-cloud segmentation, European Conference on Computer Vision, pp. 1-19, (2020)
  • [8] CORTINHAL T, TZELEPIS G, AKSORY E, Et al., SalsaNext: fast, uncertainty-aware semantic segmentation of lidar point clouds for autonomous driving, (2020)
  • [9] HUANG J, YOU S., Point cloud labeling using 3D Convolutional neural network, 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 2670-2675, (2016)
  • [10] MENG H, GAO L, LAI Y, Et al., VV-Net: voxel vae net with group convolutions for point cloud segmentation, 2019 IEEE/CVF International Conference on Computer Vision, pp. 8500-8508, (2019)
123