Incorporating Human Domain Knowledge in 3-D LiDAR-Based Semantic Segmentation

被引:21
作者
Mei, Jilin [1 ]
Zhao, Huijing [1 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2020年 / 5卷 / 02期
基金
中国国家自然科学基金;
关键词
3D LiDAR data; semantic segmentation; human domain knowledge;
D O I
10.1109/TIV.2019.2955851
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article studies semantic segmentation using 3D LiDAR data. Popular deep learning methods applied for this task require a large number of manual annotations to train the parameters. We propose a new method that makes full use of the advantages of traditional methods and deep learning methods via incorporating human domain knowledge into the neural network model to reduce the demand for large numbers of manual annotations and improve the training efficiency. We first pretrain a model with autogenerated samples from a rule-based classifier so that human knowledge can be propagated into the network. Based on the pretrained model, only a small set of annotations is required for further fine-tuning. Quantitative experiments show that the pretrained model achieves better performance than random initialization in almost all cases; furthermore, ourmethod can achieve similar performance with fewer manual annotations.
引用
收藏
页码:178 / 187
页数:10
相关论文
共 29 条
[1]   What's the Point: Semantic Segmentation with Point Supervision [J].
Bearman, Amy ;
Russakovsky, Olga ;
Ferrari, Vittorio ;
Fei-Fei, Li .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :549-565
[2]   Graph cuts and efficient N-D image segmentation [J].
Boykov, Yuri ;
Funka-Lea, Gareth .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2006, 70 (02) :109-131
[3]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[4]   BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation [J].
Dai, Jifeng ;
He, Kaiming ;
Sun, Jian .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1635-1643
[5]  
Dewan A, 2017, IEEE INT C INT ROBOT, P3544, DOI 10.1109/IROS.2017.8206198
[6]   Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds [J].
Engelmann, Francis ;
Kontogianni, Theodora ;
Hermans, Alexander ;
Leibe, Bastian .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :716-724
[7]  
Erhan D, 2010, J MACH LEARN RES, V11, P625
[8]  
Garcia A, 2017, APPR DIGIT GAME STUD, V5, P1
[9]  
Hackel T, 2017, ISPRS Annals of the Photogrammetry, Remote Sensing Spatial Info. Sci., DOI [10.5194/isprs-annals-IV-1-W1-91-2017, DOI 10.5194/ISPRS-ANNALS-IV-1-W1-91-2017]
[10]   Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs [J].
Landrieu, Loic ;
Simonovsky, Martin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4558-4567