LPD-Net: 3D Point Cloud Learning for Large-Scale Place Recognition and Environment Analysis

被引:245
作者
Liu, Zhe [1 ]
Zhou, Shunbo [1 ]
Suo, Chuanzhe [1 ]
Yin, Peng [3 ]
Chen, Wen [1 ]
Wang, Hesheng [2 ]
Li, Haoang [1 ]
Liu, Yun-Hui [1 ]
机构
[1] Chinese Univ Hong Kong, Hong Kong, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[3] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
来源
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) | 2019年
关键词
D O I
10.1109/ICCV.2019.00292
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud based place recognition is still an open issue due to the difficulty in extracting local features from the raw 3D point cloud and generating the global descriptor, and it's even harder in the large-scale dynamic environments. In this paper, we develop a novel deep neural network, named LPD-Net (Large-scale Place Description Network), which can extract discriminative and generalizable global descriptors from the raw 3D point cloud. Two modules, the adaptive local feature extraction module and the graph-based neighborhood aggregation module, are proposed, which contribute to extract the local structures and reveal the spatial distribution of local features in the large-scale point cloud, with an end-to-end manner. We implement the proposed global descriptor in solving point cloud based retrieval tasks to achieve the large-scale place recognition. Comparison results show that our LPD-Net is much better than PointNetVLAD and reaches the state-of-the-art. We also compare our LPD-Net with the vision-based solutions to show the robustness of our approach to different weather and light conditions.
引用
收藏
页码:2831 / 2840
页数:10
相关论文
共 28 条
[1]  
[Anonymous], 2009, IEEE INT C ROB AUT, DOI DOI 10.1109/R0B0T.2009.5152473
[2]  
Arandjelovic R, 2018, IEEE T PATTERN ANAL, V40, P1437, DOI [10.1109/CVPR.2016.572, 10.1109/TPAMI.2017.2711011]
[3]  
Battaglia Peter W., 2018, ARXIV180601261V2
[4]   Multi-View 3D Object Detection Network for Autonomous Driving [J].
Chen, Xiaozhi ;
Ma, Huimin ;
Wan, Ji ;
Li, Bo ;
Xia, Tian .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6526-6534
[5]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[6]  
Dube R., 2017, P IEEE INT C ROB AUT, P5266
[7]  
Engelmann Francis, 2018, P IEEE EUR C COMP VI
[8]  
Fossel J, 2017, IEEE INT C INT ROBOT, P6764, DOI 10.1109/IROS.2017.8206594
[9]   SO-Net: Self-Organizing Network for Point Cloud Analysis [J].
Li, Jiaxin ;
Chen, Ben M. ;
Lee, Gim Hee .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9397-9406
[10]   Shape classification using the inner-distance [J].
Ling, Haibin ;
Jacobs, David W. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (02) :286-299