SoftPoolNet: Shape Descriptor for Point Cloud Completion and Classification

被引:45
作者
Wang, Yida [1 ]
Tan, David Joseph [2 ]
Navab, Nassir [1 ]
Tombari, Federico [1 ,2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Google Inc, Menlo Pk, CA USA
来源
COMPUTER VISION - ECCV 2020, PT III | 2020年 / 12348卷
关键词
D O I
10.1007/978-3-030-58580-8_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point clouds are often the default choice for many applications as they exhibit more flexibility and efficiency than volumetric data. Nevertheless, their unorganized nature - points are stored in an unordered way - makes them less suited to be processed by deep learning pipelines. In this paper, we propose a method for 3D object completion and classification based on point clouds. We introduce a new way of organizing the extracted features based on their activations, which we name soft pooling. For the decoder stage, we propose regional convolutions, a novel operator aimed at maximizing the global activation entropy. Furthermore, inspired by the local refining procedure in Point Completion Network (PCN), we also propose a patch-deforming operation to simulate deconvolutional operations for point clouds. This paper proves that our regional activation can be incorporated in many point cloud architectures like AtlasNet and PCN, leading to better performance for geometric completion. We evaluate our approach on different 3D tasks such as object completion and classification, achieving state-of-the-art accuracy.
引用
收藏
页码:70 / 85
页数:16
相关论文
共 27 条
[1]  
Achlioptas P, 2018, PR MACH LEARN RES, V80
[2]  
Arief H.A., 2019, P IEEE C COMP VIS PA, P26
[3]   SUPPORT-VECTOR NETWORKS [J].
CORTES, C ;
VAPNIK, V .
MACHINE LEARNING, 1995, 20 (03) :273-297
[4]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[5]   Vision meets robotics: The KITTI dataset [J].
Geiger, A. ;
Lenz, P. ;
Stiller, C. ;
Urtasun, R. .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) :1231-1237
[6]   A Papier-Mache Approach to Learning 3D Surface Generation [J].
Groueix, Thibault ;
Fisher, Matthew ;
Kim, Vladimir G. ;
Russell, Bryan C. ;
Aubry, Mathieu .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :216-224
[7]   Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds From Multiple Angles by Joint Self-Reconstruction and Half-to-Half Prediction [J].
Han, Zhizhong ;
Wang, Xiyang ;
Liu, Yu-Shen ;
Zwicker, Matthias .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :10441-10450
[8]   Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs [J].
Landrieu, Loic ;
Simonovsky, Martin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4558-4567
[9]   A Novel Earth Mover's Distance Methodology for Image Matching with Gaussian Mixture Models [J].
Li, Peihua ;
Wang, Qilong ;
Zhang, Lei .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :1689-1696
[10]  
Li Y, 2018, ADV NEUR IN, V31