Point Cloud Instance Segmentation using Probabilistic Embeddings

被引:27
作者
Zhang, Biao [1 ]
Wonka, Peter [1 ]
机构
[1] KAUST, Thuwal, Saudi Arabia
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 | 2021年
关键词
D O I
10.1109/CVPR46437.2021.00877
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we propose a new framework for point cloud instance segmentation. Our framework has two steps: an embedding step and a clustering step. In the embedding step, our main contribution is to propose a probabilistic embedding space for point cloud embedding. Specifically, each point is represented as a tri-variate normal distribution. In the clustering step, we propose a novel loss function, which benefits both the semantic segmentation and the clustering. Our experimental results show important improvements to the SOTA, i.e., 3.1% increased average per-category mAP on the PartNet dataset.
引用
收藏
页码:8879 / 8888
页数:10
相关论文
共 36 条
[1]  
[Anonymous], pervised Semantic Segmentation via Adversarial Learning
[2]  
Bengio Y., 2005, Advances in Neural Information Processing Systems (NeurIPS)
[3]  
Chang A X, 2015, COMPUTER SCI, V1512, P3
[4]   4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks [J].
Choy, Christopher ;
Gwak, JunYoung ;
Savarese, Silvio .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3070-3079
[5]   ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes [J].
Dai, Angela ;
Chang, Angel X. ;
Savva, Manolis ;
Halber, Maciej ;
Funkhouser, Thomas ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2432-2443
[6]  
De Brabandere Bert, 2017, arXiv
[7]  
Dorta Garoe, 2018, IEEE C COMP VIS PATT
[8]   3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation [J].
Engelmann, Francis ;
Bokeloh, Martin ;
Fathi, Alireza ;
Leibe, Bastian ;
Niessner, Matthias .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9028-9037
[9]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[10]   OccuSeg: Occupancy-aware 3D Instance Segmentation [J].
Han, Lei ;
Zheng, Tian ;
Xu, Lan ;
Fang, Lu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2937-2946