Point Cloud Instance Segmentation using Probabilistic Embeddings

被引:27
作者
Zhang, Biao [1 ]
Wonka, Peter [1 ]
机构
[1] KAUST, Thuwal, Saudi Arabia
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 | 2021年
关键词
D O I
10.1109/CVPR46437.2021.00877
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we propose a new framework for point cloud instance segmentation. Our framework has two steps: an embedding step and a clustering step. In the embedding step, our main contribution is to propose a probabilistic embedding space for point cloud embedding. Specifically, each point is represented as a tri-variate normal distribution. In the clustering step, we propose a novel loss function, which benefits both the semantic segmentation and the clustering. Our experimental results show important improvements to the SOTA, i.e., 3.1% increased average per-category mAP on the PartNet dataset.
引用
收藏
页码:8879 / 8888
页数:10
相关论文
共 36 条
[21]   Anisotropic Convolutional Networks for 3D Semantic Scene Completion [J].
Li, Jie ;
Han, Kai ;
Wang, Peng ;
Liu, Yu ;
Yuan, Xia .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3348-3356
[22]   Proposal-Free Network for Instance-Level Object Segmentation [J].
Liang, Xiaodan ;
Lin, Liang ;
Wei, Yunchao ;
Shen, Xiaohui ;
Yang, Jianchao ;
Yan, Shuicheng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (12) :2978-2991
[23]   Neural RGB→D Sensing: Depth and Uncertainty from a Video Camera [J].
Liu, Chao ;
Gu, Jinwei ;
Kim, Kihwan ;
Narasimhan, Srinivasa G. ;
Kautz, Jan .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10978-10987
[24]   Path Aggregation Network for Instance Segmentation [J].
Liu, Shu ;
Qi, Lu ;
Qin, Haifang ;
Shi, Jianping ;
Jia, Jiaya .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8759-8768
[25]   PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understanding [J].
Mo, Kaichun ;
Zhu, Shilin ;
Chang, Angel X. ;
Yi, Li ;
Tripathi, Subarna ;
Guibas, Leonidas J. ;
Su, Hao .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :909-918
[26]   Instance Segmentation by Jointly Optimizing Spatial Embeddings and Clustering Bandwidth [J].
Neven, Davy ;
De Brabandere, Bert ;
Proesmans, Marc ;
Van Gool, Luc .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :8829-8837
[27]   Semi-convolutional Operators for Instance Segmentation [J].
Novotny, David ;
Albanie, Samuel ;
Larlus, Diane ;
Vedaldi, Andrea .
COMPUTER VISION - ECCV 2018, PT I, 2018, 11205 :89-105
[28]  
Qi C.R., 2017, Proc. Adv. Neural Inf. Process. Syst, V30, P5099, DOI DOI 10.1109/CVPR.2017.16
[29]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[30]  
Rezende D. J., 2014, ARXIV14014082, P1278, DOI DOI 10.1051/0004-6361/201527329