Unsupervised Learning of Geometric Sampling Invariant Representations for 3D Point Clouds

被引:18
作者
Chen, Haolan [1 ]
Luo, Shitong [1 ]
Gao, Xiang [1 ]
Hu, Wei [1 ]
机构
[1] Peking Univ, Wangxuan Inst Comp Technol, Beijing, Peoples R China
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021) | 2021年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICCVW54120.2021.00105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point clouds consist of a discrete set of points irregularly sampled from continuous 3D objects. Most existing approaches for point cloud learning are in (semi)-supervised fashions, which nevertheless require costly human annotations. To this end, we propose a novel unsupervised learning of geometric sampling invariant representations, aiming to learn intrinsic feature representations of point clouds on graphs based on that the geometry of one object can be sampled in various patterns and densities into different forms of point clouds. In particular, we represent point clouds on graphs and exploit invariant representations at multiple hierarchies: the low-resolution invariance and original-resolution invariance. To learn invariance at a lower resolution, we subsample the input point cloud in distinct patterns, and maximize the mutual information among the subsampled variants. Further, to learn invariance at the original resolution, we increase the resolution of the subsampled point clouds to the original resolution of the input based on the learned features, and minimize the distance between the input and each of the upsampled versions. In experiments, we apply the learned representations to representative downstream tasks of point clouds, and results on point cloud classification, segmentation and upsampling demonstrate the superiority of the proposed model.
引用
收藏
页码:893 / 903
页数:11
相关论文
共 66 条
[41]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[42]   Info3D: Representation Learning on 3D Objects Using Mutual Information Maximization and Contrastive Learning [J].
Sanghi, Aditya .
COMPUTER VISION - ECCV 2020, PT XXIX, 2020, 12374 :626-642
[43]   RL-GAN-Net: A Reinforcement Learning Agent Controlled GAN Network for Real-Time Point Cloud Shape Completion [J].
Sarmad, Muhammad ;
Lee, Hyunjoo Jenny ;
Kim, Young Min .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :5891-5900
[44]  
Sauder J, 2019, ADV NEUR IN, V32
[45]  
Shi Yi, 2020, P IEEECVF C COMPUTER, P9353
[46]  
Sun Fan-Yun, 2019, INT C LEARNING REPRE
[47]  
Sun YB, 2020, IEEE WINT CONF APPL, P61, DOI [10.1109/WACV45572.2020.9093430, 10.1109/wacv45572.2020.9093430]
[48]   RGCNN: Regularized Graph CNN for Point Cloud Segmentation [J].
Te, Gusi ;
Hu, Wei ;
Guo, Zongming ;
Zheng, Amin .
PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, :746-754
[49]  
Thabet Ali, 2019, ARXIV190400230
[50]  
Valsesia Diego, 2018, INT C LEARN REPR