Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learning

被引:61
作者
Du, Bi'an [1 ]
Gao, Xiang [1 ]
Hu, Wei [1 ]
Li, Xin [2 ]
机构
[1] Peking Univ, Wangxuan Inst Comp Technol, Beijing, Peoples R China
[2] West Virginia Univ, Lane Dept Comp Sci & Elect Engn, Morgantown, WV 26506 USA
来源
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021 | 2021年
基金
中国国家自然科学基金;
关键词
Contrastive learning; nonlocal self-similarity; point clouds; self-supervised learning; hard negative sampling;
D O I
10.1145/3474085.3475458
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel self-contrastive learning for self-supervised point cloud representation learning, aiming to capture both local geometric patterns and nonlocal semantic primitives based on the nonlocal self-similarity of point clouds. The contributions are twofold: on the one hand, instead of contrasting among different point clouds as commonly employed in contrastive learning, we exploit self-similar point cloud patches within a single point cloud as positive samples and otherwise negative ones to facilitate the task of contrastive learning. On the other hand, we actively learn hard negative samples that are close to positive samples for discriminative feature learning, which are sampled conditional on each anchor patch leveraging on the degree of self-similarity. Experimental results show that the proposed method achieves state-of-the-art performance on widely used benchmark datasets for self-supervised point cloud segmentation and transfer learning for classification.
引用
收藏
页码:3133 / 3142
页数:10
相关论文
共 84 条
[1]  
Achlioptas P, 2018, PR MACH LEARN RES, V80
[2]  
[Anonymous], 2015, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2015.7298801
[3]   Point Convolutional Neural Networks by Extension Operators [J].
Atzmon, Matan ;
Maron, Haggai ;
Lipman, Yaron .
ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (04)
[4]  
Bachman P, 2019, ADV NEUR IN, V32
[5]   Geometric Deep Learning Going beyond Euclidean data [J].
Bronstein, Michael M. ;
Bruna, Joan ;
LeCun, Yann ;
Szlam, Arthur ;
Vandergheynst, Pierre .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) :18-42
[6]   Registration of Laser Scanning Point Clouds: A Review [J].
Cheng, Liang ;
Chen, Song ;
Liu, Xiaoqiang ;
Xu, Hao ;
Wu, Yang ;
Li, Manchun ;
Chen, Yanming .
SENSORS, 2018, 18 (05)
[7]  
Cohen TS, 2016, PR MACH LEARN RES, V48
[8]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[9]  
De Cao Nicola, 2018, ICML 2018 WORKSH THE
[10]   PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors [J].
Deng, Haowen ;
Birdal, Tolga ;
Ilic, Slobodan .
COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 :620-638