PointMixup: Augmentation for Point Clouds

被引:99
作者
Chen, Yunlu [1 ]
Hu, Vincent Tao [1 ]
Gavves, Efstratios [1 ]
Mensink, Thomas [1 ,2 ]
Mettes, Pascal [1 ]
Yang, Pengwan [1 ,3 ]
Snoek, Cees G. M. [1 ]
机构
[1] Univ Amsterdam, Amsterdam, Netherlands
[2] Google Res, Amsterdam, Netherlands
[3] Peking Univ, Beijing, Peoples R China
来源
COMPUTER VISION - ECCV 2020, PT III | 2020年 / 12348卷
关键词
Interpolation; Point cloud classification; Data augmentation;
D O I
10.1007/978-3-030-58580-8_20
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces data augmentation for point clouds by interpolation between examples. Data augmentation by interpolation has shown to be a simple and effective approach in the image domain. Such a mixup is however not directly transferable to point clouds, as we do not have a one-to-one correspondence between the points of two different objects. In this paper, we define data augmentation between point clouds as a shortest path linear interpolation. To that end, we introduce PointMixup, an interpolation method that generates new examples through an optimal assignment of the path function between two point clouds. We prove that our PointMixup finds the shortest path between two point clouds and that the interpolation is assignment invariant and linear. With the definition of interpolation, PointMixup allows to introduce strong interpolation-based regularizers such as mixup and manifold mixup to the point cloud domain. Experimentally, we show the potential of PointMixup for point cloud classification, especially when examples are scarce, as well as increased robustness to noise and geometric transformations to points. The code for PointMixup and the experimental details are publicly available (Code is available at: https://github.com/yunlu-chen/PointMixup/).
引用
收藏
页码:330 / 345
页数:16
相关论文
共 35 条
[1]  
Achlioptas P, 2018, PR MACH LEARN RES, V80
[2]  
Berthelot D, 2019, ADV NEUR IN, V32
[3]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[4]   ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes [J].
Dai, Angela ;
Chang, Angel X. ;
Savva, Manolis ;
Halber, Maciej ;
Funkhouser, Thomas ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2432-2443
[5]   A Point Set Generation Network for 3D Object Reconstruction from a Single Image [J].
Fan, Haoqiang ;
Su, Hao ;
Guibas, Leonidas .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2463-2471
[6]  
Finn C, 2017, PR MACH LEARN RES, V70
[7]  
French G., 2019, ARXIV
[8]  
Guo HY, 2019, AAAI CONF ARTIF INTE, P3714
[9]   SceneNN: a Scene Meshes Dataset with aNNotations [J].
Hua, Binh-Son ;
Quang-Hieu Pham ;
Duc Thanh Nguyen ;
Minh-Khoi Tran ;
Yu, Lap-Fai ;
Yeung, Sai-Kit .
PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2016, :92-101
[10]   SO-Net: Self-Organizing Network for Point Cloud Analysis [J].
Li, Jiaxin ;
Chen, Ben M. ;
Lee, Gim Hee .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9397-9406