Three-stage generative network for single-view point cloud completion

被引:3
作者
Xiao, Bingling [1 ,2 ]
Da, Feipeng [1 ,2 ,3 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Jiangsu, Peoples R China
[2] Minist Educ, Key Lab Measurement & Control Complex Syst Engn, Nanjing 210096, Jiangsu, Peoples R China
[3] Southeast Univ, Shenzhen Res Inst, Shenzhen 518063, Guangdong, Peoples R China
关键词
3D shape completion; Point cloud; Deep learning; SHAPE;
D O I
10.1007/s00371-021-02301-4
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
3D shape completion from single-view scan is an important task for follow-up applications such as recognition and segmentation, but it is challenging due to the critical sparsity and structural incompleteness of single-view point clouds. In this paper, a three-stage generative network (TSGN) is proposed for single-view point cloud completion, which generates fine-grained dense point clouds step by step and effectively overcomes the ubiquitous problem-the imbalance between general and individual characteristics. In the first stage, an encoder-decoder network consumes a partial point cloud and generates a rough sparse point cloud inferring the complete geometric shape. Then, a bi-channel residual network is designed to refine the preliminary result with assistance of the original partial input. A local-based folding network is introduced in the last stage to extract local context information from the revised result and build a dense point cloud with finer-grained details. Experiments on ShapeNet dataset and KITTI dataset validate the effectiveness of TSGN. The results on ShapeNet demonstrate the competitive performance on both CD and EMD.
引用
收藏
页码:4373 / 4382
页数:10
相关论文
共 27 条
[1]  
[Anonymous], 2015, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2015.7298801
[2]  
[Anonymous], 2017, Learning representations and generative models for 3D point clouds
[3]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[4]   A Point Set Generation Network for 3D Object Reconstruction from a Single Image [J].
Fan, Haoqiang ;
Su, Hao ;
Guibas, Leonidas .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2463-2471
[5]   A self-adaptive segmentation method for a point cloud [J].
Fan, Yuling ;
Wang, Meili ;
Geng, Nan ;
He, Dongjian ;
Chang, Jian ;
Zhang, Jian J. .
VISUAL COMPUTER, 2018, 34 (05) :659-673
[6]   Vision meets robotics: The KITTI dataset [J].
Geiger, A. ;
Lenz, P. ;
Stiller, C. ;
Urtasun, R. .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) :1231-1237
[7]   A Papier-Mache Approach to Learning 3D Surface Generation [J].
Groueix, Thibault ;
Fisher, Matthew ;
Kim, Vladimir G. ;
Russell, Bryan C. ;
Aubry, Mathieu .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :216-224
[8]   High-Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inference [J].
Han, Xiaoguang ;
Li, Zhen ;
Huang, Haibin ;
Kalogerakis, Evangelos ;
Yu, Yizhou .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :85-93
[9]   PF-Net: Point Fractal Network for 3D Point Cloud Completion [J].
Huang, Zitian ;
Yu, Yikuan ;
Xu, Jiawen ;
Ni, Feng ;
Le, Xinyi .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :7659-7667
[10]   Shape Completion from a Single RGBD Image [J].
Li, Dongping ;
Shao, Tianjia ;
Wu, Hongzhi ;
Zhou, Kun .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2017, 23 (07) :1809-1822