Point Cloud Completion by Learning Shape Priors

被引:12
作者
Wang, Xiaogang [1 ]
Ang, Marcelo H., Jr. [1 ]
Lee, Gim Hee [2 ]
机构
[1] Natl Univ Singapore, Dept Mech Engn, Singapore, Singapore
[2] Natl Univ Singapore, Dept Comp Sci, Comp Vis & Robot Percept CVRP Lab, Singapore, Singapore
来源
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) | 2020年
基金
新加坡国家研究基金会;
关键词
D O I
10.1109/IROS45743.2020.9340862
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In view of the difficulty in reconstructing object details in point cloud completion, we propose a shape prior learning method for object completion. The shape priors include geometric information in both complete and the partial point clouds. We design a feature alignment strategy to learn the shape prior from complete points, and a coarse to fine strategy to incorporate partial prior in the fine stage. To learn the complete objects prior, we first train a point cloud auto-encoder to extract the latent embeddings from complete points. Then we learn a mapping to transfer the point features from partial points to that of the complete points by optimizing feature alignment losses. The feature alignment losses consist of a L2 distance and an adversarial loss obtained by Maximum Mean Discrepancy Generative Adversarial Network (MMD-GAN). The L2 distance optimizes the partial features towards the complete ones in the feature space, and MMD-GAN decreases the statistical distance of two point features in a Reproducing Kernel Hilbert Space. We achieve state-of-theart performances on the point cloud completion task. Our code is available at https://github.com/xiaogangw/ point- cloud- completion-shape-prior.
引用
收藏
页码:10719 / 10726
页数:8
相关论文
共 51 条
  • [1] Building Rome in a Day
    Agarwal, Sameer
    Furukawa, Yasutaka
    Snavely, Noah
    Simon, Ian
    Curless, Brian
    Seitz, Steven M.
    Szeliski, Richard
    [J]. COMMUNICATIONS OF THE ACM, 2011, 54 (10) : 105 - 112
  • [2] Binkowski Mikolaj, 2018, ICLR
  • [3] CodeSLAM-Learning a Compact, Optimisable Representation for Dense Visual SLAM
    Bloesch, Michael
    Czarnowski, Jan
    Clark, Ronald
    Leutenegger, Stefan
    Davison, Andrew J.
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2560 - 2568
  • [4] Bromley J., 1993, International Journal of Pattern Recognition and Artificial Intelligence, V7, P669, DOI 10.1142/S0218001493000339
  • [5] Chang Angel X., 2015, ARXIV
  • [6] LSD-SLAM: Large-Scale Direct Monocular SLAM
    Engel, Jakob
    Schoeps, Thomas
    Cremers, Daniel
    [J]. COMPUTER VISION - ECCV 2014, PT II, 2014, 8690 : 834 - 849
  • [7] A Point Set Generation Network for 3D Object Reconstruction from a Single Image
    Fan, Haoqiang
    Su, Hao
    Guibas, Leonidas
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2463 - 2471
  • [8] Feng MD, 2019, IEEE INT CONF ROBOT, P4790, DOI [10.1109/ICRA.2019.8794415, 10.1109/icra.2019.8794415]
  • [9] Vision meets robotics: The KITTI dataset
    Geiger, A.
    Lenz, P.
    Stiller, C.
    Urtasun, R.
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) : 1231 - 1237
  • [10] Goodfellow I.J., 2014, ADV NEUR IN, p1406.2661, DOI DOI 10.1145/3422622