Unsupervised 3D Shape Representation Learning Using Normalizing Flow

被引:0
|
作者
Li, Xiang [1 ]
Wen, Congcong [2 ]
Huang, Hao [2 ]
机构
[1] King Abdullah Univ Sci & Technol, Thuwal, Saudi Arabia
[2] New York Univ Abu Dhabi, Abu Dhabi, U Arab Emirates
来源
COMPUTER VISION - ACCV 2022, PT I | 2023年 / 13841卷
关键词
Shape representation learning; Normalizing flow; Contrastive learning;
D O I
10.1007/978-3-031-26319-4_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning robust and compact shape representation learning plays an important role in many 3D vision tasks. Existing supervised learning-based methods have achieved remarkable performance, meanwhile requiring large-scale human-annotated datasets for model training. Self-supervised/unsupervised methods provide an attractive solution to this issue that can learn shape representations without the need for ground truth labels. In this paper, we introduce a novel self-supervised method for shape representation learning using normalizing flows. Specifically, we build a model upon a variational normalizing flow framework where a sequence of normalizing flow layers are adopted to model exact posterior latent distribution and enhance the representation power of the learned latent code. To further encourage inter-shape separability and intra-shape compactness among a batch of shapes, we design a contrastive-center loss that performs metric learning on features on a hypersphere. We validate the representation learning ability of our model on downstream classification tasks. Experiments on ModelNet40/10, ScanobjectNN, and ScanNet datasets demonstrate the superior performance of our method compared with current state-of-the-art methods.
引用
收藏
页码:158 / 175
页数:18
相关论文
共 50 条
  • [1] Detecting 3D syndromic faces as outliers using unsupervised normalizing flow models
    Bannister J.J.
    Wilms M.
    Aponte J.D.
    Katz D.C.
    Klein O.D.
    Bernier F.P.J.
    Spritz R.A.
    Hallgrímsson B.
    Forkert N.D.
    Artificial Intelligence in Medicine, 2022, 134
  • [2] Transcoding across 3D shape representations for unsupervised learning of 3D shape feature
    Furuya, Takahiko
    Ohbuchi, Ryutarou
    PATTERN RECOGNITION LETTERS, 2020, 138 (138) : 146 - 154
  • [3] MRGAN: Multi-Rooted 3D Shape Representation Learning with Unsupervised Part Disentanglement
    Gal, Rinon
    Bermano, Amit
    Zhang, Hao
    Cohen-Or, Daniel
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 2039 - 2048
  • [4] Deep Learning Representation using Autoencoder for 3D Shape Retrieval
    Zhu, Zhuotun
    Wang, Xinggang
    Bai, Song
    Yao, Cong
    Bai, Xiang
    2014 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2014, : 279 - 284
  • [5] Deep Learning Representation using Autoencoder for 3D Shape Retrieval
    Zhu, Zhuotun
    Wang, Xinggang
    Bai, Song
    Yao, Cong
    Bai, Xiang
    NEUROCOMPUTING, 2016, 204 : 41 - 50
  • [6] Unsupervised Learning of PCFGs with Normalizing Flow
    Jin, Lifeng
    Doshi-Velez, Finale
    Miller, Timothy
    Schuler, William
    Schwartz, Lane
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 2442 - 2452
  • [7] 3D registration by using an alternative 3D shape representation
    Torre-Ferrero, C.
    Robla, S.
    Sarabia, E. G.
    Llata, J. R.
    PROCEEDINGS OF THE 7TH WSEAS INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMPUTATIONAL GEOMETRY AND ARTIFICIAL VISION (ISCGAV'-07), 2007, : 97 - +
  • [8] Disentangled Representation Learning for 3D Face Shape
    Jiang, Zi-Hang
    Wu, Qianyi
    Chen, Keyu
    Zhang, Juyong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11949 - 11958
  • [9] 3D Surface parameterization using manifold learning for medial shape representation
    Ward, Aaron D.
    Hamarneh, Ghassan
    MEDICAL IMAGING 2007: IMAGE PROCESSING, PTS 1-3, 2007, 6512
  • [10] PointGLR: Unsupervised Structural Representation Learning of 3D Point Clouds
    Rao, Yongming
    Lu, Jiwen
    Zhou, Jie
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 2193 - 2207