Characteristic-Preserving Latent Space for Unpaired Cross-Domain Translation of 3D Point Clouds

被引:0
|
作者
Zheng, Jia-Wen [1 ]
Hsu, Jhen-Yung [1 ]
Li, Chih-Chia [1 ]
Lin, I-Chen [1 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Coll Comp Sci, Hsinchu 30010, Taiwan
关键词
Shape transfer; shape characteristics; unpaired learning; 3D point cloud generative model; NETWORK;
D O I
10.1109/TVCG.2023.3287923
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This article aims at unpaired shape-to-shape transformation for 3D point clouds, for instance, turning a chair to its table counterpart. Recent work for 3D shape transfer or deformation highly relies on paired inputs or specific correspondences. However, it is usually not feasible to assign precise correspondences or prepare paired data from two domains. A few methods start to study unpaired learning, but the characteristics of a source model may not be preserved after transformation. To overcome the difficulty of unpaired learning for transformation, we propose alternately training the autoencoder and translators to construct shape-aware latent space. This latent space based on novel loss functions enables our translators to transform 3D point clouds across domains and maintain the consistency of shape characteristics. We also crafted a test dataset to objectively evaluate the performance of point-cloud translation. The experiments demonstrate that our framework can construct high-quality models and retain more shape characteristics during cross-domain translation compared to the state-of-the-art methods. Moreover, we also present shape editing applications with our proposed latent space, including shape-style mixing and shape-type shifting, which do not require retraining a model.
引用
收藏
页码:5212 / 5226
页数:15
相关论文
共 50 条
  • [1] Unpaired Translation of 3D Point Clouds with Multi-part Shape Representation
    Li, Chih-Chia
    Lin, I-Chen
    PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2023, 6 (01)
  • [2] Latent-space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds
    Egiazarian, Vage
    Ignatyev, Savva
    Artemov, Alexey
    Voynov, Oleg
    Kravchenko, Andrey
    Zheng, Youyi
    Velho, Luiz
    Burnaev, Evgeny
    VISAPP: PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 4: VISAPP, 2020, : 421 - 428
  • [3] Universal Cross-Domain 3D Model Retrieval
    Song, Dan
    Li, Tian-Bao
    Li, Wen-Hui
    Nie, Wei-Zhi
    Liu, Wu
    Liu, An-An
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 2721 - 2731
  • [4] Cross-Domain 3D Equivariant Image Embeddings
    Esteves, Carlos
    Sud, Avneesh
    Luo, Zhengyi
    Daniilidis, Kostas
    Makadia, Ameesh
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [5] Point-Syn2Real: Semi-Supervised Synthetic-to-Real Cross-Domain Learning for Object Classification in 3D Point Clouds
    Wang, Ziwei
    Arablouei, Reza
    Liu, Jiajun
    Borges, Paulo
    Bishop-Hurley, Greg
    Heaney, Nicholas
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1481 - 1486
  • [6] 3D shape knowledge graph for cross-domain 3D shape retrieval
    Chang, Rihao
    Ma, Yongtao
    Hao, Tong
    Wang, Weijie
    Nie, Weizhi
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (05) : 1199 - 1216
  • [7] Fast simplification with sharp feature preserving for 3D point clouds
    Benhabiles, Halim
    Aubreton, Olivier
    Barki, Hichem
    Tabia, Hedi
    2013 11TH INTERNATIONAL SYMPOSIUM ON PROGRAMMING AND SYSTEMS (ISPS), 2013, : 47 - 52
  • [8] Feature Preserving Mesh Generation from 3D Point Clouds
    Salman, Nader
    Yvinec, Mariette
    Merigot, Quentin
    COMPUTER GRAPHICS FORUM, 2010, 29 (05) : 1623 - 1632
  • [9] Robust Feature-Preserving Denoising of 3D Point Clouds
    Haque, Sk. Mohammadul
    Govindu, Venu Madhav
    PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2016, : 83 - 91
  • [10] LPMNet: Latent part modification and generation for 3D point clouds *
    Ongun, Cihan
    Temizel, Alptekin
    COMPUTERS & GRAPHICS-UK, 2021, 96 : 1 - 13