Decomposed Latent Diffusion Model for 3D Point Cloud Generation

被引:0
|
作者
Zhao, Runfeng [1 ]
Ji, Junzhong [1 ]
Lei, Minglong [1 ]
机构
[1] Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VI | 2025年 / 15036卷
基金
北京市自然科学基金;
关键词
D O I
10.1007/978-981-97-8508-7_30
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Latent diffusion models have achieved significant success in point cloud generation recently, where the diffusion process is constructed under a low-dimensional but efficient latent space. However, existing methods usually overlook the differences between consistency information and offset information in the point clouds, leading to difficulty in accurately learning both the overall shape and the offset of points on shape simultaneously. To address this issue, we propose a decomposed latent diffusion model that separately captures consistency information and offset information in the latent space with feature decoupling. To learn effective consistency information, the consistency constraint among different point clouds with a shape is imposed in the latent space. Then, based on the decomposed features, we further design a geometry diffusion model. We predict key points with consistency information to guide the diffusion model. Therefore, the diffusion model can achieve comprehensive and strong geometry feature extraction. Experiments show that our method achieved state-of-the-art generation performance on the ShapeNet dataset.
引用
收藏
页码:431 / 445
页数:15
相关论文
共 50 条
  • [1] Diffusion Probabilistic Models for 3D Point Cloud Generation
    Luo, Shitong
    Hu, Wei
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2836 - 2844
  • [2] LION: Latent Point Diffusion Models for 3D Shape Generation
    Zeng, Xiaohui
    Vahdat, Arash
    Williams, Francis
    Gojcic, Zan
    Litany, Or
    Fidler, Sanja
    Kreis, Karsten
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [3] Latent diffusion transformer for point cloud generation
    Ji, Junzhong
    Zhao, Runfeng
    Lei, Minglong
    VISUAL COMPUTER, 2024, 40 (06): : 3903 - 3917
  • [4] Neural Point Cloud Diffusion for Disentangled 3D Shape and Appearance Generation
    Schroeppel, Philipp
    Wewer, Christopher
    Lenssen, Jan Eric
    Ilg, Eddy
    Brox, Thomas
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 8785 - 8794
  • [5] Recurrent Diffusion for 3D Point Cloud Generation From a Single Image
    Zhou, Yan
    Ye, Dewang
    Zhang, Huaidong
    Xu, Xuemiao
    Sun, Huajie
    Xu, Yewen
    Liu, Xiangyu
    Zhou, Yuexia
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 1753 - 1765
  • [6] TIGER: Time-Varying Denoising Model for 3D Point Cloud Generation with Diffusion Process
    Ren, Zhiyuan
    Kim, Minchul
    Liu, Feng
    Liu, Xiaoming
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 9462 - 9471
  • [7] Realistic Tumor generation using 3D conditional latent diffusion model
    Hu, Rui
    Yoon, Siyeop
    Wu, Dufan
    Tivnan, Matthew
    Chen, Zhennong
    Wang, Yuang
    Luo, Jie
    Cui, Jianan
    Li, Quanzheng
    Liu, Huafeng
    Guo, Ning
    JOURNAL OF NUCLEAR MEDICINE, 2024, 65
  • [8] Learning 3D Shape Latent for Point Cloud Completion
    Chen, Zhikai
    Long, Fuchen
    Qiu, Zhaofan
    Yao, Ting
    Zhou, Wengang
    Luo, Jiebo
    Mei, Tao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8717 - 8729
  • [9] Learning Progressive Point Embeddings for 3D Point Cloud Generation
    Wen, Cheng
    Yu, Baosheng
    Tao, Dacheng
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10261 - 10270
  • [10] StructLDM: Structured Latent Diffusion for 3D Human Generation
    Hu, Tao
    Hong, Fangzhou
    Liu, Ziwei
    COMPUTER VISION - ECCV 2024, PT LI, 2025, 15109 : 363 - 381