Fast Point Cloud Generation with Straight Flows

被引:13
作者
Wu, Lemeng [1 ]
Wang, Dilin [2 ]
Gong, Chengyue [1 ]
Liu, Xingchao [1 ]
Xiong, Yunyang [2 ]
Ranjan, Rakesh [2 ]
Krishnamoorthi, Raghuraman [2 ]
Chandra, Vikas [2 ]
Liu, Qiang [1 ]
机构
[1] Univ Texas Austin, Austin, TX 78712 USA
[2] Meta, Menlo Pk, CA USA
来源
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2023年
关键词
D O I
10.1109/CVPR52729.2023.00911
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Diffusion models have emerged as a powerful tool for point cloud generation. A key component that drives the impressive performance for generating high-quality samples from noise is iteratively denoise for thousands of steps. While beneficial, the complexity of learning steps has limited its applications to many 3D real-world. To address this limitation, we propose Point Straight Flow (PSF), a model that exhibits impressive performance using one step. Our idea is based on the reformulation of the standard diffusion model, which optimizes the curvy learning trajectory into a straight path. Further, we develop a distillation strategy to shorten the straight path into one step without a performance loss, enabling applications to 3D real-world with latency constraints. We perform evaluations on multiple 3D tasks and find that our PSF performs comparably to the standard diffusion model, outperforming other efficient 3D point cloud generation methods. On real-world applications such as point cloud completion and training-free text-guided generation in a low-latency setup, PSF performs favorably.
引用
收藏
页码:9445 / 9454
页数:10
相关论文
共 50 条
[1]  
Achlioptas P, 2018, PR MACH LEARN RES, V80
[2]  
Albergo Michael S, 2022, ARXIV220915571
[3]  
[Anonymous], 2021, ADV NEURAL INFORM PR, DOI DOI 10.1080/20477724.2021.1951556
[4]  
Brock A., 2016, CoRR
[5]   nuScenes: A multimodal dataset for autonomous driving [J].
Caesar, Holger ;
Bankiti, Varun ;
Lang, Alex H. ;
Vora, Sourabh ;
Liong, Venice Erin ;
Xu, Qiang ;
Krishnan, Anush ;
Pan, Yu ;
Baldan, Giancarlo ;
Beijbom, Oscar .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11618-11628
[6]   Learning Gradient Fields for Shape Generation [J].
Cai, Ruojin ;
Yang, Guandao ;
Averbuch-Elor, Hadar ;
Hao, Zekun ;
Belongie, Serge ;
Snavely, Noah ;
Hariharan, Bharath .
COMPUTER VISION - ECCV 2020, PT III, 2020, 12348 :364-381
[7]  
Chen RTQ, 2018, Neural ordinary differential equations, V31
[8]  
Gao Jun, 2022, Advances in Neural Information Processing Systems (NeurIPS), P2
[9]  
Gong Chengyue, 2022, ARXIV220208376
[10]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672