A survey of deep learning-based 3D shape generation

被引:7
作者
Xu, Qun-Ce [1 ]
Mu, Tai-Jiang [1 ]
Yang, Yong-Liang [2 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, BNRist, Beijing 100084, Peoples R China
[2] Univ Bath, Dept Comp Sci, Bath, England
基金
中国国家自然科学基金;
关键词
3D representations; geometry learning; generative models; deep learning; MODELS;
D O I
10.1007/s41095-022-0321-5
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep learning has been successfully used for tasks in the 2D image domain. Research on 3D computer vision and deep geometry learning has also attracted attention. Considerable achievements have been made regarding feature extraction and discrimination of 3D shapes. Following recent advances in deep generative models such as generative adversarial networks, effective generation of 3D shapes has become an active research topic. Unlike 2D images with a regular grid structure, 3D shapes have various representations, such as voxels, point clouds, meshes, and implicit functions. For deep learning of 3D shapes, shape representation has to be taken into account as there is no unified representation that can cover all tasks well. Factors such as the representativeness of geometry and topology often largely affect the quality of the generated 3D shapes. In this survey, we comprehensively review works on deep-learning-based 3D shape generation by classifying and discussing them in terms of the underlying shape representation and the architecture of the shape generator. The advantages and disadvantages of each class are further analyzed. We also consider the 3D shape datasets commonly used for shape generation. Finally, we present several potential research directions that hopefully can inspire future works on this topic.
引用
收藏
页码:407 / 442
页数:36
相关论文
共 226 条
[1]  
Achlioptas P, 2018, PR MACH LEARN RES, V80
[2]   Orbifold Tutte Embeddings [J].
Aigerman, Noam ;
Lipman, Yaron .
ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (06)
[3]  
[Anonymous], 2018, ADV NEURAL INFORM PR
[4]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[5]   A Progressive Conditional Generative Adversarial Network for Generating Dense and Colored 3D Point Clouds [J].
Arshad, Mohammad Samiul ;
Beksi, William J. .
2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, :712-722
[6]  
Atwood J, 2016, ADV NEUR IN, V29
[7]   Representing 3D Shapes with Probabilistic Directed Distance Fields [J].
Aumentado-Armstrong, Tristan ;
Tsogkas, Stavros ;
Dickinson, Sven ;
Jepson, Allan .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :19321-19332
[8]   Structure-Aware Shape Synthesis [J].
Balashova, Elena ;
Singh, Vivek ;
Wang, Jiangping ;
Teixeira, Brian ;
Chen, Terrence ;
Funkhouser, Thomas .
2018 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2018, :140-149
[9]   Hierarchical Surface Prediction for 3D Object Reconstruction [J].
Bane, Christian ;
Tulsiani, Shubham ;
Malik, Jitendra .
PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2017, :412-420
[10]  
Bengio Y., 2015, P INT C LEARNING REP