A survey of deep learning-based 3D shape generation

被引:0
作者
Qun-Ce Xu
Tai-Jiang Mu
Yong-Liang Yang
机构
[1] Tsinghua University,BNRist, Department of Computer Science and Technology
[2] University of Bath,Department of Computer Science
来源
Computational Visual Media | 2023年 / 9卷
关键词
3D representations; geometry learning; generative models; deep learning;
D O I
暂无
中图分类号
学科分类号
摘要
Deep learning has been successfully used for tasks in the 2D image domain. Research on 3D computer vision and deep geometry learning has also attracted attention. Considerable achievements have been made regarding feature extraction and discrimination of 3D shapes. Following recent advances in deep generative models such as generative adversarial networks, effective generation of 3D shapes has become an active research topic. Unlike 2D images with a regular grid structure, 3D shapes have various representations, such as voxels, point clouds, meshes, and implicit functions. For deep learning of 3D shapes, shape representation has to be taken into account as there is no unified representation that can cover all tasks well. Factors such as the representativeness of geometry and topology often largely affect the quality of the generated 3D shapes. In this survey, we comprehensively review works on deep-learning-based 3D shape generation by classifying and discussing them in terms of the underlying shape representation and the architecture of the shape generator. The advantages and disadvantages of each class are further analyzed. We also consider the 3D shape datasets commonly used for shape generation. Finally, we present several potential research directions that hopefully can inspire future works on this topic.
引用
收藏
页码:407 / 442
页数:35
相关论文
共 113 条
[1]  
Zhang Z Y(2012)Microsoft kinect sensor and its effect IEEE MultiMedia 19 4-10
[2]  
Guo M H(2022)Attention mechanisms in computer vision: A survey Computational Visual Media 8 331-368
[3]  
Xu T X(2020)A comprehensive survey on geometric deep learning IEEE Access 8 35929-35949
[4]  
Liu J J(2021)High-quality textured 3D shape reconstruction with cascaded fully convolutional networks IEEE Transactions on Visualization and Computer Graphics 27 83-97
[5]  
Liu Z N(2019)3D volumetric modeling with introspective neural networks Proceedings of the AAAI Conference on Artificial Intelligence 33 8481-8488
[6]  
Jiang P T(2022)Generative VoxelNet: Learning energy-based models for 3D shape synsynthesis and analysis IEEE Transactions on Pattern Analysisand Machine Intelligence 44 2468-2484
[7]  
Mu T J(2020)Adversarial autoencoders for compact representations of 3D point clouds Computer Vision and Image Understanding 193 102921-7121
[8]  
Zhang S H(2018)Learning efficient point cloud generation for dense 3D object reconstruction Proceedings of the AAAI Conference on Artificial Intelligence 32 7114-4554
[9]  
Martin R R(2022)Learning geometry-aware joint latent space for simultaneous multimodal shape generation Computer Aided Geometric Design 93 102076-3162
[10]  
Cheng M M(2021)HSGAN: Hierarchical graph learning for point cloud generation IEEE Transactions on Image Processing 30 4540-1394