FaceVAE: Generation of a 3D Geometric Object Using Variational Autoencoders

被引:5
作者
Park, Sungsoo [1 ,2 ]
Kim, Hyeoncheol [2 ]
机构
[1] Korea Virtual Real Inc, Seoul 05719, South Korea
[2] Korea Univ, Dept Comp Sci & Engn, Seoul 02841, South Korea
关键词
VAE; deep learning; 3D geometry; graph data; generation model;
D O I
10.3390/electronics10222792
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning for 3D data has become a popular research theme in many fields. However, most of the research on 3D data is based on voxels, 2D images, and point clouds. At actual industrial sites, face-based geometry data are being used, but their direct application to industrial sites remains limited due to a lack of existing research. In this study, to overcome these limitations, we present a face-based variational autoencoder (FVAE) model that generates 3D geometry data using a variational autoencoder (VAE) model directly from face-based geometric data. Our model improves the existing node and edge-based adjacency matrix and optimizes it for geometric learning by using a face- and edge-based adjacency matrix according to the 3D geometry structure. In the experiment, we achieved the result of generating adjacency matrix information with 72% precision and 69% recall through end-to-end learning of Face-Based 3D Geometry. In addition, we presented various structurization methods for 3D unstructured geometry and compared their performance, and proved the method to effectively perform reconstruction of the learned structured data through experiments.
引用
收藏
页数:14
相关论文
共 37 条
[1]  
[Anonymous], Learning on Graphs: Methods and Applications
[2]  
[Anonymous], 2008, National Center for Supercomputing Applications
[3]  
[Anonymous], 2012, Advances in Neural Information Processing Systems
[4]   3D shape recognition and retrieval based on multi-modality deep learning [J].
Bu, Shuhui ;
Wang, Lei ;
Han, Pengcheng ;
Liu, Zhenbao ;
Li, Ke .
NEUROCOMPUTING, 2017, 259 :183-193
[5]  
Cai L, 2019, Data Min, P630
[6]  
Chen X, 2016, ADV NEUR IN, V29
[7]   Variational Autoencoder for Image-Based Augmentation of Eye-Tracking Data [J].
Elbattah, Mahmoud ;
Loughnane, Colm ;
Guerin, Jean-Luc ;
Carette, Romuald ;
Cilia, Federica ;
Dequen, Gilles .
JOURNAL OF IMAGING, 2021, 7 (05)
[8]  
Gao Z., 2021, DEEP MOL GENERATIVE, DOI [10.26434/chemrxiv.14692551.v1, DOI 10.26434/CHEMRXIV.14692551.V1]
[9]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[10]  
Hu W., GRAPH SIGNAL PROCESS