Variational Auto-Encoder for 3D Garment Deformation Prediction

被引：0

作者：

Shi M. ^{[1
]}

Feng W. ^{[1
]}

Wei Y. ^{[1
]}

Mao T. ^{[2
]}

Zhu D. ^{[2
]}

Wang Z. ^{[2
]}

机构：

[1] School of Control and Computer Engineering, North China Electric Power University, Beijing

[2] Prospective Research Laboratory, Institute of Computing Technology, Chinese Academy of Sciences, Beijing

来源：

Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2022年 / 34卷 / 08期

关键词：

clothing animation; garment deformation prediction; Laplace transform; penetration removal; variational auto-encoder;

D O I：

10.3724/SP.J.1089.2022.19156

中图分类号：

学科分类号：

摘要：

Traditional garment animation workflow relies on the professional clothing simulator, which requires manual editing of artists or animators. There is no doubt that such a process is time-consuming and laborious. Synthesizing garment dynamics according to the input high-level parameters in a semi-automatic way not only helps dismiss the domain gap between inspiration and technical implementation, but also enables artists to focus on the authoring of animating contents. To that end, a variational auto-encoder-based garment animation synthesis method is presented. Firstly, a set of motion sequences composed of different poses are sampled to generate the human body dataset. Secondly, a variational auto-encoder network is constructed to learn the probabilistic distribution of clothing deformation from garment motions under different pose variations. Besides, a mesh Laplacian term on the loss function is introduced to preserve wrinkle details of the synthesized garments. After that, constraints on the latent space are imposed to control the garment shape to be generated. Finally, a refinement process is employed to resolve the penetration between the body surface and garment mesh, obtaining realistic clothing deformations. Proposed method is qualitatively and quantitatively evaluated on the AMASS dataset from different aspects: body motion/shape-driven garment synthesis, garment animation authoring. The experimental results demonstrate that proposed workflow is able to produce visually realistic garments without noticeable artifacts. Proposed method can produce temporally-consistent garment dynamics with shape and pose variations, which assists artists in authoring the desired clothing deformations. © 2022 Institute of Computing Technology. All rights reserved.

引用

页码：1160 / 1171

页数：11

共 20 条

[11] Anguelov D, Srinivasan P, Koller D, Et al., SCAPE: shape completion and animation of people, ACM Transactions on Graphics, 24, 3, pp. 408-416, (2005)
[12] Wang T Y, Shao T J, Fu K, Et al., Learning an intrinsic garment space for interactive authoring of garment animation, ACM Transactions on Graphics, 38, 6, (2019)
[13] Vidaurre R, Santesteban I, Garces E, Et al., Fully convolutional graph neural networks for parametric virtual try-on, Computer Graphics Forum, 39, 8, pp. 145-156, (2020)
[14] Xu W W, Umentani N, Chao Q W, Et al., Sensitivity-optimized rigging for example-based real-time clothing synthesis, ACM Transactions on Graphics, 33, 4, (2014)
[15] Wu N N, Chao Q W, Chen Y Z, Et al., Example-based real-time clothing synthesis for virtual agents
[16] Bertiche H, Madadi M, Escalera S., CLOTH3D: clothed 3D humans, Proceedings of the 16th European Conference on Computer Vision, pp. 344-359, (2020)
[17] Loper M, Mahmood N, Romero J, Et al., SMPL: a skinned multi-person linear model, ACM Transactions on Graphics, 34, 6, (2015)
[18] Mahmood N, Ghorbani N, Troje N F, Et al., AMASS: archive of motion capture as surface shapes, Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 5441-5450, (2019)
[19] Kingma D P, Welling M., Auto-encoding variational Bayes
[20] Taubin G., A signal processing approach to fair surface design, Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, pp. 351-358, (1995)

← 1 2 →