DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation

被引:18
作者
Bertiche, Hugo [1 ,2 ]
Madadi, Meysam [1 ]
Tylson, Emilio [1 ]
Escalera, Sergio [1 ,2 ]
机构
[1] Univ Barcelona, Barcelona, Spain
[2] Comp Vis Ctr, Barcelona, Spain
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) | 2021年
关键词
D O I
10.1109/ICCV48922.2021.00542
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a novel solution to the garment animation problem through deep learning. Our contribution allows animating any template outfit with arbitrary topology and geometric complexity. Recent works develop models for garment edition, resizing and animation at the same time by leveraging the support body model (encoding garments as body homotopies). This leads to complex engineering solutions that suffer from scalability, applicability and compatibility. By limiting our scope to garment animation only, we are able to propose a simple model that can animate any outfit, independently of its topology, vertex order or connectivity. Our proposed architecture maps outfits to animated 3D models into the standard format for 3D animation (blend weights and blend shapes matrices), automatically providing of compatibility with any graphics engine. We also propose a methodology to complement supervised learning with an unsupervised physically based learning that implicitly solves collisions and enhances cloth quality.
引用
收藏
页码:5451 / 5460
页数:10
相关论文
共 34 条
  • [1] Tex2Shape: Detailed Full Human Body Geometry From a Single Image
    Alldieck, Thiemo
    Pons-Moll, Gerard
    Theobalt, Christian
    Magnor, Marcus
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2293 - 2303
  • [2] Video Based Reconstruction of 3D People Models
    Alldieck, Thiemo
    Magnor, Marcus
    Xu, Weipeng
    Theobalt, Christian
    Pons-Moll, Gerard
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8387 - 8397
  • [3] Allen B, 2002, ACM T GRAPHIC, V21, P612, DOI 10.1145/566570.566626
  • [4] SCAPE: Shape Completion and Animation of People
    Anguelov, D
    Srinivasan, P
    Koller, D
    Thrun, S
    Rodgers, J
    Davis, J
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03): : 408 - 416
  • [5] Baraff D., 1998, Computer Graphics. Proceedings. SIGGRAPH 98 Conference Proceedings, P43, DOI 10.1145/280814.280821
  • [6] Bertiche Hugo, 2020, EUR C COMP VIS, P344
  • [7] Multi-Garment Net: Learning to Dress 3D People from Images
    Bhatnagar, Bharat Lal
    Tiwari, Garvita
    Theobalt, Christian
    Pons-Moll, Gerard
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5419 - 5429
  • [8] Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis
    Dai, Angela
    Qi, Charles Ruizhongtai
    Niessner, Matthias
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6545 - 6554
  • [9] DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modeling
    Han, Xiaoguang
    Gao, Chang
    Yu, Yizhou
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [10] Jiang Boyi, 2020, ARXIV200400214