Implicit Neural Representation for Physics-driven Actuated Soft Bodies

被引:15
作者
Yang, Lingchen [1 ]
Kim, Byungsoo [1 ]
Zoss, Gaspard [2 ]
Gozcu, Baran [1 ]
Gross, Markus [1 ]
Solenthaler, Barbara [1 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] DisneyRes Studios, Zurich, Switzerland
来源
ACM TRANSACTIONS ON GRAPHICS | 2022年 / 41卷 / 04期
基金
瑞士国家科学基金会;
关键词
Differentiable Physics; Deep Learning; Digital Human; DYNAMICS;
D O I
10.1145/3528223.3530156
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Active soft bodies can affect their shape through an internal actuation mechanism that induces a deformation. Similar to recent work, this paper utilizes a differentiable, quasi-static, and physics-based simulation layer to optimize for actuation signals parameterized by neural networks. Our key contribution is a general and implicit formulation to control active soft bodies by defining a function that enables a continuous mapping from a spatial point in the material space to the actuation value. This property allows us to capture the signal's dominant frequencies, making the method discretization agnostic and widely applicable. We extend our implicit model to mandible kinematics for the particular case of facial animation and show that we can reliably reproduce facial expressions captured with high-quality capture systems. We apply the method to volumetric soft bodies, human poses, and facial expressions, demonstrating artist-friendly properties, such as simple control over the latent space and resolution invariance at test time.
引用
收藏
页数:10
相关论文
共 48 条
[1]  
[Anonymous], 2014, COMPUT GRAPH FORUM
[2]  
Bacher M., 2021, CURR ROBOT REP, V2, P211
[3]  
Bao Michael, 2018, ARXIV
[4]   Projective Dynamics: Fusing Constraint Projections for Fast Simulation [J].
Bouaziz, Sofien ;
Martin, Sebastian ;
Liu, Tiantian ;
Kavan, Ladislav ;
Pauly, Mark .
ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (04)
[5]  
Campbell D., 2017, IEEE I CONF COMP VIS
[6]   Learning Nonlinear Soft-Tissue Dynamics for Interactive Avatars [J].
Casas, Dan ;
Otaduy, Miguel A. .
PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2018, 1 (01)
[7]   Semantic Deep Face Models [J].
Chandran, Prashanth ;
Bradley, Derek ;
Gross, Markus ;
Beeler, Thabo .
2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, :345-354
[8]   A Differentiable Physics Engine for Deep Learning in Robotics [J].
Degrave, Jonas ;
Hermans, Michiel ;
Dambre, Joni ;
Wyffels, Francis .
FRONTIERS IN NEUROROBOTICS, 2019, 13
[9]   DiffPD: Differentiable Projective Dynamics [J].
Du, Tao ;
Wu, Kui ;
Ma, Pingchuan ;
Wah, Sebastien ;
Spielberg, Andrew ;
Rus, Daniela ;
Matusik, Wojciech .
ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (02)
[10]   3D Morphable Face Models-Past, Present, and Future [J].
Egger, Bernhard ;
Smith, William A. P. ;
Tewari, Ayush ;
Wuhrer, Stefanie ;
Zollhoefer, Michael ;
Beeler, Thabo ;
Bernard, Florian ;
Bolkart, Timo ;
Kortylewski, Adam ;
Romdhani, Sami ;
Theobalt, Christian ;
Blanz, Volker ;
Vetter, Thomas .
ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (05)