Implicit Neural Representations for Variable Length Human Motion Generation

被引:34
作者
Cervantes, Pablo [1 ]
Sekikawa, Yusuke [2 ]
Sato, Ikuro [1 ,2 ]
Shinoda, Koichi [1 ]
机构
[1] Tokyo Inst Technol, Tokyo, Japan
[2] Denso IT Lab Inc, Tokyo, Japan
来源
COMPUTER VISION - ECCV 2022, PT XVII | 2022年 / 13677卷
关键词
Motion generation; Implicit Neural Representations;
D O I
10.1007/978-3-031-19790-1_22
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose an action-conditional human motion generation method using variational implicit neural representations (INR). The variational formalism enables action-conditional distributions of INRs, from which one can easily sample representations to generate novel human motion sequences. Our method offers variable-length sequence generation by construction because a part of INR is optimized for a whole sequence of arbitrary length with temporal embeddings. In contrast, previous works reported difficulties with modeling variable-length sequences. We confirm that our method with a Transformer decoder outperforms all relevant methods on HumanAct12, NTU-RGBD, and UESTC datasets in terms of realism and diversity of generated motions. Surprisingly, even our method with an MLP decoder consistently outperforms the state-of-the-art Transformer-based auto-encoder. In particular, we show that variable-length motions generated by our method are better than fixedlength motions generated by the state-of-the-art method in terms of realism and diversity. Code at https://github.com/PACerv/ImplicitMotion.
引用
收藏
页码:356 / 372
页数:17
相关论文
共 41 条
[31]  
Ravi N, 2020, Arxiv, DOI [arXiv:2007.08501, 10.48550/arXiv.2007.08501]
[32]  
Schwarz K, 2020, ADV NEUR IN, V33
[33]  
Sengupta A., 2020, BRIT MACHINE VISION
[34]  
Sitzmann Vincent, 2020, Advances in neural information processing systems, V33
[35]   Neural Animation Layering for Synthesizing Martial Arts Movements [J].
Starke, Sebastian ;
Zhao, Yiwei ;
Zinno, Fabio ;
Komura, Taku .
ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (04) :1-16
[36]   Local Motion Phases for Learning Multi-Contact Character Movements [J].
Starke, Sebastian ;
Zhao, Yiwei ;
Komura, Taku ;
Zaman, Kazi .
ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (04)
[37]   Synthetic Humans for Action Recognition from Unseen Viewpoints [J].
Varol, Gul ;
Laptev, Ivan ;
Schmid, Cordelia ;
Zisserman, Andrew .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (07) :2264-2287
[38]   Convolutional Sequence Generation for Skeleton-Based Action Synthesis [J].
Yan, Sijie ;
Li, Zhizhong ;
Xiong, Yuanjun ;
Yan, Huahan ;
Lin, Dahua .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4393-4401
[39]  
Yariv L, 2020, ADV NEUR IN, V33
[40]   On the Continuity of Rotation Representations in Neural Networks [J].
Zhou, Yi ;
Barnes, Connelly ;
Lu, Jingwan ;
Yang, Jimei ;
Li, Hao .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :5738-5746