Human motion prediction with gated recurrent unit model of multi-dimensional input

被引:0
作者
Yue Yu
Niehao Tian
XiangYu Hao
Tao Ma
Chunguang Yang
机构
[1] School of Computer Science and Technology,
[2] Beijing Institute of Technology,undefined
[3] State Key Laboratory of Smart Manufacturing for Special Vehicles and Transmission System,undefined
来源
Applied Intelligence | 2022年 / 52卷
关键词
Human motion prediction; Quaternion; Gated recurrent unit; Motion generation;
D O I
暂无
中图分类号
学科分类号
摘要
The issue of human motion prediction aimed to predict sequences of joint positions or joint rotations of human skeleton has recently grown in importance. The Recurrent Neural Network is widely applied on the sequence prediction problems which has been proved effective. However it is difficult to train the model with human skeleton data of multi-dimensional as input, which would do naive forecasting to produce motionless sequence. To address the problem, it is a consensus that additional information will help to improve the accuracy, thus the angular velocities are extracted from the joint rotations as the input to enhance the prediction. Further more, this work adopts proper strategies on the basis of a stacked Gated Recurrent Unit network and verify them on the human motion prediction task. The experimental results show that our network outperforms the state-of-art on the short-term prediction task, and generates plausible action sequences in a relatively long period of time.
引用
收藏
页码:6769 / 6781
页数:12
相关论文
共 38 条
[1]  
Boulic R(1990)A global human walking model with real-time kinematic personification Vis Comput 6 344-358
[2]  
Thalmann NM(2019)Radar-based human-motion recognition with deep learning: Promising applications for indoor monitoring IEEE Sig Process Mag 36 16-28
[3]  
Thalmann D(1997)Long short-term memory Neural Comput 9 1735-1780
[4]  
Gurbuz SZ(2013)Human3. 6m: Large scale datasets and predictive methods for 3d human sensing in natural environments IEEE Trans Pattern Anal Mach Intell 36 1325-1339
[5]  
Amin MG(2015)Deep learning Nature 521 436-444
[6]  
Hochreiter S(2019)Skeleton-based online action prediction using scale selection network IEEE Trans Pattern Anal Mach Intell 42 1453-1467
[7]  
Schmidhuber J(2018)Learning a bidirectional mapping between human whole-body motion and natural language using deep recurrent neural networks Robot Auton Syst 109 13-26
[8]  
Ionescu C(2019)A reinforced fuzzy artmap model for data classification Int J Mach Learn Cybern 10 1643-1655
[9]  
Papava D(2020)Human motion prediction based on attention mechanism Multimed Tools Appl 79 5529-5544
[10]  
Olaru V(2012)Continuous body and hand gesture recognition for natural human-computer interaction ACM Trans Interact Intell Syst (TiiS) 2 5-332