Fusion learning-based recurrent neural network for human motion prediction

被引:6
作者
Guo, Chongyang [1 ]
Liu, Rui [1 ]
Che, Chao [1 ]
Zhou, Dongsheng [1 ,2 ]
Zhang, Qiang [1 ,2 ]
Wei, Xiaopeng [2 ]
机构
[1] Dalian Univ, Key Lab Adv Design & Intelligent Comp, Minist Educ, Sch Soft Engn, Dalian 116622, Peoples R China
[2] Dalian Univ Technol, Sch Mech Engn, Dalian 116024, Peoples R China
关键词
Human motion prediction; Recurrent neural network; Fusion loss learning;
D O I
10.1007/s11370-021-00403-5
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Human motion prediction is an important research frontier, which is a key supporting technology in the fields of human-robot collaboration, automatic driving, etc. As is well known, long-term motion prediction is one most challenging direction. This paper mainly focuses on how to eliminate cumulative errors to overcome the fossilization of long-term motion sequences and aims to improve the reliability of prediction results. This paper proposed an algorithm named "fusion loss learning network," which is based on gated recurrent unit, to solve the above-mentioned problem. A fusion training method was established by combining the sampling of each step of the GRU unit with true value and output value of each previous step, which helped recover from the errors in the long-term prediction sequences. This method achieved promising results on the Human 3.6 M dataset. The results show that the proposed method could significantly improve the performance of long-term human motion prediction, and the total prediction error is reduced by 7.25% on average.
引用
收藏
页码:245 / 257
页数:13
相关论文
共 25 条
  • [1] HP-GAN: Probabilistic 3D human motion prediction via GAN
    Barsoum, Emad
    Kender, John
    Liu, Zicheng
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1499 - 1508
  • [2] Bengio Samy, 2015, Advances In Neural Information Pro-cessing Systems (NeurIPS)
  • [3] Cho K, 2014, ARXIV14061078, P1724
  • [4] Bio-LSTM: A Biomechanically Inspired Recurrent Neural Network for 3-D Pedestrian Pose and Gait Prediction
    Du, Xiaoxiao
    Vasudevan, Ram
    Johnson-Roberson, Matthew
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (02): : 1501 - 1508
  • [5] Recurrent Network Models for Human Dynamics
    Fragkiadaki, Katerina
    Levine, Sergey
    Felsen, Panna
    Malik, Jitendra
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 4346 - 4354
  • [6] A Neural Temporal Model for Human Motion Prediction
    Gopalakrishnan, Anand
    Mali, Ankur
    Kifer, Dan
    Giles, C. Lee
    Ororbia, Alexander G.
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 12108 - 12117
  • [7] Graves A, 2012, STUD COMPUT INTELL, V385, P5
  • [8] Adversarial Geometry-Aware Human Motion Prediction
    Gui, Liang-Yan
    Wang, Yu-Xiong
    Liang, Xiaodan
    Moura, Jose M. F.
    [J]. COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 : 823 - 842
  • [9] Guo X, 2019, AAAI CONF ARTIF INTE, P2580
  • [10] Habibie I., 2017, BMVC, DOI DOI 10.5244/C.31.119