Long Term Motion Prediction Using Keyposes

被引:2
|
作者
Kiciroglu, Sena [1 ]
Wang, Wei [1 ,2 ]
Salzmann, Mathieu [1 ,3 ]
Fua, Pascal [1 ]
机构
[1] Ecole Polytech Fed Lausanne, CVLab, Lausanne, Switzerland
[2] Univ Trento, MHUG, Trento, Italy
[3] Clearspace, Lausanne, Switzerland
基金
瑞士国家科学基金会;
关键词
D O I
10.1109/3DV57658.2022.00014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Long term human motion prediction is essential in safety-critical applications such as human-robot interaction and autonomous driving. In this paper we show that to achieve long term forecasting, predicting human pose at every time instant is unnecessary. Instead, it is more effective to predict a few keyposes and approximate intermediate ones by interpolating the keyposes. We demonstrate that our approach enables us to predict realistic motions for up to 5 seconds in the future, which is far longer than the typical 1 second encountered in the literature. Furthermore, because we model future keyposes probabilistically, we can generate multiple plausible future motions by sampling at inference time. Over this extended time period, our predictions are more realistic, more diverse and better preserve the motion dynamics than those stateof-the-art methods yield.
引用
收藏
页码:12 / 21
页数:10
相关论文
共 50 条
  • [41] On the performance of temporal error concealment for long-term motion-compensated prediction
    Al-Mualla, ME
    Canagarajah, CN
    Bull, DR
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2000, : 376 - 379
  • [42] Prediction of Sea Ice Motion With Convolutional Long Short-Term Memory Networks
    Petrou, Zisis I.
    Tian, Yingli
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (09): : 6865 - 6876
  • [43] Long Term Traffic Prediction in Highway Using Parallel CNN
    Lim, Donghyun
    Lee, Minhyeok
    Seok, Junhee
    2020 IEEE 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION ENGINEERING (IEEE ICITE 2020), 2020, : 107 - 110
  • [44] Oculomotor prediction of accelerative target motion during occlusion: long-term and short-term effects
    Simon J. Bennett
    Jean-Jacques Orban de Xivry
    Philippe Lefèvre
    Graham R. Barnes
    Experimental Brain Research, 2010, 204 : 493 - 504
  • [45] Oculomotor prediction of accelerative target motion during occlusion: long-term and short-term effects
    Bennett, Simon J.
    de Xivry, Jean-Jacques Orban
    Lefevre, Philippe
    Barnes, Graham R.
    EXPERIMENTAL BRAIN RESEARCH, 2010, 204 (04) : 493 - 504
  • [46] Medium- and Long-Term Prediction of Polar Motion Using Weighted Least Squares Extrapolation and Vector Autoregressive Modeling
    Lei, Yu
    Zhao, Danning
    Guo, Min
    ARTIFICIAL SATELLITES-JOURNAL OF PLANETARY GEODESY, 2023, 58 (02): : 42 - 55
  • [47] Combined BiLSTM and ARIMA models in middle- and long-term polar motion prediction
    Yu, Kehao
    Shi, Haowei
    Sun, Mengqi
    Li, Lihua
    Li, Shuhui
    Yang, Honglei
    Wei, Erhu
    STUDIA GEOPHYSICA ET GEODAETICA, 2024, 68 (1-2) : 25 - 40
  • [48] Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning
    Lee, Sangmin
    Kim, Hak Gu
    Choi, Dae Hwi
    Kim, Hyung-Il
    Ro, Yong Man
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3053 - 3062
  • [49] Real-time long-term prediction of ship motion for fire control applications
    Ra, W. S.
    Whang, I. H.
    ELECTRONICS LETTERS, 2006, 42 (18) : 1020 - 1022
  • [50] Long term prediction of respiratory motion with artificial neural network based adaptive filtering techniques
    Vedam, S
    Murphy, M
    Docef, A
    George, R
    Keall, P
    MEDICAL PHYSICS, 2005, 32 (06) : 1925 - 1925