Long Term Motion Prediction Using Keyposes

被引:2
|
作者
Kiciroglu, Sena [1 ]
Wang, Wei [1 ,2 ]
Salzmann, Mathieu [1 ,3 ]
Fua, Pascal [1 ]
机构
[1] Ecole Polytech Fed Lausanne, CVLab, Lausanne, Switzerland
[2] Univ Trento, MHUG, Trento, Italy
[3] Clearspace, Lausanne, Switzerland
基金
瑞士国家科学基金会;
关键词
D O I
10.1109/3DV57658.2022.00014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Long term human motion prediction is essential in safety-critical applications such as human-robot interaction and autonomous driving. In this paper we show that to achieve long term forecasting, predicting human pose at every time instant is unnecessary. Instead, it is more effective to predict a few keyposes and approximate intermediate ones by interpolating the keyposes. We demonstrate that our approach enables us to predict realistic motions for up to 5 seconds in the future, which is far longer than the typical 1 second encountered in the literature. Furthermore, because we model future keyposes probabilistically, we can generate multiple plausible future motions by sampling at inference time. Over this extended time period, our predictions are more realistic, more diverse and better preserve the motion dynamics than those stateof-the-art methods yield.
引用
收藏
页码:12 / 21
页数:10
相关论文
共 50 条
  • [31] Map-based Long Term Motion Prediction for Vehicles in Traffic Environments
    Petrich, Dominik
    Dang, Thao
    Kasper, Dietmar
    Breuel, Gabi
    Stiller, Christoph
    2013 16TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS - (ITSC), 2013, : 2166 - 2172
  • [32] Probabilistic Long-Term Vehicle Motion Prediction and Tracking in Large Environments
    Shan, Mao
    Worrall, Stewart
    Nebot, Eduardo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2013, 14 (02) : 539 - 552
  • [33] ECG COMPRESSION USING LONG-TERM PREDICTION
    NAVE, G
    COHEN, A
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 1993, 40 (09) : 877 - 885
  • [34] SEMI-AUTOMATIC MOTION BASED SEGMENTATION USING LONG TERM MOTION TRAJECTORIES
    Baugh, Gary
    Kokaram, Anil
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 3009 - 3012
  • [35] Improving the accuracy of polar motion prediction using a hybrid least squares and long short-term memory model
    Wang, Chenxiang
    Zhang, Pengfei
    EARTH PLANETS AND SPACE, 2023, 75 (01):
  • [36] Improving the accuracy of polar motion prediction using a hybrid least squares and long short-term memory model
    Chenxiang Wang
    Pengfei Zhang
    Earth, Planets and Space, 75
  • [37] Goal-Directed Pedestrian Model for Long-Term Motion Prediction with Application to Robot Motion Planning
    Yen, Hsiao Chieh
    Huang, Han Pang
    Chung, Shu Yun
    2008 IEEE WORKSHOP ON ADVANCED ROBOTICS AND ITS SOCIAL IMPACTS, 2008, : 143 - 148
  • [38] 3D action recognition and long-term prediction of human motion
    Hahn, Markus
    Krueger, Lars
    Woehler, Christian
    COMPUTER VISION SYSTEMS, PROCEEDINGS, 2008, 5008 : 23 - 32
  • [39] Guest Editorial: Introduction to the Special Issue on Long-Term Human Motion Prediction
    Palmieri, Luigi
    Andrey, Rudenko
    Mainprice, Jim
    Hanheide, Marc
    Alahi, Alexandre
    Lilienthal, Achim
    Arras, Kai O.
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) : 5613 - 5617
  • [40] Long-term memory motion-compensated prediction for robust video transmission
    Wiegand, T
    Färber, N
    Stuhlmüller, K
    Girod, B
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2000, : 152 - 155