Long Term Motion Prediction Using Keyposes

被引:2
|
作者
Kiciroglu, Sena [1 ]
Wang, Wei [1 ,2 ]
Salzmann, Mathieu [1 ,3 ]
Fua, Pascal [1 ]
机构
[1] Ecole Polytech Fed Lausanne, CVLab, Lausanne, Switzerland
[2] Univ Trento, MHUG, Trento, Italy
[3] Clearspace, Lausanne, Switzerland
基金
瑞士国家科学基金会;
关键词
D O I
10.1109/3DV57658.2022.00014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Long term human motion prediction is essential in safety-critical applications such as human-robot interaction and autonomous driving. In this paper we show that to achieve long term forecasting, predicting human pose at every time instant is unnecessary. Instead, it is more effective to predict a few keyposes and approximate intermediate ones by interpolating the keyposes. We demonstrate that our approach enables us to predict realistic motions for up to 5 seconds in the future, which is far longer than the typical 1 second encountered in the literature. Furthermore, because we model future keyposes probabilistically, we can generate multiple plausible future motions by sampling at inference time. Over this extended time period, our predictions are more realistic, more diverse and better preserve the motion dynamics than those stateof-the-art methods yield.
引用
收藏
页码:12 / 21
页数:10
相关论文
共 50 条
  • [21] Human-Like Hand Reaching by Motion Prediction Using Long Short-Term Memory
    Vinayavekhin, Phongtharin
    Tatsubori, Michiaki
    Kimura, Daiki
    Huang, Yifan
    De Magistris, Giovanni
    Munawar, Asim
    Tachibana, Ryuki
    SOCIAL ROBOTICS, ICSR 2017, 2017, 10652 : 156 - 166
  • [22] Intent-Aware Long-Term Prediction of Pedestrian Motion
    Karasev, Vasiliy
    Ayvaci, Alper
    Heisele, Bernd
    Soatto, Stefano
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2016, : 2543 - 2549
  • [23] Long-term Motion In-betweening via Keyframe Prediction
    Hong, Seokhyeon
    Kim, Haemin
    Cho, Kyungmin
    Noh, Junyong
    COMPUTER GRAPHICS FORUM, 2024, 43 (08)
  • [24] Precise long-term prediction of the space debris object motion
    Kolyuka, YF
    Afanasieva, TI
    Gridchina, TA
    Proceedings of the 4th European Conference on Space Debris, 2005, 587 : 315 - 319
  • [25] Long-term Motion In-betweening via Keyframe Prediction
    Hong, Seokhyeon
    Kim, Haemin
    Cho, Kyungmin
    Noh, Junyong
    ACM SIGGRAPH / EUROGRAPHICS SYMPOSIUM OF COMPUTER ANIMATION 2024, 2024,
  • [26] Bidirectional Transformer GAN for Long-term Human Motion Prediction
    Zhao, Mengyi
    Tang, Hao
    Xie, Pan
    Dai, Shuling
    Sebe, Nicu
    Wang, Wei
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (05)
  • [27] The WayHome: Long-term Motion Prediction on Dynamically Scaled Grids
    Scheerer, Kay
    Michalke, Thomas
    Mathes, Juergen
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 383 - 390
  • [28] Joint Long-Term Prediction of Human Motion Using a Planning-Based Social Force Approach
    Rudenko, Andrey
    Palmieri, Luigi
    Arras, Kai O.
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 4571 - 4577
  • [29] Error-resilient video transmission using long-term memory motion-compensated prediction
    Wiegand, T
    Färber, N
    Stuhlmüller, K
    Girod, B
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2000, 18 (06) : 1050 - 1062
  • [30] Fast search for long-term memory motion-compensated prediction
    Wiegand, T
    Lincoln, B
    Girod, B
    1998 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL 3, 1998, : 619 - 622