Optimizing human motion prediction through decoupled motion spatio-temporal trends

被引:0
|
作者
Pan, Huan [1 ]
Ji, Ruiya [2 ]
Cao, Wenming [1 ]
Huang, Zhao [3 ]
Zhong, Jianqi [1 ]
机构
[1] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen 518060, Peoples R China
[2] Queen Mary Univ London, Dept Comp Sci, London, England
[3] Univ Northumbria, Dept Comp & Informat Sci, Newcastle, England
基金
中国国家自然科学基金;
关键词
3D human motion forecasting; Deep learning; Time series;
D O I
10.1007/s00530-025-01691-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent advancements in deep learning and artificial intelligence have underscored the importance of human motion prediction in fields such as intelligent robotics, autonomous driving, and human-computer interaction. Current human motion prediction methods primarily focus on network structure and feature extraction innovations, often overlooking the underlying logic of spatio-temporal changes in motion data. This oversight can result in potential conflicts within the coupled modeling of spatial and temporal dependencies, potentially obscuring the spatio-temporal logic of human motion. In this paper, we address this issue by decoupling the spatio-temporal features, employing time series modeling for preliminary prediction, and introducing velocity data as a learning branch to capture joint dependencies. This velocity-based information more clearly represents quantitative indices related to human movement, enhancing the model's pattern recognition capability. We map the trajectory change rules to the joint change trends for future moments, thereby refining the prediction results. Additionally, we enhance local semantic information through a patching method and ensure the independence of multi-scale representations of spatial and temporal dimensions using a two-branch framework. We propose a multi-layer perceptron (MLP)-based network structure, DCMixer, designed to learn multi-scale dynamic information and perform internal feature extraction. Our approach achieves spatio-temporal fusion with greater kinematic logic, significantly improving model performance. We evaluated our method on three public datasets, demonstrating superior prediction performance compared to state-of-the-art methods. The code is publicly available at https://github.com/Dabanshou/STTSN.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Background initialisation by spatio-temporal motion estimation
    Varadarajan, Sriram
    Wang, Hui
    Scotney, Bryan
    Nibouche, Omar
    2017 14TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2017,
  • [32] Spatio-temporal Motion Tracking with Unsynchronized Cameras
    Elhayek, A.
    Stoll, C.
    Hasler, N.
    Kim, K. I.
    Seidel, H. -P.
    Theobalt, C.
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 1870 - 1877
  • [33] A spatio-temporal interaction on the apparent motion trace
    Schwiedrzik, C. M.
    Alink, A.
    Kohler, A.
    Singer, W.
    Muckli, L.
    PERCEPTION, 2007, 36 : 96 - 96
  • [34] A spatio-temporal interaction on the apparent motion trace
    Schwiedrzik, C. M.
    Alink, A.
    Kohler, A.
    Singer, W.
    Muckli, L.
    VISION RESEARCH, 2007, 47 (28) : 3424 - 3433
  • [35] Spatio-temporal modeling for overactuated motion control
    Tacx, Paul
    van de Vosse, Matthijs
    Voorhoeve, Robbert
    Witvoet, Gert
    Heertjes, Marcel
    Oomen, Tom
    MECHATRONICS, 2025, 105
  • [36] Spatial Optimization in Spatio-temporal Motion Planning
    Zhang, Weize
    Yadmellat, Peyman
    Gao, Zhiwei
    2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 1248 - 1254
  • [37] Can spatio-temporal energy models of motion predict feature motion?
    Bowns, L
    VISION RESEARCH, 2002, 42 (13) : 1671 - 1681
  • [38] Can spatio-temporal energy models of motion predict feature motion?
    Bowns, L
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2001, 42 (04) : S873 - S873
  • [39] Sharpening image motion based on the spatio-temporal characteristics of human vision
    Takeuchi, T
    De Valois, KK
    HUMAN VISION AND ELECTRONIC IMAGING X, 2005, 5666 : 83 - 94
  • [40] Human motion synthesis based on independent spatio-temporal feature space
    Liu G.-D.
    Xu M.-L.
    Zhang M.-M.
    Jisuanji Xuebao/Chinese Journal of Computers, 2011, 34 (03): : 464 - 472