Tacking over-smoothing: Target-guide progressive dynamic graph learning for 3D skeleton-based human motion prediction

被引:0
作者
Zhong, Jianqi [1 ,2 ,3 ,4 ]
Huang, Jiang [1 ,2 ,4 ]
Cao, Wenming [1 ,2 ,3 ,4 ]
机构
[1] Shenzhen Univ, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Guangdong, Peoples R China
[2] Shenzhen Univ, Shenzhen Key Lab Media Secur, Shenzhen 518060, Guangdong, Peoples R China
[3] Shenzhen Univ, State Key Lab Radio Frequency Heterogeneous Integr, Shenzhen 518060, Guangdong, Peoples R China
[4] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen 518060, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Dynamic graph convolutional network; Over-smoothing; Motion prediction; NETWORKS; MODELS;
D O I
10.1016/j.eswa.2024.124914
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Convolution Network-based (GCN-based) approaches show promising performance on 3D skeleton-based human motion prediction due to its natural graph representation and outstanding ability for spatial-temporal dependencies modeling for human motion. However, the existing GCN-based methods inherently have difficulties in designing deep GCN-based structures for human motion prediction due to the over-smoothing issue. Although the over-smoothing issue has been studied in many scenarios, few attempts focus on this problem in 3D human motion prediction tasks. Therefore, we propose a novel deep GCN architecture termed TPDGN (Target-guide Progressive Dynamic Graph Network) to solve this issue in a motion prediction context. The core of the proposed TPDGN is the progressive dynamic graph leaning block, which is developed to model the dynamic graph pattern. We claim that the key to solving the over-smoothing issue is to reduce the loss of motion features and boost graph representations. Accordingly, we further explore the progressive learning mode by the specific target guidance for the motion prediction task, which aims at learning rich motion dependencies to tackle over-smoothing. Empirical results show that our approach could improve the over-smoothing issue, achieving state-of-the-art results on three public datasets. The codes is available at https://github.com/1111szu/TPDGN.
引用
收藏
页数:12
相关论文
共 56 条
  • [1] Neural network for dynamic human motion prediction
    Bataineh, Mohammad
    Marler, Timothy
    Abdel-Malek, Karim
    Arora, Jasbir
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2016, 48 : 26 - 34
  • [2] Bernhard S., 2007, Advances in Neural Information Processing Systems 19: Proceedings of the 2006 Conference, P1345
  • [3] Chen DL, 2020, AAAI CONF ARTIF INTE, V34, P3438
  • [4] Spatiotemporal Consistency Learning From Momentum Cues for Human Motion Prediction
    Chen, Haipeng
    Hu, Jiahui
    Zhang, Wenyin
    Su, Pengxiang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4577 - 4587
  • [5] Chen M, 2020, PR MACH LEARN RES, V119
  • [6] Learning Dynamic Relationships for 3D Human Motion Prediction
    Cui, Qiongjie
    Sun, Huaijiang
    Yang, Fei
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6518 - 6526
  • [7] MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Prediction
    Dang, Lingwei
    Nie, Yongwei
    Long, Chengjiang
    Zhang, Qing
    Li, Guiqing
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 11447 - 11456
  • [8] Devlin J, 2019, Arxiv, DOI arXiv:1810.04805
  • [9] Recurrent Network Models for Human Dynamics
    Fragkiadaki, Katerina
    Levine, Sergey
    Felsen, Panna
    Malik, Jitendra
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 4346 - 4354
  • [10] Learning Constrained Dynamic Correlations in Spatiotemporal Graphs for Motion Prediction
    Fu, Jiajun
    Yang, Fuxing
    Dang, Yonghao
    Liu, Xiaoli
    Yin, Jianqin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 14273 - 14287