H 2 GCN: A hybrid hypergraph convolution network for skeleton-based action recognition

被引:1
|
作者
Shao, Yiming [1 ]
Mao, Lintao [1 ]
Ye, Leixiong [1 ]
Li, Jincheng [1 ]
Yang, Ping [1 ]
Ji, Chengtao [2 ]
Wu, Zizhao [3 ]
机构
[1] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
[2] Xian Jiaotong Liverpool Univ, Suchou, Peoples R China
[3] Room 322,Build 10, Hangzhou 310018, Zhejiang, Peoples R China
关键词
Action recognition; Hypergraph convolution network; Spatio-temporal modeling;
D O I
10.1016/j.jksuci.2024.102072
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent GCN-based works have achieved remarkable results for skeleton -based human action recognition. Nevertheless, while existing approaches extensively investigate pairwise joint relationships, only a limited number of models explore the intricate, high -order relationships among multiple joints. In this paper, we propose a novel hypergraph convolution method that represents the relationships among multiple joints with hyperedges, and dynamically refines the height -order relationship between hyperedges in the spatial, temporal, and channel dimensions. Specifically, our method initiates with a temporal -channel refinement hypergraph convolutional network, dynamically learning temporal and channel topologies in a data -dependent manner, which facilitates the capture of non-physical structural information inherent in the human body. Furthermore, to model various inter -joint relationships across spatio-temporal dimensions, we propose a spatio-temporal hypergraph joint module, which aims to encapsulate the dynamic spatial-temporal characteristics of the human body. Through the integration of these modules, our proposed model achieves state-of-the-art performance on RGB+D 60 and NTU RGB+D 120 datasets.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Attentional weighting strategy-based dynamic GCN for skeleton-based action recognition
    Kai Hu
    Junlan Jin
    Chaowen Shen
    Min Xia
    Liguo Weng
    Multimedia Systems, 2023, 29 : 1941 - 1954
  • [42] MSA-GCN: Exploiting Multi-Scale Temporal Dynamics With Adaptive Graph Convolution for Skeleton-Based Action Recognition
    Alowonou, Kowovi Comivi
    Han, Ji-Hyeong
    IEEE ACCESS, 2024, 12 : 193552 - 193563
  • [43] Skeleton-Based ST-GCN for Human Action Recognition With Extended Skeleton Graph and Partitioning Strategy
    WANG, Q. U. A. N. Y. U.
    ZHANG, K. A. I. X. I. A. N. G.
    ASGHAR, M. A. N. J. O. T. H. O. A. L., I
    IEEE ACCESS, 2022, 10 : 41403 - 41410
  • [44] Multi-scale skeleton adaptive weighted GCN for skeleton-based human action recognition in IoT
    Xu Weiyao
    Wu Muqing
    Zhu Jie
    Zhao Min
    APPLIED SOFT COMPUTING, 2021, 104
  • [45] Multi-scale and attention enhanced graph convolution network for skeleton-based violence action recognition
    Yang, Huaigang
    Ren, Ziliang
    Yuan, Huaqiang
    Wei, Wenhong
    Zhang, Qieshi
    Zhang, Zhaolong
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [46] Glimpse and focus: Global and local-scale graph convolution network for skeleton-based action recognition
    Gao, Xuehao
    Du, Shaoyi
    Yang, Yang
    NEURAL NETWORKS, 2023, 167 : 551 - 558
  • [47] Dynamic GCN: Context-enriched Topology Learning for Skeleton-based Action Recognition
    Ye, Fanfan
    Pu, Shiliang
    Zhong, Qiaoyong
    Li, Chao
    Xie, Di
    Tang, Huiming
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 55 - 63
  • [48] Asymmetric Convolution View Adaptation Networks for Skeleton-Based Human Action Recognition
    Ma, Tianyu
    Yu, Jiahui
    Gao, Hongwei
    Ju, Zhaojie
    ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, 2022, 1409 : 191 - 199
  • [49] Skeleton-Based Action Recognition with Shift Graph Convolutional Network
    Cheng, Ke
    Zhang, Yifan
    He, Xiangyu
    Chen, Weihan
    Cheng, Jian
    Lu, Hanqing
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 180 - 189
  • [50] SHoTGCN: Spatial high-order temporal GCN for skeleton-based action recognition
    Liu, Qiyu
    Wu, Ying
    Li, Bicheng
    Ma, Yuxin
    Li, Hanling
    Yu, Yong
    NEUROCOMPUTING, 2025, 632