H 2 GCN: A hybrid hypergraph convolution network for skeleton-based action recognition

被引:1
|
作者
Shao, Yiming [1 ]
Mao, Lintao [1 ]
Ye, Leixiong [1 ]
Li, Jincheng [1 ]
Yang, Ping [1 ]
Ji, Chengtao [2 ]
Wu, Zizhao [3 ]
机构
[1] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
[2] Xian Jiaotong Liverpool Univ, Suchou, Peoples R China
[3] Room 322,Build 10, Hangzhou 310018, Zhejiang, Peoples R China
关键词
Action recognition; Hypergraph convolution network; Spatio-temporal modeling;
D O I
10.1016/j.jksuci.2024.102072
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent GCN-based works have achieved remarkable results for skeleton -based human action recognition. Nevertheless, while existing approaches extensively investigate pairwise joint relationships, only a limited number of models explore the intricate, high -order relationships among multiple joints. In this paper, we propose a novel hypergraph convolution method that represents the relationships among multiple joints with hyperedges, and dynamically refines the height -order relationship between hyperedges in the spatial, temporal, and channel dimensions. Specifically, our method initiates with a temporal -channel refinement hypergraph convolutional network, dynamically learning temporal and channel topologies in a data -dependent manner, which facilitates the capture of non-physical structural information inherent in the human body. Furthermore, to model various inter -joint relationships across spatio-temporal dimensions, we propose a spatio-temporal hypergraph joint module, which aims to encapsulate the dynamic spatial-temporal characteristics of the human body. Through the integration of these modules, our proposed model achieves state-of-the-art performance on RGB+D 60 and NTU RGB+D 120 datasets.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] PART AWARE GRAPH CONVOLUTION NETWORK WITH TEMPORAL ENHANCEMENT FOR SKELETON-BASED ACTION RECOGNITION
    Huang, Qian
    Nie, Yunqing
    Li, Xing
    Yang, Tianjin
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3255 - 3259
  • [22] SelfGCN: Graph Convolution Network With Self-Attention for Skeleton-Based Action Recognition
    Wu, Zhize
    Sun, Pengpeng
    Chen, Xin
    Tang, Keke
    Xu, Tong
    Zou, Le
    Wang, Xiaofeng
    Tan, Ming
    Cheng, Fan
    Weise, Thomas
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4391 - 4403
  • [23] Multi-Scale Adaptive Graph Convolution Network for Skeleton-Based Action Recognition
    Hu, Huangshui
    Fang, Yue
    Han, Mei
    Qi, Xingshuo
    IEEE ACCESS, 2024, 12 : 16868 - 16880
  • [24] Auxiliary Task Graph Convolution Network: A Skeleton-Based Action Recognition for Practical Use
    Cho, Junsu
    Kim, Seungwon
    Oh, Chi-Min
    Park, Jeong-Min
    APPLIED SCIENCES-BASEL, 2025, 15 (01):
  • [25] Dual-Stream Structured Graph Convolution Network for Skeleton-Based Action Recognition
    Xu, Chunyan
    Liu, Rong
    Zhang, Tong
    Cui, Zhen
    Yang, Jian
    Hu, Chunlong
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (04)
  • [26] Dual-Excitation SpatialTemporal Graph Convolution Network for Skeleton-Based Action Recognition
    Lu, Jian
    Huang, Tingting
    Zhao, Bo
    Chen, Xiaogai
    Zhou, Jian
    Zhang, Kaibing
    IEEE SENSORS JOURNAL, 2024, 24 (06) : 8184 - 8196
  • [27] Semantics-Assisted Training Graph Convolution Network for Skeleton-Based Action Recognition
    Hu, Huangshui
    Cao, Yu
    Fang, Yue
    Meng, Zhiqiang
    Sensors, 2025, 25 (06)
  • [28] Multi-channel network: Constructing efficient GCN baselines for skeleton-based action recognition
    Hou, Ruijie
    Wang, Zhihao
    Ren, Ruimin
    Cao, Yang
    Wang, Zhao
    COMPUTERS & GRAPHICS-UK, 2023, 110 : 111 - 117
  • [29] Multi-Scale Mixed Dense Graph Convolution Network for Skeleton-Based Action Recognition
    Xia, Hailun
    Gao, Xinkai
    IEEE ACCESS, 2021, 9 (09): : 36475 - 36484
  • [30] A spatial attentive and temporal dilated (SATD) GCN for skeleton-based action recognition
    Zhang, Jiaxu
    Ye, Gaoxiang
    Tu, Zhigang
    Qin, Yongtao
    Qin, Qianqing
    Zhang, Jinlu
    Liu, Jun
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2022, 7 (01) : 46 - 55