H 2 GCN: A hybrid hypergraph convolution network for skeleton-based action recognition

被引:1
|
作者
Shao, Yiming [1 ]
Mao, Lintao [1 ]
Ye, Leixiong [1 ]
Li, Jincheng [1 ]
Yang, Ping [1 ]
Ji, Chengtao [2 ]
Wu, Zizhao [3 ]
机构
[1] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
[2] Xian Jiaotong Liverpool Univ, Suchou, Peoples R China
[3] Room 322,Build 10, Hangzhou 310018, Zhejiang, Peoples R China
关键词
Action recognition; Hypergraph convolution network; Spatio-temporal modeling;
D O I
10.1016/j.jksuci.2024.102072
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent GCN-based works have achieved remarkable results for skeleton -based human action recognition. Nevertheless, while existing approaches extensively investigate pairwise joint relationships, only a limited number of models explore the intricate, high -order relationships among multiple joints. In this paper, we propose a novel hypergraph convolution method that represents the relationships among multiple joints with hyperedges, and dynamically refines the height -order relationship between hyperedges in the spatial, temporal, and channel dimensions. Specifically, our method initiates with a temporal -channel refinement hypergraph convolutional network, dynamically learning temporal and channel topologies in a data -dependent manner, which facilitates the capture of non-physical structural information inherent in the human body. Furthermore, to model various inter -joint relationships across spatio-temporal dimensions, we propose a spatio-temporal hypergraph joint module, which aims to encapsulate the dynamic spatial-temporal characteristics of the human body. Through the integration of these modules, our proposed model achieves state-of-the-art performance on RGB+D 60 and NTU RGB+D 120 datasets.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Hypergraph Neural Network for Skeleton-Based Action Recognition
    Hao, Xiaoke
    Li, Jie
    Guo, Yingchun
    Jiang, Tao
    Yu, Ming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2263 - 2275
  • [2] A GCN and Transformer complementary network for skeleton-based action recognition
    Xiang, Xuezhi
    Li, Xiaoheng
    Liu, Xuzhao
    Qiao, Yulong
    El Saddik, Abdulmotaleb
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 249
  • [3] Hierarchical adaptive multi-scale hypergraph attention convolution network for skeleton-based action recognition
    Yang, Honghong
    Wang, Sai
    Jiang, Lu
    Su, Yuping
    Zhang, Yumei
    APPLIED SOFT COMPUTING, 2025, 172
  • [4] Si-GCN: Structure-induced Graph Convolution Network for Skeleton-based Action Recognition
    Liu, Rong
    Xu, Chunyan
    Zhang, Tong
    Zhao, Wenting
    Cui, Zhen
    Yang, Jian
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [5] Skeleton-Based Action Recognition with Improved Graph Convolution Network
    Yang, Xuqi
    Zhang, Jia
    Qin, Rong
    Su, Yunyu
    Qiu, Shuting
    Yu, Jintian
    Ge, Yongxin
    BIOMETRIC RECOGNITION (CCBR 2021), 2021, 12878 : 31 - 38
  • [6] Skeleton-based action recognition with JRR-GCN
    Ye, Fanfan
    Tang, Huiming
    ELECTRONICS LETTERS, 2019, 55 (17) : 933 - 935
  • [7] Enhanced decoupling graph convolution network for skeleton-based action recognition
    Gu, Yue
    Yu, Qiang
    Xue, Wanli
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (29) : 73289 - 73304
  • [8] EHC-GCN: Efficient Hierarchical Co-Occurrence Graph Convolution Network for Skeleton-Based Action Recognition
    Bai, Ying
    Yang, Dongsheng
    Xu, Jing
    Xu, Lei
    Wang, Hongliang
    APPLIED SCIENCES-BASEL, 2025, 15 (04):
  • [9] HybridNet: Integrating GCN and CNN for skeleton-based action recognition
    Wenjie Yang
    Jianlin Zhang
    Jingju Cai
    Zhiyong Xu
    Applied Intelligence, 2023, 53 : 574 - 585
  • [10] Selective Hypergraph Convolutional Networks for Skeleton-based Action Recognition
    Zhu, Yiran
    Huang, Guangji
    Xu, Xing
    Ji, Yanli
    Shen, Fumin
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2022, 2022, : 518 - 526