PART AWARE GRAPH CONVOLUTION NETWORK WITH TEMPORAL ENHANCEMENT FOR SKELETON-BASED ACTION RECOGNITION

被引:1
作者
Huang, Qian [1 ,2 ,3 ]
Nie, Yunqing [1 ,2 ,3 ]
Li, Xing [1 ,2 ]
Yang, Tianjin [1 ,2 ]
机构
[1] Hohai Univ, Minist Water Resources, Key Lab Water Big Data Technol, Nanjing, Peoples R China
[2] Hohai Univ, Sch Comp & Informat, Nanjing, Peoples R China
[3] Nanjing Huiying Elect Technol Corp, Nanjing, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2023年
关键词
Human action recognition; Skeleton; Graph convolution network;
D O I
10.1109/ICIP49359.2023.10222714
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, skeleton-based human action recognition has attracted broad research interests, and methods based on graph convolution networks have demonstrated excellent performance. However, how to extract the distinguishing spatio-temporal information effectively remains an essential problem. To address the problem, we propose a novel part aware graph convolution network with temporal enhancement, which can adaptively evaluate the activity level of each part of the body in the action sequence and enhance the extraction of temporal information. Considering that the range of motion of body parts in the action sequence is greater than that of joints, we manually divide the five major parts of the body and generate a skeleton sequence with different attention weights by using part-based attention module. Then, a temporal enhanced module is used to model actions with different duration. Experiments show that our method achieves the state-of-the-art performance.
引用
收藏
页码:3255 / 3259
页数:5
相关论文
共 18 条
  • [1] Human Activity Analysis: A Review
    Aggarwal, J. K.
    Ryoo, M. S.
    [J]. ACM COMPUTING SURVEYS, 2011, 43 (03)
  • [2] [Anonymous], 2019, P IEEE INT C ADV VID, DOI DOI 10.1089/END.2019.0084
  • [3] Skeleton-Based Action Recognition with Shift Graph Convolutional Network
    Cheng, Ke
    Zhang, Yifan
    He, Xiangyu
    Chen, Weihan
    Cheng, Jian
    Lu, Hanqing
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 180 - 189
  • [4] Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognition
    Li, Maosen
    Chen, Siheng
    Chen, Xu
    Zhang, Ya
    Wang, Yanfeng
    Tian, Qi
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3590 - 3598
  • [5] Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates
    Liu, Jun
    Shahroudy, Amir
    Xu, Dong
    Kot, Alex C.
    Wang, Gang
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (12) : 3007 - 3021
  • [6] Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognition
    Liu, Ziyu
    Zhang, Hongwen
    Chen, Zhenghao
    Wang, Zhiyong
    Ouyang, Wanli
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 140 - 149
  • [7] Peng Wei, 2020, P AAAI C ART INT
  • [8] A survey on vision-based human action recognition
    Poppe, Ronald
    [J]. IMAGE AND VISION COMPUTING, 2010, 28 (06) : 976 - 990
  • [9] Skeleton-Based Action Recognition with Directed Graph Neural Networks
    Shi, Lei
    Zhang, Yifan
    Cheng, Jian
    Lu, Hanqing
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7904 - 7913
  • [10] Two-Stream Adaptive Graph Convolutional Networks for Skeleton-Based Action Recognition
    Shi, Lei
    Zhang, Yifan
    Cheng, Jian
    Lu, Hanqing
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 12018 - 12027