Multiple Attention Mechanism Graph Convolution HAR Model Based on Coordination Theory

被引:9
作者
Hu, Kai [1 ,2 ]
Ding, Yiwu [1 ]
Jin, Junlan [1 ]
Xia, Min [1 ,2 ]
Huang, Huaming [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing 210044, Peoples R China
关键词
human action recognition; graph neural network; attention module;
D O I
10.3390/s22145259
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human action recognition (HAR) is the foundation of human behavior comprehension. It is of great significance and can be used in many real-world applications. From the point of view of human kinematics, the coordination of limbs is an important intrinsic factor of motion and contains a great deal of information. In addition, for different movements, the HAR algorithm provides important, multifaceted attention to each joint. Based on the above analysis, this paper proposes a HAR algorithm, which adopts two attention modules that work together to extract the coordination characteristics in the process of motion, and strengthens the attention of the model to the more important joints in the process of moving. Experimental data shows these two modules can improve the recognition accuracy of the model on the public HAR dataset (NTU-RGB + D, Kinetics-Skeleton).
引用
收藏
页数:18
相关论文
共 47 条
[21]  
Li C, 2017, IEEE INT CONF MULTI
[22]   Dual-Branch Network for Cloud and Cloud Shadow Segmentation [J].
Lu, Chen ;
Xia, Min ;
Qian, Ming ;
Chen, Binyu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[23]   Multi-scale strip pooling feature aggregation network for cloud and cloud shadow segmentation [J].
Lu, Chen ;
Xia, Min ;
Lin, Haifeng .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (08) :6149-6162
[24]   TCDA: Truthful Combinatorial Double Auctions for Mobile Edge Computing in Industrial Internet of Things [J].
Ma, Lianbo ;
Wang, Xueyi ;
Wang, Xingwei ;
Wang, Liang ;
Shi, Ying ;
Huang, Min .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (11) :4125-4138
[25]   Learning to Optimize: Reference Vector Reinforcement Learning Adaption to Constrained Many-Objective Optimization of Industrial Copper Burdening System [J].
Ma, Lianbo ;
Li, Nan ;
Guo, Yinan ;
Wang, Xingwei ;
Yang, Shengxiang ;
Huang, Min ;
Zhang, Hao .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (12) :12698-12711
[26]   Cloud/shadow segmentation based on multi-level feature enhanced network for remote sensing imagery [J].
Miao, Shoukuan ;
Xia, Min ;
Qian, Ming ;
Zhang, Yonghong ;
Liu, Jia ;
Lin, Haifeng .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (15-16) :5940-5960
[27]   A survey on video-based Human Action Recognition: recent updates, datasets, challenges, and applications [J].
Pareek, Preksha ;
Thakkar, Ankit .
ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (03) :2259-2322
[28]  
Peng W, 2020, AAAI CONF ARTIF INTE, V34, P2669
[29]   Strip pooling channel spatial attention network for the segmentation of cloud and cloud shadow [J].
Qu, Yi ;
Xia, Min ;
Zhang, Yonghong .
COMPUTERS & GEOSCIENCES, 2021, 157
[30]   NTU RGB plus D: A Large Scale Dataset for 3D Human Activity Analysis [J].
Shahroudy, Amir ;
Liu, Jun ;
Ng, Tian-Tsong ;
Wang, Gang .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1010-1019