Action recognition algorithm based on skeletal joint data and adaptive time pyramid

被引:1
作者
Sima, Mingjun [1 ]
Hou, Mingzheng [1 ]
Zhang, Xin [1 ]
Ding, Jianwei [1 ]
Feng, Ziliang [1 ]
机构
[1] Sichuan Univ, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Action recognition; Skeletal joint data; Time pyramid; FUSION;
D O I
10.1007/s11760-021-02116-9
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Human action recognition technology plays an crucial role in the fields of video surveillance, video retrieval, sports medicine and human-computer interaction. Slow research and application of this technology limited to complex environments and plasticity of human action. As a new sensor, Kinect provides a new idea for human action recognition, which can synchronously obtain data of skeleton joint points from target. In this paper, we propose a human action recognition method using skeletal joints data. The motion and static information of human action are firstly fused as feature and skeletal vector is used to construct motion model which can describe variation of human action after feature extraction. Then the model is introduced into adaptive time pyramid to capture global and local information; furthermore, skeletal joints feature in each period of time is processed. Finally, kernel extreme learning machine is used for human action recognition. Experimental results show that our work successfully achieves skeleton information in comparison with other methods.
引用
收藏
页码:1615 / 1622
页数:8
相关论文
共 29 条
[21]   Accurate 3D action recognition using learning on the Grassmann manifold [J].
Slama, Rim ;
Wannous, Hazem ;
Daoudi, Mohamed ;
Srivastava, Anuj .
PATTERN RECOGNITION, 2015, 48 (02) :556-567
[22]   A Review on Machine Learning and Deep Learning Perspectives of IDS for IoT: Recent Updates, Security Issues, and Challenges [J].
Thakkar, Ankit ;
Lohiya, Ritika .
ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2021, 28 (04) :3211-3243
[23]   Fusion in stock market prediction: A decade survey on the necessity, recent developments, and potential future directions [J].
Thakkar, Ankit ;
Chaudhari, Kinjal .
INFORMATION FUSION, 2021, 65 (65) :95-107
[24]   Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group [J].
Vemulapalli, Raviteja ;
Arrate, Felipe ;
Chellappa, Rama .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :588-595
[25]   Action recognition based on joint trajectory maps with convolutional neural networks [J].
Wang, Pichao ;
Li, Wanqing ;
Li, Chuankun ;
Hou, Yonghong .
KNOWLEDGE-BASED SYSTEMS, 2018, 158 :43-53
[26]   Autoencoder With Invertible Functions for Dimension Reduction and Image Reconstruction [J].
Yang, Yimin ;
Wu, Q. M. Jonathan ;
Wang, Yaonan .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (07) :1065-1079
[27]   A Discriminative Deep Model With Feature Fusion and Temporal Attention for Human Action Recognition [J].
Yu, Jiahui ;
Gao, Hongwei ;
Yang, Wei ;
Jiang, Yueqiu ;
Chin, Weihong ;
Kubota, Naoyuki ;
Ju, Zhaojie .
IEEE ACCESS, 2020, 8 :43243-43255
[28]   Action Recognition Using 3D Histograms of Texture and A Multi-Class Boosting Classifier [J].
Zhang, Baochang ;
Yang, Yun ;
Chen, Chen ;
Yang, Linlin ;
Han, Jungong ;
Shao, Ling .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (10) :4648-4660
[29]  
Zhang YP, 2012, IEEE VTS VEH TECHNOL