Action recognition algorithm based on skeletal joint data and adaptive time pyramid

被引:1
作者
Sima, Mingjun [1 ]
Hou, Mingzheng [1 ]
Zhang, Xin [1 ]
Ding, Jianwei [1 ]
Feng, Ziliang [1 ]
机构
[1] Sichuan Univ, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Action recognition; Skeletal joint data; Time pyramid; FUSION;
D O I
10.1007/s11760-021-02116-9
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Human action recognition technology plays an crucial role in the fields of video surveillance, video retrieval, sports medicine and human-computer interaction. Slow research and application of this technology limited to complex environments and plasticity of human action. As a new sensor, Kinect provides a new idea for human action recognition, which can synchronously obtain data of skeleton joint points from target. In this paper, we propose a human action recognition method using skeletal joints data. The motion and static information of human action are firstly fused as feature and skeletal vector is used to construct motion model which can describe variation of human action after feature extraction. Then the model is introduced into adaptive time pyramid to capture global and local information; furthermore, skeletal joints feature in each period of time is processed. Finally, kernel extreme learning machine is used for human action recognition. Experimental results show that our work successfully achieves skeleton information in comparison with other methods.
引用
收藏
页码:1615 / 1622
页数:8
相关论文
共 29 条
  • [1] Human activity recognition from 3D data: A review
    Aggarwal, J. K.
    Xia, Lu
    [J]. PATTERN RECOGNITION LETTERS, 2014, 48 : 70 - 80
  • [2] Human motions and emotions recognition inspired by LMA qualities
    Ajili, Insaf
    Mallem, Malik
    Didier, Jean-Yves
    [J]. VISUAL COMPUTER, 2019, 35 (10) : 1411 - 1426
  • [3] Dynamic 3D Hand Gesture Recognition by Learning Weighted Depth Motion Maps
    Azad, Reza
    Asadi-Aghbolaghi, Maryam
    Kasaei, Shohreh
    Escalera, Sergio
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (06) : 1729 - 1740
  • [4] Gradient local auto-correlation features for depth human action recognition
    Bulbul, Mohammad Farhad
    Ali, Hazrat
    [J]. SN APPLIED SCIENCES, 2021, 3 (05):
  • [5] Chen C, 2015, IEEE IMAGE PROC, P168, DOI 10.1109/ICIP.2015.7350781
  • [6] Performance Analysis of Smartphone-Sensor Behavior for Human Activity Recognition
    Chen, Yufei
    Shen, Chao
    [J]. IEEE ACCESS, 2017, 5 : 3095 - 3110
  • [7] Learning Spatiotemporal Features with 3D Convolutional Networks
    Du Tran
    Bourdev, Lubomir
    Fergus, Rob
    Torresani, Lorenzo
    Paluri, Manohar
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 4489 - 4497
  • [8] Skeletal Quads: Human Action Recognition Using Joint Quadruples
    Evangelidis, Georgios
    Singh, Gurkirt
    Horaud, Radu
    [J]. 2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 4513 - 4518
  • [9] Optimization method based extreme learning machine for classification
    Huang, Guang-Bin
    Ding, Xiaojian
    Zhou, Hongming
    [J]. NEUROCOMPUTING, 2010, 74 (1-3) : 155 - 163
  • [10] Deep Learning on Lie Groups for Skeleton-based Action Recognition
    Huang, Zhiwu
    Wan, Chengde
    Probst, Thomas
    Van Gool, Luc
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1243 - 1252