3D human action analysis and recognition through GLAC descriptor on 2D motion and static posture images

被引:13
作者
Bulbul, Mohammad Farhad [1 ]
Islam, Saiful [2 ]
Ali, Hazrat [3 ]
机构
[1] Jashore Univ Sci & Technol, Dept Math, Jashore, Bangladesh
[2] Bangabandhu Sheikh Mujibur Rahman Sci & Technol U, Dept Math, Gopalganj, Bangladesh
[3] COMSATS Univ Islamabad, Dept Elect & Comp Engn, Abbottabad Campus, Abbottabad, Pakistan
关键词
Human action recognition; l2-CRC; Motion history images; Static history images; REPRESENTATION; GRADIENTS; FUSION; HISTOGRAMS; ENSEMBLE; NETWORK; VISION; SCALE; POSE;
D O I
10.1007/s11042-019-7365-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present an approach for identification of actions within depth action videos. First, we process the video to get motion history images (MHIs) and static history images (SHIs) corresponding to an action video based on the use of 3D Motion Trail Model (3DMTM). We then characterize the action video by extracting the Gradient Local Auto-Correlations (GLAC) features from the SHIs and the MHIs. The two sets of features i.e., GLAC features from MHIs and GLAC features from SHIs are concatenated to obtain a representation vector for action. Finally, we perform the classification on all the action samples by using the l2-regularized Collaborative Representation Classifier (l2-CRC) to recognize different human actions in an effective way. We perform evaluation of the proposed method on three action datasets, MSR-Action3D, DHA and UTD-MHAD. Through experimental results, we observe that the proposed method performs superior to other approaches.
引用
收藏
页码:21085 / 21111
页数:27
相关论文
共 67 条
  • [11] Action recognition from depth sequences using weighted fusion of 2D and 3D auto-correlation of gradients features
    Chen, Chen
    Zhang, Baochang
    Hou, Zhenjie
    Jiang, Junjun
    Liu, Mengyuan
    Yang, Yun
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (03) : 4651 - 4669
  • [12] Gradient Local Auto-Correlations and Extreme Learning Machine for Depth-Based Activity Recognition
    Chen, Chen
    Hou, Zhenjie
    Zhang, Baochang
    Jiang, Junjun
    Yang, Yun
    [J]. ADVANCES IN VISUAL COMPUTING, PT I (ISVC 2015), 2015, 9474 : 613 - 623
  • [13] Chen C, 2015, IEEE IMAGE PROC, P168, DOI 10.1109/ICIP.2015.7350781
  • [14] Action Recognition from Depth Sequences Using Depth Motion Maps-based Local Binary Patterns
    Chen, Chen
    Jafari, Roozbeh
    Kehtarnavaz, Nasser
    [J]. 2015 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2015, : 1092 - 1099
  • [15] Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors
    Chen, Chen
    Jafari, Roozbeh
    Kehtarnavaz, Nasser
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2015, 45 (01) : 51 - 61
  • [16] Chen C, 2014, IEEE ENG MED BIO, P4135, DOI 10.1109/EMBC.2014.6944534
  • [17] Chen C, 2014, IEEE ENG MED BIO, P4983, DOI 10.1109/EMBC.2014.6944743
  • [18] Reconstruction of Hyperspectral Imagery From Random Projections Using Multihypothesis Prediction
    Chen, Chen
    Li, Wei
    Tramel, Eric W.
    Fowler, James E.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (01): : 365 - 374
  • [19] Real-time human action recognition based on depth motion maps
    Chen, Chen
    Liu, Kui
    Kehtarnavaz, Nasser
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2016, 12 (01) : 155 - 163
  • [20] Chen C, 2012, CONF REC ASILOMAR C, P608, DOI 10.1109/ACSSC.2012.6489079