Action recognition using interrelationships of 3D joints and frames based on angle sine relation and distance features using interrelationships

被引:19
作者
Islam, M. Shujah [1 ]
Bakhat, Khush [2 ]
Khan, Rashid [1 ]
Iqbal, Mansoor [1 ]
Islam, M. Mattah [3 ]
Ye, Zhongfu [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Air Univ, Islamabad, Pakistan
[3] Natl Univ Comp & Emerging Sci, Islamabad, Pakistan
关键词
Human action recognition; ASD-R; Joint's point interrelationships; Frame-frame interrelationships; SVM; REPRESENTATION;
D O I
10.1007/s10489-020-02176-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human action recognition is still an uncertain computer vision problem, which could be solved by a robust action descriptor. As a solution, we proposed an action recognition descriptor using only the 3D skeleton joint's points to perform this unsettle task. Joint's point interrelationships and frame-frame interrelationships are presented, which is a solution backbone to achieve human action recognition. Here, many joints are related to each other, and frames depend on different frames while performing any action sequence. Joints point spatial information calculates using angle, joint's sine relation, and distance features, whereas joints point temporal information estimates from frame-frame relations. Experiments are performed over four publicly available databases, i.e., MSR Daily Activity 3D Dataset, UTD Multimodal Human Action Dataset, KARD- Kinect Activity Recognition Dataset, and SBU Kinect Interaction Dataset, and proved that proposed descriptor outperforms as a comparison to state-of-the-art approaches on entire four datasets. Angle, Sine relation, and Distance features are extracted using interrelationships of joints and frames (ASD-R). It is all achieved due to accurately detecting spatial and temporal information of the Joint's points. Moreover, the Support Vector Machine classifier supports the proposed descriptor to identify the right classification precisely.
引用
收藏
页码:6001 / 6013
页数:13
相关论文
共 50 条
  • [1] Reducing multiclass to binary: A unifying approach for margin classifiers
    Allwein, EL
    Schapire, RE
    Singer, Y
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2001, 1 (02) : 113 - 141
  • [2] Fusion of Skeletal and Silhouette-based Features for Human Action Recognition with RGB-D Devices
    Andre Chaaraoui, Alexandros
    Ramon Padilla-Lopez, Jose
    Florez-Revuelta, Francisco
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, : 91 - 97
  • [3] Ashwini K., 2020, 2020 Proceedings of the International Conference on Communication and Signal Processing (ICCSP), P444, DOI 10.1109/ICCSP48568.2020.9182132
  • [4] Chen C, 2015, IEEE IMAGE PROC, P168, DOI 10.1109/ICIP.2015.7350781
  • [5] Action Recognition from Depth Sequences Using Depth Motion Maps-based Local Binary Patterns
    Chen, Chen
    Jafari, Roozbeh
    Kehtarnavaz, Nasser
    [J]. 2015 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2015, : 1092 - 1099
  • [6] Towards automatic feature extraction for activity recognition from wearable sensors: a deep learning approach
    Chikhaoui, Belkacem
    Gouineau, Frank
    [J]. 2017 17TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2017), 2017, : 693 - 702
  • [7] A Human Activity Recognition System Using Skeleton Data from RGBD Sensors
    Cippitelli, Enea
    Gasparrini, Samuele
    Gambi, Ennio
    Spinsante, Susanna
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2016, 2016
  • [8] Du Dalong, 2018, ARXIV PREPRINT ARXIV
  • [9] Du Y, 2015, PROC CVPR IEEE, P1110, DOI 10.1109/CVPR.2015.7298714
  • [10] On the Decoding Process in Ternary Error-Correcting Output Codes
    Escalera, Sergio
    Pujol, Oriol
    Radeva, Petia
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (01) : 120 - 134