Action recognition using interrelationships of 3D joints and frames based on angle sine relation and distance features using interrelationships

被引:19
作者
Islam, M. Shujah [1 ]
Bakhat, Khush [2 ]
Khan, Rashid [1 ]
Iqbal, Mansoor [1 ]
Islam, M. Mattah [3 ]
Ye, Zhongfu [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Air Univ, Islamabad, Pakistan
[3] Natl Univ Comp & Emerging Sci, Islamabad, Pakistan
关键词
Human action recognition; ASD-R; Joint's point interrelationships; Frame-frame interrelationships; SVM; REPRESENTATION;
D O I
10.1007/s10489-020-02176-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human action recognition is still an uncertain computer vision problem, which could be solved by a robust action descriptor. As a solution, we proposed an action recognition descriptor using only the 3D skeleton joint's points to perform this unsettle task. Joint's point interrelationships and frame-frame interrelationships are presented, which is a solution backbone to achieve human action recognition. Here, many joints are related to each other, and frames depend on different frames while performing any action sequence. Joints point spatial information calculates using angle, joint's sine relation, and distance features, whereas joints point temporal information estimates from frame-frame relations. Experiments are performed over four publicly available databases, i.e., MSR Daily Activity 3D Dataset, UTD Multimodal Human Action Dataset, KARD- Kinect Activity Recognition Dataset, and SBU Kinect Interaction Dataset, and proved that proposed descriptor outperforms as a comparison to state-of-the-art approaches on entire four datasets. Angle, Sine relation, and Distance features are extracted using interrelationships of joints and frames (ASD-R). It is all achieved due to accurately detecting spatial and temporal information of the Joint's points. Moreover, the Support Vector Machine classifier supports the proposed descriptor to identify the right classification precisely.
引用
收藏
页码:6001 / 6013
页数:13
相关论文
共 50 条
  • [21] Human action recognition in RGB-D videos using motion sequence information and deep learning
    Ijjina, Earnest Paul
    Chalavadi, Krishna Mohan
    [J]. PATTERN RECOGNITION, 2017, 72 : 504 - 516
  • [22] CAD: concatenated action descriptor for one and two person(s), using silhouette and silhouette's skeleton
    Islam, M. Shujah
    Iqbal, Mansoor
    Naqvi, Nuzhat
    Bakhat, Khush
    Islam, M. Mattah
    Kanwal, Shamsa
    Ye, Zhongfu
    [J]. IET IMAGE PROCESSING, 2020, 14 (03) : 417 - 422
  • [23] Automatic Recognition of Human Interaction via Hybrid Descriptors and Maximum Entropy Markov Model Using Depth Sensors
    Jalal, Ahmad
    Khalid, Nida
    Kim, Kibum
    [J]. ENTROPY, 2020, 22 (08)
  • [24] Ke Jina, 2017, The Journal of Engineering, DOI 10.1049/joe.2016.0330
  • [25] A New Representation of Skeleton Sequences for 3D Action Recognition
    Ke, Qiuhong
    Bennamoun, Mohammed
    An, Senjian
    Sohel, Ferdous
    Boussaid, Farid
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4570 - 4579
  • [26] SkeletonNet: Mining Deep Part Features for 3-D Action Recognition
    Ke, Qiuhong
    An, Senjian
    Bennamoun, Mohammed
    Sohel, Ferdous
    Boussaid, Farid
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (06) : 731 - 735
  • [27] Kerboua A, 2019, Int J Intell Syst Appl, V11, P42
  • [28] Joint Distance Maps Based Action Recognition With Convolutional Neural Networks
    Li, Chuankun
    Hou, Yonghong
    Wang, Pichao
    Li, Wanqing
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (05) : 624 - 628
  • [29] Application on Integration Technology of Visualized Hierarchical Information
    Li, Weibo
    He, Yang
    [J]. 2010 THE 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INDUSTRIAL APPLICATION (PACIIA2010), VOL I, 2010, : 9 - 12
  • [30] Skeleton-Based Human Action Recognition With Global Context-Aware Attention LSTM Networks
    Liu, Jun
    Wang, Gang
    Duan, Ling-Yu
    Abdiyeva, Kamila
    Kot, Alex C.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) : 1586 - 1599