Human action recognition based on spatial-temporal relational model and LSTM-CNN framework

被引:7
|
作者
Senthilkumar, N. [1 ]
Manimegalai, M. [2 ]
Karpakam, S. [3 ]
Ashokkumar, S. R. [3 ]
Premkumar, M. [4 ]
机构
[1] Dr NGP Inst Technol, Dept ECE, Coimbatore, Tamil Nadu, India
[2] Mahendra Engn Coll Women, Dept ECE, Namakkal, India
[3] Sri Eshwar Coll Engn, Dept ECE, Coimbatore, Tamil Nadu, India
[4] SSM Inst Engn & Technol, Dept ECE, Dindigul, India
关键词
Action recognition; Dilated bi-directional LSTM; CNN;
D O I
10.1016/j.matpr.2021.12.004
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Due to the increasing popularity of human skeleton capture systems, many new methods for implementing skeleton-based action recognition has been proposed. Some of these include Long Term Memory and Convolutional Neural Networks. These methods can investigate the significant spatial-temporal information, but they are limited in their capacity to do so in real-world scenarios. In this paper, a new spatialtemporal model with a bi-temporal end-to-end framework is proposed. A novel structure is proposed to combine the functions LSTM and CNN. The structure uses the dependency model to build the skeleton data for the proposed network. Copyright (C) 2022 Elsevier Ltd. All rights reserved. Selection and peer-review under responsibility of the scientific committee of the International Conference on Innovation and Application in Science and Technology
引用
收藏
页码:2087 / 2091
页数:5
相关论文
共 50 条
  • [1] Exploring a rich spatial-temporal dependent relational model for skeleton-based action recognition by bidirectional LSTM-CNN
    Zhu, Aichun
    Wu, Qianyu
    Cui, Ran
    Wang, Tian
    Hang, Wenlong
    Hua, Gang
    Snoussi, Hichem
    NEUROCOMPUTING, 2020, 414 : 90 - 100
  • [2] Spatial-Temporal Taxi Demand Prediction Using LSTM-CNN
    Shu, Pengfeng
    Sun, Ying
    Zhao, Yifan
    Xu, Gangyan
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2020, : 1226 - 1230
  • [3] A Novel Action Recognition Scheme Based on Spatial-Temporal Pyramid Model
    Zhao, Hengying
    Xiang, Xinguang
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT II, 2018, 10736 : 212 - 221
  • [4] Bi-direction hierarchical LSTM with spatial-temporal attention for action recognition
    Yang, Haodong
    Zhang, Jun
    Li, Shuohao
    Luo, Tingjin
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 36 (01) : 775 - 786
  • [5] STA-CNN: Convolutional Spatial-Temporal Attention Learning for Action Recognition
    Yang, Hao
    Yuan, Chunfeng
    Zhang, Li
    Sun, Yunda
    Hu, Weiming
    Maybank, Stephen J.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5783 - 5793
  • [6] Spatial-Temporal Attention for Action Recognition
    Sun, Dengdi
    Wu, Hanqing
    Ding, Zhuanlian
    Luo, Bin
    Tang, Jin
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT I, 2018, 11164 : 854 - 864
  • [7] An Attention Enhanced Spatial-Temporal Graph Convolutional LSTM Network for Action Recognition in Karate
    Guo, Jianping
    Liu, Hong
    Li, Xi
    Xu, Dahong
    Zhang, Yihan
    APPLIED SCIENCES-BASEL, 2021, 11 (18):
  • [8] A SPATIAL-TEMPORAL CONSTRAINT-BASED ACTION RECOGNITION METHOD
    Han, Tingting
    Yao, Hongxun
    Zhang, Yanhao
    Xu, Pengfei
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 2767 - 2771
  • [9] Human action recognition based on multi-mode spatial-temporal feature fusion
    Wang, Dongli
    Yang, Jun
    Zhou, Yan
    2019 22ND INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2019), 2019,
  • [10] Joint spatial-temporal attention for action recognition
    Yu, Tingzhao
    Guo, Chaoxu
    Wang, Lingfeng
    Gu, Huxiang
    Xiang, Shiming
    Pan, Chunhong
    PATTERN RECOGNITION LETTERS, 2018, 112 : 226 - 233