Proposed spatio-temporal features for human activity classification using ensemble classification model

被引:0
作者
Tyagi, Anshuman [1 ]
Singh, Pawan [1 ]
Dev, Harsh [2 ]
机构
[1] Amity Univ, Amity Sch Engn & Technol Lucknow, Dept Comp Sci & Engn, Noida, Uttar Pradesh, India
[2] Pranveer Singh Inst Technol, Kanpur, India
关键词
accuracy; human action; multi-layer perceptron; proposed spatio-temporal features; RNN; HUMAN ACTIVITY RECOGNITION; WI-FI; KNOWLEDGE; SPACE;
D O I
10.1002/cpe.7588
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Classifying human actions from still images or video sequences is a demanding task owing to issues, like lighting, backdrop clutter, variations in scale, partial occlusion, viewpoint, and appearance. A lot of appliances, together with video systems, human-computer interfaces, and surveillance necessitate a compound action recognition system. Here, the proposed system develops a novel scheme for HAR. Initially, filtering as well as background subtraction is done during preprocessing. Then, the features including local binary pattern (LBP), bag of the virtual word (BOW), and the proposed local spatio-temporal features are extracted. Then, in the recognition phase, an ensemble classification model is introduced that includes Recurrent Neural networks (RNN 1 and RNN 2) and Multi-Layer Perceptron (MLP 1 and MLP 2). The features are classified using RNN 1 and RNN 2, and the outputs from RNN 1 and RNN 2 are further classified using MLP 1 and MLP 2, respectively. Finally, the outputs attained from MLP 1 and MLP 2 are averaged and the final classified output is obtained. At last, the superiority of the developed approach is proved on varied measures.
引用
收藏
页数:12
相关论文
共 50 条
[41]   A spatio-temporal absorbing state model for disease and syndromic surveillance [J].
Heaton, Matthew J. ;
Banks, David L. ;
Zou, Jian ;
Karr, Alan F. ;
Datta, Gauri ;
Lynch, James ;
Vera, Francisco .
STATISTICS IN MEDICINE, 2012, 31 (19) :2123-2136
[42]   EdgeRNN: A Compact Speech Recognition Network With Spatio-Temporal Features for Edge Computing [J].
Yang, Shunzhi ;
Gong, Zheng ;
Ye, Kai ;
Wei, Yungen ;
Huang, Zhenhua ;
Huang, Zheng .
IEEE ACCESS, 2020, 8 :81468-81478
[43]   Modelling daily actions through hand-based spatio-temporal features [J].
Mur, Olga ;
Frigola, Manel ;
Casals, Alicia .
PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2015, :478-483
[44]   Early predictive model for breast cancer classification using blended ensemble learning [J].
T. R. Mahesh ;
V. Vinoth Kumar ;
V. Vivek ;
K. M. Karthick Raghunath ;
G. Sindhu Madhuri .
International Journal of System Assurance Engineering and Management, 2024, 15 :188-197
[45]   Early predictive model for breast cancer classification using blended ensemble learning [J].
Mahesh, T. R. ;
Kumar, V. Vinoth ;
Vivek, V. ;
Raghunath, K. M. Karthick ;
Madhuri, G. Sindhu .
INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, 2024, 15 (01) :188-197
[46]   Motion Prediction of Beating Heart Using Spatio-Temporal LSTM [J].
Zhang, Wanruo ;
Yao, Guan ;
Yang, Bo ;
Zheng, Wenfeng ;
Liu, Chao .
IEEE SIGNAL PROCESSING LETTERS, 2022, 29 :787-791
[47]   Spatio-Temporal Data Clustering using Deep Learning: A Review [J].
Aparna, R. ;
Idicula, Sumam Mary .
2022 IEEE CONFERENCE ON EVOLVING AND ADAPTIVE INTELLIGENT SYSTEMS (IEEE EAIS 2022), 2022,
[48]   Estimation of Housing Price Variations Using Spatio-Temporal Data [J].
Chica-Olmo, Jorge ;
Cano-Guervos, Rafael ;
Chica-Rivas, Mario .
SUSTAINABILITY, 2019, 11 (06)
[49]   Compressing an Ensemble With Statistical Models: An Algorithm for Global 3D Spatio-Temporal Temperature [J].
Castruccio, Stefano ;
Genton, Marc G. .
TECHNOMETRICS, 2016, 58 (03) :319-328
[50]   Evaluation of Color Spatio-Temporal Interest Points for Human Action Recognition [J].
Everts, Ivo ;
van Gemert, Jan C. ;
Gevers, Theo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (04) :1569-1580