Human activity recognition using a multi-branched CNN-BiLSTM-BiGRU model

被引:9
作者
Lalwani, Pooja [1 ]
Ramasamy, Ganeshan [1 ]
机构
[1] VIT Bhopal Univ, Sch Comp Sci & Engn, Bhopal 466114, Madhya Pradesh, India
关键词
Human activity recognition; Deep learning; Classification; Bipedal robot; Accelerometer; Sensors; Smartphone; CLASSIFICATION; NETWORK;
D O I
10.1016/j.asoc.2024.111344
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human behaviour analysis, human-computer interaction, and pervasive computing are three areas where human activity recognition has recently attracted a lot of attention. Recent advances in deep learning have made it possible to accurately predict a variety of human actions by handling time -series data from wearable sensors and mobile devices quickly. Despite their remarkable achievements in recognising activities, DL -based algorithms continue to face hurdles in successfully processing sequential data. Ongoing difficulties include complex feature extraction, dealing with data imbalances, and other related concerns. Furthermore, manual feature engineering techniques are significantly used in the majority of HAR approaches. In order to recognise human behaviours using wearable sensors, this research introduces a powerful classification technique. The strategy combines a bidirectional long -short-term memory, a convolutional neural network, and a bidirectional gated recurrent unit. This system efficiently and successfully derives critical insights from unprocessed sensor data. The model gains the capacity to recognise both short-term patterns and long-term associations in sequential data by merging CNN, BiGRU, and BiLSTM components. The model can capture a wide range of temporal local connections since the feature extraction process is sped up by the addition of multiple filter sizes. The algorithm's performance is assessed using common datasets, particularly the WISDM dataset, which shows a remarkable accuracy of 99.33% and an F1 -score of 73.20% for the hybrid model CCBB. The proposed model is proven to be superior to competing approaches by experimental findings.
引用
收藏
页数:17
相关论文
共 52 条
  • [1] Abdel-Salam R., 2021, INT WORKSH DEEP LEAR, P1
  • [2] Two-stream spatiotemporal feature fusion for human action recognition
    Abdelbaky, Amany
    Aly, Saleh
    [J]. VISUAL COMPUTER, 2021, 37 (07) : 1821 - 1835
  • [3] LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT
    BENGIO, Y
    SIMARD, P
    FRASCONI, P
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02): : 157 - 166
  • [4] A Comparative Study on Classifying Human Activities Using Classical Machine and Deep Learning Methods
    Bozkurt, Ferhat
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2022, 47 (02) : 1507 - 1521
  • [5] Chakraborty P., Understanding the level of human attention for cognitive analysis to transplant the human behavioral mechanism to robots
  • [6] A multibranch CNN-BiLSTM model for human activity recognition using wearable sensor data
    Challa, Sravan Kumar
    Kumar, Akhilesh
    Semwal, Vijay Bhaskar
    [J]. VISUAL COMPUTER, 2022, 38 (12) : 4095 - 4109
  • [7] Multi-label image classification with recurrently learning semantic dependencies
    Chen, Long
    Wang, Ronggui
    Yang, Juan
    Xue, Lixia
    Hu, Min
    [J]. VISUAL COMPUTER, 2019, 35 (10) : 1361 - 1371
  • [8] Smartphone Sensor-Based Human Activity Recognition Using Feature Fusion and Maximum Full a Posteriori
    Chen, Zhenghua
    Jiang, Chaoyang
    Xiang, Shili
    Ding, Jie
    Wu, Min
    Li, Xiaoli
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (07) : 3992 - 4001
  • [9] Das Antar A, 2019, 2019 JOINT 8TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2019 3RD INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR) WITH INTERNATIONAL CONFERENCE ON ACTIVITY AND BEHAVIOR COMPUTING (ABC), P134, DOI [10.1109/ICIEV.2019.8858508, 10.1109/iciev.2019.8858508]
  • [10] RCNet: road classification convolutional neural networks for intelligent vehicle system
    Dewangan, Deepak Kumar
    Sahu, Satya Prakash
    [J]. INTELLIGENT SERVICE ROBOTICS, 2021, 14 (02) : 199 - 214