Multi-ResAtt: Multilevel Residual Network With Attention for Human Activity Recognition Using Wearable Sensors

被引:91
作者
Al-qaness, Mohammed A. A. [1 ]
Dahou, Abdelghani [2 ,3 ]
Abd Elaziz, Mohamed [4 ,5 ,6 ]
Helmi, A. M. [7 ,8 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[2] Univ Ahmed DRAIA, Fac Sci & Technol, Lab Dev Durable & Informat LDDI Lab, Adrar 01000, Algeria
[3] Univ Ahmed DRAIA, Dept Math & Comp Sci, Adrar 01000, Algeria
[4] Galala Univ, Fac Comp Sci & Engn, Suez 435611, Egypt
[5] Zagazig Univ, Dept Math, Fac Sci, Zagazig 44519, Egypt
[6] Ajman Univ, Artificial Intelligence Res Ctr, Ajman 346, U Arab Emirates
[7] Zagazig Univ, Fac Engn, Dept Comp & Syst Engn, Zagazig 44519, Egypt
[8] Buraydah Private Coll, Coll Engn & Informat Technol, Buraydah 51418, Saudi Arabia
基金
中国国家自然科学基金;
关键词
Sensors; Deep learning; Feature extraction; Convolutional neural networks; Activity recognition; Residual neural networks; Informatics; Deep learning (DL); human activity recognition; Industry; 5; 0; Internet of Things (IoT); recurrent neural network (RNN); wearable sensors;
D O I
10.1109/TII.2022.3165875
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human activity recognition (HAR) applications have received much attention due to their necessary implementations in various domains, including Industry 5.0 applications such as smart homes, e-health, and various Internet of Things applications. Deep learning (DL) techniques have shown impressive performance in different classification tasks, including HAR. Accordingly, in this article, we develop a comprehensive HAR system based on a novel DL architecture called Multi-ResAtt (multilevel residual network with attention). This model incorporates initial blocks and residual modules aligned in parallel. Multi-ResAtt learns data representations on the inertial measurement units level. Multi-ResAtt integrates a recurrent neural network with attention to extract time-series features and perform activity recognition. We consider complex human activities collected from wearable sensors to evaluate the Multi-ResAtt using three public datasets, Opportunity; UniMiB-SHAR; and PAMAP2. Additionally, we compared the proposed Multi-ResAtt to several DL models and existing HAR systems, and it achieved significant performance.
引用
收藏
页码:144 / 152
页数:9
相关论文
共 50 条
  • [31] Sensors-Based Human Activity Recognition Using Hybrid Features and Deep Capsule Network
    Ghafoor, Hafiz Yasir
    Jahangir, Rashid
    Jaffar, Arfan
    Alroobaea, Roobaea
    Saidani, Oumaima
    Alhayan, Fatimah
    [J]. IEEE SENSORS JOURNAL, 2024, 24 (14) : 23129 - 23139
  • [32] Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
    Zhang, Shibo
    Li, Yaxuan
    Zhang, Shen
    Shahabi, Farzad
    Xia, Stephen
    Deng, Yu
    Alshurafa, Nabil
    [J]. SENSORS, 2022, 22 (04)
  • [33] Attention-based LSTM Network for Wearable Human Activity Recognition
    Sun, Bo
    Liu, Meiqin
    Zheng, Ronghao
    Zhang, Senlin
    [J]. PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 8677 - 8682
  • [34] Multiscale Deep Feature Learning for Human Activity Recognition Using Wearable Sensors
    Tang, Yin
    Zhang, Lei
    Min, Fuhong
    He, Jun
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2023, 70 (02) : 2106 - 2116
  • [35] An Overview of Human Activity Recognition Using Wearable Sensors: Healthcare and Artificial Intelligence
    Liu, Rex
    Ramli, Albara Ah
    Zhang, Huanle
    Henricson, Erik
    Liu, Xin
    [J]. INTERNET OF THINGS - ICIOT 2021, 2022, 12993 : 1 - 14
  • [36] Deep-Learning-Based Human Activity Recognition Using Wearable Sensors
    Nouriani, A.
    McGovern, R. A.
    Rajamani, R.
    [J]. IFAC PAPERSONLINE, 2022, 55 (37): : 1 - 6
  • [37] Layer-Wise Training Convolutional Neural Networks With Smaller Filters for Human Activity Recognition Using Wearable Sensors
    Tang, Yin
    Teng, Qi
    Zhang, Lei
    Min, Fuhong
    He, Jun
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (01) : 581 - 592
  • [38] Human activity recognition using wearable sensors by heterogeneous convolutional neural networks
    Han, Chaolei
    Zhang, Lei
    Tang, Yin
    Huang, Wenbo
    Min, Fuhong
    He, Jun
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 198
  • [39] Self-Attention Networks for Human Activity Recognition Using Wearable Devices
    Betancourt, Carlos
    Chen, Wen-Hui
    Kuan, Chi-Wei
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 1194 - 1199
  • [40] A Hybrid Deep Residual Network for Efficient Transitional Activity Recognition Based on Wearable Sensors
    Mekruksavanich, Sakorn
    Hnoohom, Narit
    Jitpattanakul, Anuchit
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (10):