Multi-ResAtt: Multilevel Residual Network With Attention for Human Activity Recognition Using Wearable Sensors

被引:110
作者
Al-qaness, Mohammed A. A. [1 ]
Dahou, Abdelghani [2 ,3 ]
Abd Elaziz, Mohamed [4 ,5 ,6 ]
Helmi, A. M. [7 ,8 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[2] Univ Ahmed DRAIA, Fac Sci & Technol, Lab Dev Durable & Informat LDDI Lab, Adrar 01000, Algeria
[3] Univ Ahmed DRAIA, Dept Math & Comp Sci, Adrar 01000, Algeria
[4] Galala Univ, Fac Comp Sci & Engn, Suez 435611, Egypt
[5] Zagazig Univ, Dept Math, Fac Sci, Zagazig 44519, Egypt
[6] Ajman Univ, Artificial Intelligence Res Ctr, Ajman 346, U Arab Emirates
[7] Zagazig Univ, Fac Engn, Dept Comp & Syst Engn, Zagazig 44519, Egypt
[8] Buraydah Private Coll, Coll Engn & Informat Technol, Buraydah 51418, Saudi Arabia
基金
中国国家自然科学基金;
关键词
Sensors; Deep learning; Feature extraction; Convolutional neural networks; Activity recognition; Residual neural networks; Informatics; Deep learning (DL); human activity recognition; Industry; 5; 0; Internet of Things (IoT); recurrent neural network (RNN); wearable sensors;
D O I
10.1109/TII.2022.3165875
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human activity recognition (HAR) applications have received much attention due to their necessary implementations in various domains, including Industry 5.0 applications such as smart homes, e-health, and various Internet of Things applications. Deep learning (DL) techniques have shown impressive performance in different classification tasks, including HAR. Accordingly, in this article, we develop a comprehensive HAR system based on a novel DL architecture called Multi-ResAtt (multilevel residual network with attention). This model incorporates initial blocks and residual modules aligned in parallel. Multi-ResAtt learns data representations on the inertial measurement units level. Multi-ResAtt integrates a recurrent neural network with attention to extract time-series features and perform activity recognition. We consider complex human activities collected from wearable sensors to evaluate the Multi-ResAtt using three public datasets, Opportunity; UniMiB-SHAR; and PAMAP2. Additionally, we compared the proposed Multi-ResAtt to several DL models and existing HAR systems, and it achieved significant performance.
引用
收藏
页码:144 / 152
页数:9
相关论文
共 30 条
[1]   Enhanced Human Activity Recognition Based on Smartphone Sensor Data Using Hybrid Feature Selection Model [J].
Ahmed, Nadeem ;
Rafiq, Jahir Ibna ;
Islam, Md Rashedul .
SENSORS, 2020, 20 (01)
[2]  
[Anonymous], 2016, Deep, Convolutional, and Recurrent Models for Human Activity Recognition using wearables
[3]  
Betancourt C, 2020, IEEE SYS MAN CYBERN, P1194, DOI [10.1109/smc42975.2020.9283381, 10.1109/SMC42975.2020.9283381]
[4]   The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition [J].
Chavarriaga, Ricardo ;
Sagha, Hesam ;
Calatroni, Alberto ;
Digumarti, Sundara Tejaswi ;
Troester, Gerhard ;
Millan, Jose del R. ;
Roggen, Daniel .
PATTERN RECOGNITION LETTERS, 2013, 34 (15) :2033-2042
[5]  
Fujii A., 2021, HUMAN ACTIVITY RECOG, P91
[6]   DanHAR: Dual Attention Network for multimodal human activity recognition using wearable sensors [J].
Gao, Wenbin ;
Zhang, Lei ;
Teng, Qi ;
He, Jun ;
Wu, Hao .
APPLIED SOFT COMPUTING, 2021, 111
[7]   Multi-GAT: A Graphical Attention-Based Hierarchical Multimodal Representation Learning Approach for Human Activity Recognition [J].
Islam, Md Mofijul ;
Iqbal, Tariq .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) :1729-1736
[8]   Differential Channel-State-Information-Based Human Activity Recognition in IoT Networks [J].
Khan, Pritam ;
Reddy, Bathula Shiva Karthik ;
Pandey, Ankur ;
Kumar, Sudhir ;
Youssef, Moustafa .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (11) :11290-11302
[9]   Interpretable and Accurate Convolutional Neural Networks for Human Activity Recognition [J].
Kim, Eunji .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (11) :7190-7198
[10]  
Kingma D. P., 2015, INT C LEARNING REPRE