Ensem-HAR: An Ensemble Deep Learning Model for Smartphone Sensor-Based Human Activity Recognition for Measurement of Elderly Health Monitoring

被引:71
作者
Bhattacharya, Debarshi [1 ]
Sharma, Deepak [2 ]
Kim, Wonjoon [3 ]
Ijaz, Muhammad Fazal [4 ]
Singh, Pawan Kumar [2 ]
机构
[1] Techno Main Salt Lake, Dept Elect & Commun Engn, EM-4-1,Sect 5, Kolkata 700091, W Bengal, India
[2] Jadavpur Univ, Dept Informat Technol, Second Campus,Plot 8,LB Block,Sect 3, Kolkata 700106, W Bengal, India
[3] Dongduk Womens Univ, Div Future Convergence, Seoul 02748, South Korea
[4] Sejong Univ, Dept Intelligent Mechatron Engn, Seoul 05006, South Korea
来源
BIOSENSORS-BASEL | 2022年 / 12卷 / 06期
基金
新加坡国家研究基金会;
关键词
Human Activity Recognition; Ensem-HAR; elderly health monitoring; deep learning; WISDM; PAMAP2; UCI-HAR; CONVOLUTIONAL NEURAL-NETWORKS;
D O I
10.3390/bios12060393
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Biomedical images contain a huge number of sensor measurements that can provide disease characteristics. Computer-assisted analysis of such parameters aids in the early detection of disease, and as a result aids medical professionals in quickly selecting appropriate medications. Human Activity Recognition, abbreviated as 'HAR', is the prediction of common human measurements, which consist of movements such as walking, running, drinking, cooking, etc. It is extremely advantageous for services in the sphere of medical care, such as fitness trackers, senior care, and archiving patient information for future use. The two types of data that can be fed to the HAR system as input are, first, video sequences or images of human activities, and second, time-series data of physical movements during different activities recorded through sensors such as accelerometers, gyroscopes, etc., that are present in smart gadgets. In this paper, we have decided to work with time-series kind of data as the input. Here, we propose an ensemble of four deep learning-based classification models, namely, 'CNN-net', 'CNNLSTM-net', 'ConvLSTM-net', and 'StackedLSTM-net', which is termed as 'Ensem-HAR'. Each of the classification models used in the ensemble is based on a typical 1D Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) network; however, they differ in terms of their architectural variations. Prediction through the proposed Ensem-HAR is carried out by stacking predictions from each of the four mentioned classification models, then training a Blender or Meta-learner on the stacked prediction, which provides the final prediction on test data. Our proposed model was evaluated over three benchmark datasets, WISDM, PAMAP2, and UCI-HAR; the proposed Ensem-HAR model for biomedical measurement achieved 98.70%, 97.45%, and 95.05% accuracy, respectively, on the mentioned datasets. The results from the experiments reveal that the suggested model performs better than the other multiple generated measurements to which it was compared.
引用
收藏
页数:25
相关论文
共 46 条
[1]   ST-DeepHAR: Deep Learning Model for Human Activity Recognition in IoHT Applications [J].
Abdel-Basset, Mohamed ;
Hawash, Hossam ;
Chakrabortty, Ripon K. ;
Ryan, Michael ;
Elhoseny, Mohamed ;
Song, Houbing .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (06) :4969-4979
[2]   A Lightweight Deep Learning Model for Human Activity Recognition on Edge Devices [J].
Agarwal, Preeti ;
Alam, Mansaf .
INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 :2364-2373
[3]  
[Anonymous], 2013, 21TH EUROPEAN S ARTI
[4]   Coarse-Fine Convolutional Deep-Learning Strategy for Human Activity Recognition [J].
Aviles-Cruz, Carlos ;
Ferreyra-Ramirez, Andres ;
Zuniga-Lopez, Arturo ;
Villegas-Cortez, Juan .
SENSORS, 2019, 19 (07)
[5]   COFE-Net: An ensemble strategy for Computer-Aided Detection for COVID-19 [J].
Banerjee, Avinandan ;
Bhattacharya, Rajdeep ;
Bhateja, Vikrant ;
Singh, Pawan Kumar ;
Lay-Ekuakille, Aime' ;
Sarkar, Ram .
MEASUREMENT, 2022, 187
[6]  
Bhattacharya S., 2020, P INT C SOFT COMP PA, P10, DOI [10.1007/978-3-030-49345-5_2, DOI 10.1007/978-3-030-49345-5_2]
[7]   Transfer learning with fine tuning for human action recognition from still images [J].
Chakraborty, Saikat ;
Mondal, Riktim ;
Singh, Pawan Kumar ;
Sarkar, Ram ;
Bhattacharjee, Debotosh .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (13) :20547-20578
[8]   A multibranch CNN-BiLSTM model for human activity recognition using wearable sensor data [J].
Challa, Sravan Kumar ;
Kumar, Akhilesh ;
Semwal, Vijay Bhaskar .
VISUAL COMPUTER, 2022, 38 (12) :4095-4109
[9]   A Deep Learning Approach to Human Activity Recognition Based on Single Accelerometer [J].
Chen, Yuqing ;
Xue, Yang .
2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, :1488-1492
[10]   Real-Time Human Activity Recognition Using Conditionally Parametrized Convolutions on Mobile and Wearable Devices [J].
Cheng, Xin ;
Zhang, Lei ;
Tang, Yin ;
Liu, Yue ;
Wu, Hao ;
He, Jun .
IEEE SENSORS JOURNAL, 2022, 22 (06) :5889-5901