Personalized Human Activity Recognition Based on Integrated Wearable Sensor and Transfer Learning

被引:50
作者
Fu, Zhongzheng [1 ]
He, Xinrun [1 ]
Wang, Enkai [1 ]
Huo, Jun [1 ]
Huang, Jian [1 ]
Wu, Dongrui [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Minist Educ Image Proc & Intelligent Control, Key Lab, Wuhan 430074, Peoples R China
关键词
human activity recognition (HAR); wearable device; air pressure sensor; inertial measurement unit (IMU); transfer learning;
D O I
10.3390/s21030885
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human activity recognition (HAR) based on the wearable device has attracted more attention from researchers with sensor technology development in recent years. However, personalized HAR requires high accuracy of recognition, while maintaining the model's generalization capability is a major challenge in this field. This paper designed a compact wireless wearable sensor node, which combines an air pressure sensor and inertial measurement unit (IMU) to provide multi-modal information for HAR model training. To solve personalized recognition of user activities, we propose a new transfer learning algorithm, which is a joint probability domain adaptive method with improved pseudo-labels (IPL-JPDA). This method adds the improved pseudo-label strategy to the JPDA algorithm to avoid cumulative errors due to inaccurate initial pseudo-labels. In order to verify our equipment and method, we use the newly designed sensor node to collect seven daily activities of 7 subjects. Nine different HAR models are trained by traditional machine learning and transfer learning methods. The experimental results show that the multi-modal data improve the accuracy of the HAR system. The IPL-JPDA algorithm proposed in this paper has the best performance among five HAR models, and the average recognition accuracy of different subjects is 93.2%.
引用
收藏
页码:1 / 23
页数:24
相关论文
共 62 条
[1]   Human activity recognition from 3D data: A review [J].
Aggarwal, J. K. ;
Xia, Lu .
PATTERN RECOGNITION LETTERS, 2014, 48 :70-80
[2]   Physical Human Activity Recognition Using Wearable Sensors [J].
Attal, Ferhat ;
Mohammed, Samer ;
Dedabrishvili, Mariam ;
Chamroukhi, Faicel ;
Oukhellou, Latifa ;
Amirat, Yacine .
SENSORS, 2015, 15 (12) :31314-31338
[3]   Human activity recognition using multidimensional indexing [J].
Ben-Arie, J ;
Wang, ZQ ;
Pandit, P ;
Rajaram, S .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (08) :1091-1104
[4]   Online Human Activity Recognition using Low-Power Wearable Devices [J].
Bhat, Ganapati ;
Deb, Ranadeep ;
Chaurasia, Vatika Vardhan ;
Shill, Holly ;
Ogras, Umit Y. .
2018 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD) DIGEST OF TECHNICAL PAPERS, 2018,
[5]   A Visual Servo-Based Predictive Control With Echo State Gaussian Process for Soft Bending Actuator [J].
Cao, Yu ;
Huang, Jian ;
Ru, Hongge ;
Chen, Wenbin ;
Xiong, Cai-Hua .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2021, 26 (01) :574-585
[6]  
Cardone G, 2014, 2014 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATION (ISCC)
[7]   A survey of video datasets for human action and activity recognition [J].
Chaquet, Jose M. ;
Carmona, Enrique J. ;
Fernandez-Caballero, Antonio .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2013, 117 (06) :633-659
[8]   Performance Analysis of Smartphone-Sensor Behavior for Human Activity Recognition [J].
Chen, Yufei ;
Shen, Chao .
IEEE ACCESS, 2017, 5 :3095-3110
[9]   A Deep Learning Approach to Human Activity Recognition Based on Single Accelerometer [J].
Chen, Yuqing ;
Xue, Yang .
2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, :1488-1492
[10]   Distilling the Knowledge From Handcrafted Features for Human Activity Recognition [J].
Chen, Zhenghua ;
Zhang, Le ;
Cao, Zhiguang ;
Guo, Jing .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (10) :4334-4342