Self-Supervised Federated Learning for Personalized Human Activity Recognition

被引:0
作者
Deng, Shizhuo [1 ,2 ]
Teng, Da [1 ]
Guo, Zhubao [1 ]
Chen, Jiaqi [1 ]
Chen, Dongyue [1 ,2 ,3 ]
Jia, Tong [1 ,2 ,3 ]
Wang, Hao [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Peoples R China
[2] Northeastern Univ, Foshan Grad Sch Innovat, Foshan, Peoples R China
[3] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Op, Shenyang, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024 | 2024年
基金
中国国家自然科学基金;
关键词
Human Activity Recognition; Federated Learning; Self-supervised Learning; Wearable Sensor;
D O I
10.1109/ICME57554.2024.10687970
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Personalized Human Activity Recognition (PHAR) based on wearable sensors is crucial in the medical, sports, industrial and other fields. PHAR faces challenges of privacy leakage and a shortage of labeled data. Therefore, we propose a framework called self-supervised federated learning for personalized human activity recognition (SSF-HAR) to implement private PHAR. To protect user privacy, our framework integrates federated learning (FL) to achieve the transmission of only model parameters between the cloud and clients, rather than user data. Besides, we propose a strategy of weighted aggregation to update the cloud model with the client models. To overcome the lack of labeled data, our framework introduces self-supervised learning (SSL) tasks to pretrain a feature extractor in the cloud. The proxy task of SSL transforms data and provides pseudo-labels in three forms. We test the performance on the benchmark datasets MotionSense and WIDSM. The experiments show that SSF-HAR outperforms other FL frameworks for PHAR.
引用
收藏
页数:6
相关论文
共 20 条
[1]  
Bettini C., 2021, ARXIV
[2]   Self-Supervised GANs via Auxiliary Rotation Loss [J].
Chen, Ting ;
Zhai, Xiaohua ;
Ritter, Marvin ;
Lucic, Mario ;
Houlsby, Neil .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :12146-12155
[3]  
Grill J-B, 2020, PROC ADV NEURAL INF, V33, P21271
[4]   Masked Reconstruction Based Self-Supervision for Human Activity Recognition [J].
Haresamudram, Harish ;
Beedu, Apoorva ;
Agrawal, Varun ;
Grady, Patrick L. ;
Essa, Irfan ;
Hoffman, Judy ;
Plotz, Thomas .
PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, ISWC 2020, 2020, :45-49
[5]   Contrastive Predictive Coding for Human Activity Recognition [J].
Haresamudram, Harish ;
Essa, Irfan ;
Plotz, Thomas .
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2021, 5 (02)
[6]  
Li T, 2020, P MACHINE LEARNING S, V2, P429
[7]  
Li X., 2021, arXiv
[8]   Mobile Sensor Data Anonymization [J].
Malekzadeh, Mohammad ;
Clegg, Richard G. ;
Cavallaro, Andrea ;
Haddadi, Hamed .
PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTERNET OF THINGS DESIGN AND IMPLEMENTATION (IOTDI '19), 2019, :49-58
[9]  
McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
[10]   Multi-task self-supervised learning for human activity detection [J].
Saeed, Aaqib ;
Ozcelebi, Tanir ;
Lukkien, Johan .
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3 (02)