Aldp-fl: an adaptive local differential privacy-based federated learning mechanism for IoT

被引:0
作者
Li, Jinguo [1 ]
Lu, Mengli [1 ]
Zhang, Jin [2 ]
Wu, Jing [1 ]
机构
[1] Shanghai Univ Elect Power, Shanghai 201306, Peoples R China
[2] Changsha Univ Sci & Technol, Changsha 410114, Peoples R China
基金
中国国家自然科学基金;
关键词
Local differential privacy; Federated learning; Privacy preserving;
D O I
10.1007/s10207-024-00933-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning offers an effective solution for safeguarding data privacy in the Internet of Things ecosystem among diverse stakeholders. To enhance data usability for sharing and collaboration, the integration of differential privacy (DP) techniques into federated learning becomes crucial, providing essential support for system sustainability. In fact, differential privacy-based federated learning (DPFL) has gained widespread application across various domains, including healthcare, finance, and smart homes. However, traditional DPFL faces challenges, such as potential privacy leakage due to the plaintext transmission of intermediate content between the central server and clients, as well as the adverse impact of DP on model accuracy. In this article, we propose ALDP, a federated learning-based adaptive local differential privacy mechanism for IoT, which aims to address the privacy leakage and model accuracy degradation problems encountered by traditional DPFL. Specifically, we employ a SAM optimizer to mitigate the negative impact of DP through perceptual tuning and gradient normalization. We further implement an effective threshold cropping technique to manage gradient explosion and sparsity, and apply hierarchical adaptive noise to ensure balanced privacy protection across both data and participants. Experimental results demonstrate that our scheme maintains high model accuracy while preserving privacy. Compared to existing methods, our ALDP mechanism achieves a training and testing accuracy difference of only 8.47% on the EMNIST dataset, significantly outperforming other benchmark methods.
引用
收藏
页数:14
相关论文
共 48 条
[1]  
Abbas M, 2022, PR MACH LEARN RES, P10
[2]  
Andriushchenko M, 2022, PR MACH LEARN RES, P639
[3]   Differentially Private Secure Multi-Party Computation for Federated Learning in Financial Applications [J].
Byrd, David ;
Polychroniadou, Antigoni .
FIRST ACM INTERNATIONAL CONFERENCE ON AI IN FINANCE, ICAIF 2020, 2020,
[4]   Improving Generalization in Federated Learning by Seeking Flat Minima [J].
Caldarola, Debora ;
Caputo, Barbara ;
Ciccone, Marco .
COMPUTER VISION, ECCV 2022, PT XXIII, 2022, 13683 :654-672
[5]  
Castiglia T, 2022, PR MACH LEARN RES
[6]   Secure and efficient federated learning via novel multi-party computation and compressed sensing [J].
Chen, Lvjun ;
Xiao, Di ;
Yu, Zhuyang ;
Zhang, Maolan .
INFORMATION SCIENCES, 2024, 667
[7]   Differentially Private Federated Learning with Local Regularization and Sparsification [J].
Cheng, Anda ;
Wang, Peisong ;
Zhang, Xi Sheryl ;
Cheng, Jian .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :10112-10121
[8]  
Cohen G, 2017, IEEE IJCNN, P2921, DOI 10.1109/IJCNN.2017.7966217
[9]  
Dai Y., 2024, Adv. Neural Inf. Process. Syst., V36
[10]  
Dwork C, 2006, LECT NOTES COMPUT SC, V4052, P1