Adaptive Federated Deep Learning With Non-IID Data

被引：0
作者：
Zhang, Ze-Hui
Li, Qing-Dan
Fu, Yao
He, Ning-Xin
Gao, Tie-Gang
机构：
来源：
Zidonghua Xuebao/Acta Automatica Sinica | 2023年 / 49卷 / 12期
关键词：
chaos system; deep learning; Federated learning (FL); homomorphic encryption; privacy-preserving;
D O I：
10.16383/j.aas.c201018
中图分类号：
学科分类号：
摘要：
In recent years, federated learning (FL) that can break data barriers and realize the value of isolated data, has been received wide-spread attention from industry and academia. However, in real industry applications, federated learning has problems with privacy leakage and model accuracy loss, which is analyzed through mathematical demonstration in this study. To solve the issues, this paper proposes an adaptive global model aggregation scheme that can adaptively set the Mini-batch value of each participant and the global model aggregation interval for the parameter server, which aims to improve the training efficiency while ensuring the accuracy of the model. Moreover, this paper introduces the chaos system into the federated learning field, which is used to construct a hybrid privacy-preserving scheme based on chaos system and homomorphic encryption, thereby further improving the privacy protection level. Theoretical analysis and experimental results show that the proposed approach can guarantee the data privacy security of participants. Moreover, in the non-independent and identically distributed (Non-IID) data scenario, the proposed method can improve the training efficiency and reduce communication cost while ensuring the model accuracy, which is feasible for real industrial applications. © 2023 Science Press. All rights reserved.
引用
收藏
页码：2493 / 2506
页数：13
相关论文
共 36 条
  • [11] Zhang W, Li X, Ma H, Luo Z, Li X., Federated learning for machinery fault diagnosis with dynamic validation and self-supervision, Knowledge-Based Systems, 213, (2021)
  • [12] Sheller M J, Edwards B, Reina G A, Martin J, Pati S, Kotrotsou A, Et al., Federated learning in medicine: Facilitating multiinstitutional collaborations without sharing patient data, Scientific Reports, 10, 1, (2020)
  • [13] Kwon D, Jeon J, Park S, Kim J, Cho S., Multiagent DDPGbased deep learning for Smart Ocean federated learning IoT networks, IEEE Internet of Things Journal, 7, 10, pp. 9895-9903, (2020)
  • [14] Rothchild D, Panda A, Ullah E, Ivkin N, Stoica I, Braverman V, Et al., FetchSGD: Communication-efficient federated learning with sketching, Proceedings of the 37th International Conference on Machine Learning, (2020)
  • [15] Duan M M, Liu D, Chen X Z, Liu R P, Tan Y J, Liang L., Self-balancing federated learning with global imbalanced data in mobile systems, IEEE Transactions on Parallel and Distributed Systems, 32, 1, pp. 59-71, (2021)
  • [16] Liu W, Chen L, Chen Y F, Zhang W Y., Accelerating federated learning via momentum gradient descent, IEEE Transactions on Parallel and Distributed Systems, 31, 8, pp. 1754-1766, (2020)
  • [17] Wang S Q, Tuor T, Salonidis T, Leung K K, Makaya C, He T, Et al., Adaptive federated learning in resource constrained edge computing systems, IEEE Journal on Selected Areas in Communications, 37, 6, pp. 1205-1221, (2019)
  • [18] Li Q B, Wen Z Y, Wu Z M, Hu S X, Wang N B, Li Y, Et al., A survey on federated learning systems: Vision, hype and reality for data privacy and protection, IEEE Transactions on Knowledge and Data Engineering, 35, 4, pp. 3347-3366, (2023)
  • [19] Zhang Ze-Hui, Fu Yao, Gao Tie-Gang, Research on federated deep neural network model for data privacy preserving, Acta Automatica Sinica, 48, 5, pp. 1273-1284, (2022)
  • [20] Lv L J, Li Y T, Nandakumar K, Yu J S, Ma X J., How to demo-cratise and protect AI: Fair and differentially private decentralised deep learning, IEEE Transactions on Dependable and Secure Computing, 19, 2, pp. 1003-1017, (2022)
1234