Fed-MPS: Federated learning with local differential privacy using model parameter selection for resource-constrained CPS

被引:1
作者
Jiang, Shui [1 ]
Wang, Xiaoding [1 ,3 ]
Que, Youxiong [3 ]
Lin, Hui [1 ,2 ]
机构
[1] Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
[2] Fujian Prov Univ, Engn Res Ctr Cyber Secur & Educ Informatizat, Fuzhou 350117, Peoples R China
[3] Chinese Acad Trop Agr Sci, Inst Trop Biosci & Biotechnol, Natl Key Lab Trop Crop Breeding, Sanya 572024, Peoples R China
关键词
Cyber-Physical Systems; Distributed learning; Federated learning; Differential privacy;
D O I
10.1016/j.sysarc.2024.103108
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In Cyber-Physical Systems (CPS), distributed learning is essential for efficiently handling complex tasks when sufficient resources are available. However, when resources are limited, traditional distributed learning struggles to complete even simple tasks and presents a risk of privacy leakage. As a promising distributed learning paradigm, federated learning only requires the client to send the trained model to the server instead of private data, thereby preserving the client's privacy to some extent. However, with the rapid development of artificial intelligence technology, attack methods such as inference attacks still cause privacy leakage for clients participating in federated learning. Moreover, due to its distributed learning nature, federated learning cannot escape the dilemma of model accuracy being constrained by resources. To address the aforementioned problems, this paper proposes a Federated local differential privacy scheme using Model Parameter Selection, named Fed -MPS, for resource -constrained CPS. Specifically, to resolve the issue of limited CPS resources, Fed -MPS adopts an update direction consistency -based parameter selection algorithm in federated learning to extract parameters that enhance model accuracy for subsequent training, thereby improving the final model accuracy and reducing communication overhead. Furthermore, Fed -MPS applies the local differential privacy mechanism to further enhance clients' privacy. By adding noise only to the chosen parameters, the privacy budget is significantly reduced while ensuring model accuracy. Through privacy analysis, we prove that the proposed Fed -MPS scheme satisfies ( e , 6 ) - DP . Additionally, convergence analysis guarantees that Fed -MPS will converge to the global optimum with a convergence ratio of O ( T 1 2 ) within T rounds of federated learning. Extensive experiments on prominent benchmark datasets Cifar10, Mnist, and FashionMNIST demonstrate that, compared with baseline schemes, the proposed Fed -MPS provides higher model accuracy for CPS under resource constraints.
引用
收藏
页数:13
相关论文
共 55 条
  • [1] Utility Fairness for the Differentially Private Federated-Learning-Based Wireless IoT Networks
    Alvi, Sheeraz A.
    Hong, Yi
    Durrani, Salman
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (19): : 19398 - 19413
  • [2] Towards a real-time IoT: Approaches for incoming packet processing in cyber-physical systems
    Behnke, Ilja
    Blumschein, Christoph
    Danicki, Robert
    Wiesner, Philipp
    Thamsen, Lauritz
    Kao, Odej
    [J]. JOURNAL OF SYSTEMS ARCHITECTURE, 2023, 140
  • [3] A federated deep learning framework for privacy preservation and communication efficiency
    Cao, Tien-Dung
    Tram, Truong-Huu
    Tran, Hien
    Tran, Khanh
    [J]. JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 124
  • [4] Dwork C, 2006, LECT NOTES COMPUT SC, V4052, P1
  • [5] An Efficient Framework for Clustered Federated Learning
    Ghosh, Avishek
    Chung, Jichan
    Yin, Dong
    Ramchandran, Kannan
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (12) : 8076 - 8091
  • [6] Girgis Antonious, 2021, PMLR, P2521
  • [7] Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence
    Hao, Meng
    Li, Hongwei
    Luo, Xizhao
    Xu, Guowen
    Yang, Haomiao
    Liu, Sen
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (10) : 6532 - 6542
  • [8] Contribution- and Participation-Based Federated Learning on Non-IID Data
    Hu, Fei
    Zhou, Wuneng
    Liao, Kaili
    Li, Hongliang
    [J]. IEEE INTELLIGENT SYSTEMS, 2022, 37 (04) : 35 - 43
  • [9] Hu R, 2022, Arxiv, DOI arXiv:2202.07178
  • [10] Hu R, 2021, Arxiv, DOI arXiv:2008.01558