FLCP: federated learning framework with communication-efficient and privacy-preserving

被引:0
作者
Yang, Wei [1 ]
Yang, Yuan [1 ]
Xi, Yingjie [2 ]
Zhang, Hailong [2 ]
Xiang, Wei [3 ,4 ]
机构
[1] Xian Univ Technol, Sch Automat & Informat Engn, Xian 710048, Peoples R China
[2] Xian Univ Technol, Sch Int Engn, Xian 710048, Peoples R China
[3] La Trobe Univ, Sch Comp Engn & Math Sci, Melbourne 3086, Australia
[4] James Cook Univ, Coll Sci & Engn, Cairns, Qld 4870, Australia
基金
中国国家自然科学基金;
关键词
Artificial intelligence; Federated learning; Privacy protection; Communication efficiency; DIFFERENTIAL PRIVACY; ENCRYPTION;
D O I
10.1007/s10489-024-05521-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Within the federated learning (FL) framework, the client collaboratively trains the model in coordination with a central server, while the training data can be kept locally on the client. Thus, the FL framework mitigates the privacy disclosure and costs related to conventional centralized machine learning. Nevertheless, current surveys indicate that FL still has problems in terms of communication efficiency and privacy risks. In this paper, to solve these problems, we develop an FL framework with communication-efficient and privacy-preserving (FLCP). To realize the FLCP, we design a novel compression algorithm with efficient communication, namely, adaptive weight compression FedAvg (AWC-FedAvg). On the basis of the non-independent and identically distributed (non-IID) and unbalanced data distribution in FL, a specific compression rate is provided for each client, and homomorphic encryption (HE) and differential privacy (DP) are integrated to provide demonstrable privacy protection and maintain the desirability of the model. Therefore, our proposed FLCP smoothly balances communication efficiency and privacy risks, and we prove its security against "honest-but-curious" servers and extreme collusion under the defined threat model. We evaluate the scheme by comparing it with state-of-the-art results on the MNIST and CIFAR-10 datasets. The results show that the FLCP performs better in terms of training efficiency and model accuracy than the baseline method.
引用
收藏
页码:6816 / 6835
页数:20
相关论文
共 50 条
  • [41] Staged Noise Perturbation for Privacy-Preserving Federated Learning
    Li, Zhe
    Chen, Honglong
    Gao, Yudong
    Ni, Zhichen
    Xue, Huansheng
    Shao, Huajie
    [J]. IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2024, 9 (06): : 936 - 947
  • [42] An Efficient and Dynamic Privacy-Preserving Federated Learning System for Edge Computing
    Tang, Xinyu
    Guo, Cheng
    Choo, Kim-Kwang Raymond
    Liu, Yining
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 207 - 220
  • [43] Privacy-preserving federated learning on lattice quantization
    Zhang, Lingjie
    Zhang, Hai
    [J]. INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2023, 21 (06)
  • [44] AddShare: A Privacy-Preserving Approach for Federated Learning
    Asare, Bernard Atiemo
    Branco, Paula
    Kiringa, Iluju
    Yeap, Tet
    [J]. COMPUTER SECURITY. ESORICS 2023 INTERNATIONAL WORKSHOPS, PT I, 2024, 14398 : 299 - 309
  • [45] Contribution Measurement in Privacy-Preserving Federated Learning
    Hsu, Ruei-hau
    Yu, Yi-an
    Su, Hsuan-cheng
    [J]. JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2024, 40 (06) : 1173 - 1196
  • [46] Privacy-preserving federated learning framework in multimedia courses recommendation
    Qin, YangJie
    Li, Ming
    Zhu, Jia
    [J]. WIRELESS NETWORKS, 2023, 29 (04) : 1535 - 1544
  • [47] A Privacy-preserving Data Alignment Framework for Vertical Federated Learning
    Gao, Ying
    Xie, Yuxin
    Deng, Huanghao
    Zhu, Zukun
    Zhang, Yiyu
    [J]. Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (08): : 3419 - 3427
  • [48] Privacy-Preserving and Verifiable Federated Learning Framework for Edge Computing
    Zhou, Hao
    Yang, Geng
    Huang, Yuxian
    Dai, Hua
    Xiang, Yang
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 565 - 580
  • [49] Robust privacy-preserving federated learning framework for IoT devices
    Han, Zhaoyang
    Zhou, Lu
    Ge, Chunpeng
    Li, Juan
    Liu, Zhe
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (11) : 9655 - 9673
  • [50] Privacy-preserving federated learning framework in multimedia courses recommendation
    YangJie Qin
    Ming Li
    Jia Zhu
    [J]. Wireless Networks, 2023, 29 : 1535 - 1544