FLCP: federated learning framework with communication-efficient and privacy-preserving

被引:0
|
作者
Yang, Wei [1 ]
Yang, Yuan [1 ]
Xi, Yingjie [2 ]
Zhang, Hailong [2 ]
Xiang, Wei [3 ,4 ]
机构
[1] Xian Univ Technol, Sch Automat & Informat Engn, Xian 710048, Peoples R China
[2] Xian Univ Technol, Sch Int Engn, Xian 710048, Peoples R China
[3] La Trobe Univ, Sch Comp Engn & Math Sci, Melbourne 3086, Australia
[4] James Cook Univ, Coll Sci & Engn, Cairns, Qld 4870, Australia
基金
中国国家自然科学基金;
关键词
Artificial intelligence; Federated learning; Privacy protection; Communication efficiency; DIFFERENTIAL PRIVACY; ENCRYPTION;
D O I
10.1007/s10489-024-05521-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Within the federated learning (FL) framework, the client collaboratively trains the model in coordination with a central server, while the training data can be kept locally on the client. Thus, the FL framework mitigates the privacy disclosure and costs related to conventional centralized machine learning. Nevertheless, current surveys indicate that FL still has problems in terms of communication efficiency and privacy risks. In this paper, to solve these problems, we develop an FL framework with communication-efficient and privacy-preserving (FLCP). To realize the FLCP, we design a novel compression algorithm with efficient communication, namely, adaptive weight compression FedAvg (AWC-FedAvg). On the basis of the non-independent and identically distributed (non-IID) and unbalanced data distribution in FL, a specific compression rate is provided for each client, and homomorphic encryption (HE) and differential privacy (DP) are integrated to provide demonstrable privacy protection and maintain the desirability of the model. Therefore, our proposed FLCP smoothly balances communication efficiency and privacy risks, and we prove its security against "honest-but-curious" servers and extreme collusion under the defined threat model. We evaluate the scheme by comparing it with state-of-the-art results on the MNIST and CIFAR-10 datasets. The results show that the FLCP performs better in terms of training efficiency and model accuracy than the baseline method.
引用
收藏
页码:6816 / 6835
页数:20
相关论文
共 50 条
  • [21] Efficient-FedRec: Efficient Federated Learning Framework for Privacy-Preserving News Recommendation
    Yi, Jingwei
    Wu, Fangzhao
    Wu, Chuhan
    Liu, Ruixuan
    Sun, Guangzhong
    Xie, Xing
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 2814 - 2824
  • [22] PPFed: A Privacy-Preserving and Personalized Federated Learning Framework
    Zhang, Guangsheng
    Liu, Bo
    Zhu, Tianqing
    Ding, Ming
    Zhou, Wanlei
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 19380 - 19393
  • [23] A efficient and robust privacy-preserving framework for cross-device federated learning
    Du, Weidong
    Li, Min
    Wu, Liqiang
    Han, Yiliang
    Zhou, Tanping
    Yang, Xiaoyuan
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (05) : 4923 - 4937
  • [24] Fedlabx: a practical and privacy-preserving framework for federated learning
    Yan, Yuping
    Kamel, Mohammed B. M.
    Zoltay, Marcell
    Gal, Marcell
    Hollos, Roland
    Jin, Yaochu
    Peter, Ligeti
    Tenyi, Akos
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (01) : 677 - 690
  • [25] A efficient and robust privacy-preserving framework for cross-device federated learning
    Weidong Du
    Min Li
    Liqiang Wu
    Yiliang Han
    Tanping Zhou
    Xiaoyuan Yang
    Complex & Intelligent Systems, 2023, 9 : 4923 - 4937
  • [26] FLZip: An Efficient and Privacy-Preserving Framework for Cross-Silo Federated Learning
    Feng, Xiaojie
    Du, Haizhou
    IEEE CONGRESS ON CYBERMATICS / 2021 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS (ITHINGS) / IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) / IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) / IEEE SMART DATA (SMARTDATA), 2021, : 209 - 216
  • [27] A Verifiable and Privacy-Preserving Federated Learning Training Framework
    Duan, Haohua
    Peng, Zedong
    Xiang, Liyao
    Hu, Yuncong
    Li, Bo
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2024, 21 (05) : 5046 - 5058
  • [28] A privacy-preserving federated learning framework for blockchain networks
    Abuzied, Youssif
    Ghanem, Mohamed
    Dawoud, Fadi
    Gamal, Habiba
    Soliman, Eslam
    Sharara, Hossam
    Elbatt, Tamer
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (04): : 3997 - 4014
  • [29] Towards Efficient and Privacy-preserving Federated Deep Learning
    Hao, Meng
    Li, Hongwei
    Xu, Guowen
    Liu, Sen
    Yang, Haomiao
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [30] Efficient Privacy-Preserving Federated Learning With Unreliable Users
    Li, Yiran
    Li, Hongwei
    Xu, Guowen
    Huang, Xiaoming
    Lu, Rongxing
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (13) : 11590 - 11603