Privacy-Enhanced Federated Learning for Non-IID Data

被引:0
作者
Tan, Qingjie [1 ]
Wu, Shuhui [1 ]
Tao, Yuanhong [1 ]
机构
[1] Zhejiang Univ Sci & Technol, Sch Sci, Hangzhou 310023, Peoples R China
关键词
federated learning; Hellinger distance; differential privacy; non-IID data; 68CS; 94ICC;
D O I
10.3390/math11194123
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Federated learning (FL) allows the collaborative training of a collective model by a vast number of decentralized clients while ensuring that these clients' data remain private and are not shared. In practical situations, the training data utilized in FL often exhibit non-IID characteristics, hence diminishing the efficacy of FL. Our study presents a novel privacy-preserving FL algorithm, HW-DPFL, which leverages data label distribution similarity as a basis for its design. Our proposed approach achieves this objective without incurring any additional overhead communication. In this study, we provide evidence to support the assertion that our approach improves the privacy guarantee and convergence of FL both theoretically and empirically.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] A Novel Approach for Federated Learning with Non-IID Data
    Nguyen, Hiep
    Warrier, Harikrishna
    Gupta, Yogesh
    2022 9TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE, ISCMI, 2022, : 62 - 67
  • [22] Decoupled Federated Learning for ASR with Non-IID Data
    Zhu, Han
    Wang, Jindong
    Cheng, Gaofeng
    Zhang, Pengyuan
    Yan, Yonghong
    INTERSPEECH 2022, 2022, : 2628 - 2632
  • [23] GFL: Federated Learning on Non-IID data via Privacy-preserving Synthetic data
    Cheng, Yihang
    Zhang, Lan
    Li, Anran
    2023 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS, PERCOM, 2023, : 61 - 70
  • [24] FedEL: Federated ensemble learning for non-iid data
    Wu, Xing
    Pei, Jie
    Han, Xian-Hua
    Chen, Yen-Wei
    Yao, Junfeng
    Liu, Yang
    Qian, Quan
    Guo, Yike
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237
  • [25] Contractible Regularization for Federated Learning on Non-IID Data
    Chen, Zifan
    Wu, Zhe
    Wu, Xian
    Zhang, Li
    Zhao, Jie
    Yan, Yangtian
    Zheng, Yefeng
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, : 61 - 70
  • [26] Privacy-preserving Blockchain-based Global Data Sharing for Federated Learning with Non-IID Data
    Lian, Zhuotao
    Zeng, Qingkui
    Su, Chunhua
    2022 IEEE 42ND INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW), 2022, : 193 - 198
  • [27] On the impact of non-IID data on the performance and fairness of differentially private federated learning
    Amiri, Saba
    Belloum, Adam
    Nalisnick, Eric
    Klous, Sander
    Gommans, Leon
    52ND ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS WORKSHOP VOLUME (DSN-W 2022), 2022, : 52 - 58
  • [28] FedNSE: Optimal Node Selection for Federated Learning with Non-IID Data
    Bansal, Sourav
    Bansal, Manav
    Verma, Rohit
    Shorey, Rajeev
    Saran, Huzur
    2023 15TH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS, COMSNETS, 2023,
  • [29] Training Keyword Spotting Models on Non-IID Data with Federated Learning
    Hard, Andrew
    Partridge, Kurt
    Nguyen, Cameron
    Subrahmanya, Niranjan
    Shah, Aishanee
    Zhu, Pai
    Moreno, Ignacio Lopez
    Mathews, Rajiv
    INTERSPEECH 2020, 2020, : 4343 - 4347
  • [30] Exploring personalization via federated representation Learning on non-IID data
    Jing, Changxing
    Huang, Yan
    Zhuang, Yihong
    Sun, Liyan
    Xiao, Zhenlong
    Huang, Yue
    Ding, Xinghao
    NEURAL NETWORKS, 2023, 163 : 354 - 366