Privacy-Enhanced Federated Learning for Non-IID Data

被引:2
作者
Tan, Qingjie [1 ]
Wu, Shuhui [1 ]
Tao, Yuanhong [1 ]
机构
[1] Zhejiang Univ Sci & Technol, Sch Sci, Hangzhou 310023, Peoples R China
关键词
federated learning; Hellinger distance; differential privacy; non-IID data; 68CS; 94ICC;
D O I
10.3390/math11194123
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Federated learning (FL) allows the collaborative training of a collective model by a vast number of decentralized clients while ensuring that these clients' data remain private and are not shared. In practical situations, the training data utilized in FL often exhibit non-IID characteristics, hence diminishing the efficacy of FL. Our study presents a novel privacy-preserving FL algorithm, HW-DPFL, which leverages data label distribution similarity as a basis for its design. Our proposed approach achieves this objective without incurring any additional overhead communication. In this study, we provide evidence to support the assertion that our approach improves the privacy guarantee and convergence of FL both theoretically and empirically.
引用
收藏
页数:21
相关论文
共 50 条
[21]   Communication-privacy-accuracy trade-offs in federated learning for non-IID data with shuffle model [J].
Xiao, Di ;
Fan, Xinchun ;
Chen, Lvjun ;
Li, Min ;
Zhang, Maolan .
KNOWLEDGE-BASED SYSTEMS, 2025, 324
[22]   Digital Twin-Empowered Federated Incremental Learning for Non-IID Privacy Data [J].
Wang, Qian ;
Chen, Siguang ;
Wu, Meng ;
Li, Xue .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2025, 24 (05) :3860-3877
[23]   A Novel Approach for Federated Learning with Non-IID Data [J].
Nguyen, Hiep ;
Warrier, Harikrishna ;
Gupta, Yogesh .
2022 9TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE, ISCMI, 2022, :62-67
[24]   GFL: Federated Learning on Non-IID data via Privacy-preserving Synthetic data [J].
Cheng, Yihang ;
Zhang, Lan ;
Li, Anran .
2023 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS, PERCOM, 2023, :61-70
[25]   Decoupled Federated Learning for ASR with Non-IID Data [J].
Zhu, Han ;
Wang, Jindong ;
Cheng, Gaofeng ;
Zhang, Pengyuan ;
Yan, Yonghong .
INTERSPEECH 2022, 2022, :2628-2632
[26]   Privacy-preserving Blockchain-based Global Data Sharing for Federated Learning with Non-IID Data [J].
Lian, Zhuotao ;
Zeng, Qingkui ;
Su, Chunhua .
2022 IEEE 42ND INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW), 2022, :193-198
[27]   FedEL: Federated ensemble learning for non-iid data [J].
Wu, Xing ;
Pei, Jie ;
Han, Xian-Hua ;
Chen, Yen-Wei ;
Yao, Junfeng ;
Liu, Yang ;
Qian, Quan ;
Guo, Yike .
EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237
[28]   Contractible Regularization for Federated Learning on Non-IID Data [J].
Chen, Zifan ;
Wu, Zhe ;
Wu, Xian ;
Zhang, Li ;
Zhao, Jie ;
Yan, Yangtian ;
Zheng, Yefeng .
2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, :61-70
[29]   On the impact of non-IID data on the performance and fairness of differentially private federated learning [J].
Amiri, Saba ;
Belloum, Adam ;
Nalisnick, Eric ;
Klous, Sander ;
Gommans, Leon .
52ND ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS WORKSHOP VOLUME (DSN-W 2022), 2022, :52-58
[30]   FedNSE: Optimal Node Selection for Federated Learning with Non-IID Data [J].
Bansal, Sourav ;
Bansal, Manav ;
Verma, Rohit ;
Shorey, Rajeev ;
Saran, Huzur .
2023 15TH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS, COMSNETS, 2023,