Privacy-Enhanced Federated Learning for Non-IID Data

被引:2
作者
Tan, Qingjie [1 ]
Wu, Shuhui [1 ]
Tao, Yuanhong [1 ]
机构
[1] Zhejiang Univ Sci & Technol, Sch Sci, Hangzhou 310023, Peoples R China
关键词
federated learning; Hellinger distance; differential privacy; non-IID data; 68CS; 94ICC;
D O I
10.3390/math11194123
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Federated learning (FL) allows the collaborative training of a collective model by a vast number of decentralized clients while ensuring that these clients' data remain private and are not shared. In practical situations, the training data utilized in FL often exhibit non-IID characteristics, hence diminishing the efficacy of FL. Our study presents a novel privacy-preserving FL algorithm, HW-DPFL, which leverages data label distribution similarity as a basis for its design. Our proposed approach achieves this objective without incurring any additional overhead communication. In this study, we provide evidence to support the assertion that our approach improves the privacy guarantee and convergence of FL both theoretically and empirically.
引用
收藏
页数:21
相关论文
共 50 条
[31]   Training Keyword Spotting Models on Non-IID Data with Federated Learning [J].
Hard, Andrew ;
Partridge, Kurt ;
Nguyen, Cameron ;
Subrahmanya, Niranjan ;
Shah, Aishanee ;
Zhu, Pai ;
Moreno, Ignacio Lopez ;
Mathews, Rajiv .
INTERSPEECH 2020, 2020, :4343-4347
[32]   Exploring personalization via federated representation Learning on non-IID data [J].
Jing, Changxing ;
Huang, Yan ;
Zhuang, Yihong ;
Sun, Liyan ;
Xiao, Zhenlong ;
Huang, Yue ;
Ding, Xinghao .
NEURAL NETWORKS, 2023, 163 :354-366
[33]   Differentially Private Auction Design for Federated Learning With non-IID Data [J].
Ren, Kean ;
Liao, Guocheng ;
Ma, Qian ;
Chen, Xu .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (05) :2236-2247
[34]   SHFL: Selective Hierarchical Federated Learning for Non-IID Data Distribution [J].
Tseng, Fan-Hsun ;
Lai, Yu-Teng .
2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
[35]   Overcoming Noisy Labels and Non-IID Data in Edge Federated Learning [J].
Xu, Yang ;
Liao, Yunming ;
Wang, Lun ;
Xu, Hongli ;
Jiang, Zhida ;
Zhang, Wuyang .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) :11406-11421
[36]   Federated Learning Based on Diffusion Model to Cope with Non-IID Data [J].
Zhao, Zhuang ;
Yang, Feng ;
Liang, Guirong .
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX, 2024, 14433 :220-231
[37]   FedRDS: Federated Learning on Non-IID Data via Regularization and Data Sharing [J].
Lv, Yankai ;
Ding, Haiyan ;
Wu, Hao ;
Zhao, Yiji ;
Zhang, Lei .
APPLIED SCIENCES-BASEL, 2023, 13 (23)
[38]   Inverse Distance Aggregation for Federated Learning with Non-IID Data [J].
Yeganeh, Yousef ;
Farshad, Azade ;
Navab, Nassir ;
Albarqouni, Shadi .
DOMAIN ADAPTATION AND REPRESENTATION TRANSFER, AND DISTRIBUTED AND COLLABORATIVE LEARNING, DART 2020, DCL 2020, 2020, 12444 :150-159
[39]   FEDERATED PAC-BAYESIAN LEARNING ON NON-IID DATA [J].
Zhao, Zihao ;
Liu, Yang ;
Ding, Wenbo ;
Zhang, Xiao-Ping .
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, :5945-5949
[40]   A General Federated Learning Scheme with Blockchain on Non-IID Data [J].
Wu, Hao ;
Zhao, Shengnan ;
Zhao, Chuan ;
Jing, Shan .
INFORMATION SECURITY AND CRYPTOLOGY, INSCRYPT 2023, PT I, 2024, 14526 :126-140