FedCon: Scalable and Efficient Federated Learning via Contribution-Based Aggregation

被引:1
作者
Gao, Wenyu [1 ]
Xu, Gaochao [1 ]
Meng, Xianqiu [1 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
关键词
federated learning; importance weight; Shapley value; Monte Carlo sampling; client contribution evaluation;
D O I
10.3390/electronics14051024
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing application of federated learning to medical and image data, the challenges of class distribution imbalances and Non-IID heterogeneity across clients have become critical factors affecting the generalization ability of global models. In the medical domain, the phenomenon of data silos is particularly pronounced, leading to significant differences in data distributions across hospitals, which in turn hinder the performance of global model training. To address these challenges, this paper proposes FedCon, a federated learning method capable of dynamically adjusting aggregation weights, while accurately evaluating client contributions. Specifically, FedCon initializes aggregation weights based on client data volume and class distribution and employs Monte Carlo sampling to effectively simplify the computation of Shapley values. Subsequently, it further optimizes the aggregation weights by comprehensively considering the historical contributions of clients and the similarity between clients and the global model. This approach significantly enhances the ability to generalize and update the stability of the global model. Experimental results demonstrate that, compared to existing methods, FedCon achieved a superior generalization performance on public datasets and significantly accelerated the convergence of the global model.
引用
收藏
页数:30
相关论文
共 37 条
[1]  
Acar DAE, 2021, Arxiv, DOI arXiv:2111.04263
[2]  
Chatterjee P., 2023, preprint
[3]  
Chen HK, 2024, AAAI CONF ARTIF INTE, P11285
[4]   A Survey on the use of Federated Learning in Privacy-Preserving Recommender Systems [J].
Chronis, Christos ;
Varlamis, Iraklis ;
Himeur, Yassine ;
Sayed, Aya N. ;
AL-Hasan, Tamim M. ;
Nhlabatsi, Armstrong ;
Bensaali, Faycal ;
Dimitrakopoulos, George .
IEEE OPEN JOURNAL OF THE COMPUTER SOCIETY, 2024, 5 :227-247
[5]  
Dai YT, 2023, AAAI CONF ARTIF INTE, P7314
[6]  
Ezzeldin YH, 2023, AAAI CONF ARTIF INTE, P7494
[7]   FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction [J].
Gao, Liang ;
Fu, Huazhu ;
Li, Li ;
Chen, Yingwen ;
Xu, Ming ;
Xu, Cheng-Zhong .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :10102-10111
[8]   Federated learning for medical image analysis: A survey [J].
Guan, Hao ;
Yap, Pew-Thian ;
Bozoki, Andrea ;
Liu, Mingxia .
PATTERN RECOGNITION, 2024, 151
[9]   Advances and Open Problems in Federated Learning [J].
Kairouz, Peter ;
McMahan, H. Brendan ;
Avent, Brendan ;
Bellet, Aurelien ;
Bennis, Mehdi ;
Bhagoji, Arjun Nitin ;
Bonawitz, Kallista ;
Charles, Zachary ;
Cormode, Graham ;
Cummings, Rachel ;
D'Oliveira, Rafael G. L. ;
Eichner, Hubert ;
El Rouayheb, Salim ;
Evans, David ;
Gardner, Josh ;
Garrett, Zachary ;
Gascon, Adria ;
Ghazi, Badih ;
Gibbons, Phillip B. ;
Gruteser, Marco ;
Harchaoui, Zaid ;
He, Chaoyang ;
He, Lie ;
Huo, Zhouyuan ;
Hutchinson, Ben ;
Hsu, Justin ;
Jaggi, Martin ;
Javidi, Tara ;
Joshi, Gauri ;
Khodak, Mikhail ;
Konecny, Jakub ;
Korolova, Aleksandra ;
Koushanfar, Farinaz ;
Koyejo, Sanmi ;
Lepoint, Tancrede ;
Liu, Yang ;
Mittal, Prateek ;
Mohri, Mehryar ;
Nock, Richard ;
Ozgur, Ayfer ;
Pagh, Rasmus ;
Qi, Hang ;
Ramage, Daniel ;
Raskar, Ramesh ;
Raykova, Mariana ;
Song, Dawn ;
Song, Weikang ;
Stich, Sebastian U. ;
Sun, Ziteng ;
Suresh, Ananda Theertha .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2021, 14 (1-2) :1-210
[10]   Blockchain-Based Federated Learning With SMPC Model Verification Against Poisoning Attack for Healthcare Systems [J].
Kalapaaking, Aditya Pribadi ;
Khalil, Ibrahim ;
Yi, Xun .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2024, 12 (01) :269-280