CosPer: An adaptive personalized approach for enhancing fairness and robustness of federated learning

被引:1
作者
Ren, Pengcheng [1 ]
Qi, Kaiyue [1 ]
Li, Jialin [1 ]
Yan, Tongjiang [1 ]
Dai, Qiang [1 ]
机构
[1] China Univ Petr East China, Coll Sci, Qingdao 266580, Shandong, Peoples R China
关键词
Personalized federated learning; Data heterogeneity; Fairness; Robustness;
D O I
10.1016/j.ins.2024.120760
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) enables clients to collaboratively train a global model while safeguarding the privacy of their respective data. In practical applications, the data heterogeneity across clients introduces competing constraints on the accuracy, fairness and robustness of FL models. However, existing methods that attempt to address all three of these issues perform poorly in scenarios with severe data heterogeneity. To address this limitation, this paper proposes an innovative personalized federated learning (PFL) framework named CosPer. This framework employs an adaptive local aggregation mechanism, where the aggregation weight is determined by the cosine similarity between the global gradient and the local gradient of each client. This mechanism can construct a personalized model for each client, suited to different degrees of the data heterogeneity. In addition, we conduct extensive experiments to evaluate the performance of CosPer on four datasets. The results demonstrate that CosPer outperforms other state-of-the-art PFL methods in terms of accuracy, fairness and robustness.
引用
收藏
页数:12
相关论文
共 42 条
[1]  
Bhagoji AN, 2019, PR MACH LEARN RES, V97
[2]  
Blanchard P, 2017, ADV NEUR IN, V30
[3]  
Caton S., 2023, Fairness in Machine Learning: A Survey
[4]   Adaptive Nonstationary Fuzzy Neural Network [J].
Chang, Qin ;
Zhang, Zhen ;
Wei, Fanyue ;
Wang, Jian ;
Pedrycz, Witold ;
Pal, Nikhil R. .
KNOWLEDGE-BASED SYSTEMS, 2024, 288
[5]  
Collins L, 2021, PR MACH LEARN RES, V139
[6]  
Deng YY, 2020, Arxiv, DOI [arXiv:2003.13461, DOI 10.48550/ARXIV.2003.13461]
[7]  
Ezzeldin YH, 2023, AAAI CONF ARTIF INTE, P7494
[8]  
Fallah A, 2020, ADV NEUR IN, V33
[9]   Fairness and accuracy in horizontal federated learning [J].
Huang, Wei ;
Li, Tianrui ;
Wang, Dexian ;
Du, Shengdong ;
Zhang, Junbo ;
Huang, Tianqiang .
INFORMATION SCIENCES, 2022, 589 (170-185) :170-185
[10]  
Huang YT, 2021, AAAI CONF ARTIF INTE, V35, P7865