A Robust Client Selection Mechanism for Federated Learning Environments

被引:0
作者
Veiga, Rafael [1 ]
Sousa, John [1 ]
Morais, Renan [1 ]
Bastos, Lucas [1 ]
Lobato, Wellington [1 ]
Rosário, Denis [1 ]
Cerqueira, Eduardo [1 ]
机构
[1] Institute of Technology, Federal University of Pará, Av. Perimetral, s/n, Guamá, PA, Belém
来源
Journal of the Brazilian Computer Society | / 30卷 / 01期
基金
巴西圣保罗研究基金会;
关键词
Client Selection; Entropy; Federated Learning;
D O I
10.5753/jbcs.2024.4325
中图分类号
学科分类号
摘要
There is a exponential growth of data usage, specially due to the proliferation of connected applications with personalized models for different applications. In this context, Federated Learning (FL) emerges as a promising solution to enable collaborative model training while preserving the privacy and autonomy of participating clients. In a typical FL scenario, clients exhibit significant heterogeneity in terms of data distribution and hardware configurations. In this way, randomly sampling clients in each training round may not fully exploit the local updates from heterogeneous clients, resulting in lower model accuracy, slower convergence rate, degraded fairness, etc. In addition, malicious users could disseminate incorrect weights, which may decrease the accuracy of aggregated models and increase the time for convergence in FL. In this article, we introduce Resilience-aware Client Selection Mechanism for non-IID data and malicious clients in FL environment, called RICA. The proposed mechanism employs data size and entropy as criteria for client selection. In addition, RICA relies Centroid-Based Kernel Alignment (CKA) to identify and exclude potentially malicious clients. Our evaluation shows an improvement of 125% in Accuracy values in a scenario of malicious clients, which means the RICA+CKA demonstrates a more stable and resilient approach, reaching 90% accuracy in a few rounds compared to the default average approach, reached only around 30%. Therefore, results of the behavior of RICA+CKA in different datasets show the evaluation of different numbers of clients reaching around 90% while the other approach does not pass the 50% Accuracy. © 2024, Brazilian Computing Society. All rights reserved.
引用
收藏
页码:444 / 455
页数:11
相关论文
共 50 条
  • [21] Client Selection for Federated Learning With Label Noise
    Yang, Miao
    Qian, Hua
    Wang, Ximin
    Zhou, Yong
    Zhu, Honghin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 2193 - 2197
  • [22] FedECS: Client Selection for Optimizing Computing Energy in Federated Learning
    Han, Shuo
    Zhang, Chenyu
    Wang, Luhan
    Zheng, Wei
    Wen, Xiangming
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [23] Adaptive client selection and model aggregation for heterogeneous federated learning
    Zhai, Rui
    Jin, Haozhe
    Gong, Wei
    Lu, Ke
    Liu, Yanhong
    Song, Yalin
    Yu, Junyang
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [24] Federated learning client selection algorithm based on gradient similarity
    Hu, Lingxi
    Hu, Yuanyuan
    Jiang, Linhua
    Long, Wei
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2025, 28 (02):
  • [25] Adaptive client selection with personalization for communication efficient Federated Learning
    de Souza, Allan M.
    Maciel, Filipe
    da Costa, Joahannes B. D.
    Bittencourt, Luiz F.
    Cerqueira, Eduardo
    Loureiro, Antonio A. F.
    Villas, Leandro A.
    AD HOC NETWORKS, 2024, 157
  • [26] Federated Learning with Personalized Differential Privacy Combining Client Selection
    Xie, Yunting
    Zhang, Lan
    2022 8TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS, BIGCOM, 2022, : 79 - 87
  • [27] Towards Instant Clustering Approach for Federated Learning Client Selection
    Arisdakessian, Sarhad
    Wahab, Omar Abdel
    Mourad, Azzam
    Otrok, Hadi
    2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 409 - 413
  • [28] Review on Research Trends of Optimization for Client Selection in Federated Learning
    Kim, Jaemin
    Song, Chihyun
    Paek, Jeongyeup
    Kwon, Jung-Hyok
    Cho, Sungrae
    38TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN 2024, 2024, : 287 - 289
  • [29] Client Selection for Wireless Federated Learning With Data and Latency Heterogeneity
    Chen, Xiaobing
    Zhou, Xiangwei
    Zhang, Hongchao
    Sun, Mingxuan
    Vincent Poor, H.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (19): : 32183 - 32196
  • [30] FedBoost: Bayesian Estimation Based Client Selection for Federated Learning
    Sheng, Yuhang
    Zeng, Lingguo
    Cao, Shuqin
    Dai, Qing
    Yang, Shasha
    Lu, Jianfeng
    IEEE ACCESS, 2024, 12 : 52255 - 52266