A Robust Client Selection Mechanism for Federated Learning Environments

被引:0
作者
Veiga, Rafael [1 ]
Sousa, John [1 ]
Morais, Renan [1 ]
Bastos, Lucas [1 ]
Lobato, Wellington [1 ]
Rosário, Denis [1 ]
Cerqueira, Eduardo [1 ]
机构
[1] Institute of Technology, Federal University of Pará, Av. Perimetral, s/n, Guamá, PA, Belém
来源
Journal of the Brazilian Computer Society | / 30卷 / 01期
基金
巴西圣保罗研究基金会;
关键词
Client Selection; Entropy; Federated Learning;
D O I
10.5753/jbcs.2024.4325
中图分类号
学科分类号
摘要
There is a exponential growth of data usage, specially due to the proliferation of connected applications with personalized models for different applications. In this context, Federated Learning (FL) emerges as a promising solution to enable collaborative model training while preserving the privacy and autonomy of participating clients. In a typical FL scenario, clients exhibit significant heterogeneity in terms of data distribution and hardware configurations. In this way, randomly sampling clients in each training round may not fully exploit the local updates from heterogeneous clients, resulting in lower model accuracy, slower convergence rate, degraded fairness, etc. In addition, malicious users could disseminate incorrect weights, which may decrease the accuracy of aggregated models and increase the time for convergence in FL. In this article, we introduce Resilience-aware Client Selection Mechanism for non-IID data and malicious clients in FL environment, called RICA. The proposed mechanism employs data size and entropy as criteria for client selection. In addition, RICA relies Centroid-Based Kernel Alignment (CKA) to identify and exclude potentially malicious clients. Our evaluation shows an improvement of 125% in Accuracy values in a scenario of malicious clients, which means the RICA+CKA demonstrates a more stable and resilient approach, reaching 90% accuracy in a few rounds compared to the default average approach, reached only around 30%. Therefore, results of the behavior of RICA+CKA in different datasets show the evaluation of different numbers of clients reaching around 90% while the other approach does not pass the 50% Accuracy. © 2024, Brazilian Computing Society. All rights reserved.
引用
收藏
页码:444 / 455
页数:11
相关论文
共 50 条
  • [1] Client Selection Mechanism for Federated Learning Based on Class Imbalance
    Zhang, Linlin
    Lin, Congjie
    Bie, Zhangshuai
    Li, Shuo
    Bi, Xuehua
    Zhao, Kai
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT 1, 2025, 15031 : 266 - 278
  • [2] Incentive Mechanism for Federated Learning With Random Client Selection
    Wu, Hongyi
    Tang, Xiaoying
    Zhang, Ying-Jun Angela
    Gao, Lin
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (02): : 1922 - 1933
  • [3] Client Selection in Hierarchical Federated Learning
    Trindade, Silvana
    da Fonseca, Nelson L. S.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 28480 - 28495
  • [4] A review on client selection models in federated learning
    Panigrahi, Monalisa
    Bharti, Sourabh
    Sharma, Arun
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2023, 13 (06)
  • [5] Towards Client Selection in Satellite Federated Learning
    Wu, Changhao
    He, Siyang
    Yin, Zengshan
    Guo, Chongbin
    APPLIED SCIENCES-BASEL, 2024, 14 (03):
  • [6] Active Client Selection for Clustered Federated Learning
    Huang, Honglan
    Shi, Wei
    Feng, Yanghe
    Niu, Chaoyue
    Cheng, Guangquan
    Huang, Jincai
    Liu, Zhong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16424 - 16438
  • [7] A Novel Reputation-aware Client Selection Scheme for Federated Learning within Mobile Environments
    Wang, Yuwei
    Kantarci, Burak
    2020 IEEE 25TH INTERNATIONAL WORKSHOP ON COMPUTER AIDED MODELING AND DESIGN OF COMMUNICATION LINKS AND NETWORKS (CAMAD), 2020,
  • [8] Client Selection for Federated Bayesian Learning
    Yang, Jiarong
    Liu, Yuan
    Kassab, Rahif
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 915 - 928
  • [9] Maverick Matters: Client Contribution and Selection in Federated Learning
    Huang, Jiyue
    Hong, Chi
    Liu, Yang
    Chen, Lydia Y.
    Roos, Stefanie
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT II, 2023, 13936 : 269 - 282
  • [10] A comprehensive survey on client selection strategies in federated learning
    Li, Jian
    Chen, Tongbao
    Teng, Shaohua
    COMPUTER NETWORKS, 2024, 251