A Robust Client Selection Mechanism for Federated Learning Environments

被引:0
作者
Veiga, Rafael [1 ]
Sousa, John [1 ]
Morais, Renan [1 ]
Bastos, Lucas [1 ]
Lobato, Wellington [1 ]
Rosário, Denis [1 ]
Cerqueira, Eduardo [1 ]
机构
[1] Institute of Technology, Federal University of Pará, Av. Perimetral, s/n, Guamá, PA, Belém
来源
Journal of the Brazilian Computer Society | / 30卷 / 01期
基金
巴西圣保罗研究基金会;
关键词
Client Selection; Entropy; Federated Learning;
D O I
10.5753/jbcs.2024.4325
中图分类号
学科分类号
摘要
There is a exponential growth of data usage, specially due to the proliferation of connected applications with personalized models for different applications. In this context, Federated Learning (FL) emerges as a promising solution to enable collaborative model training while preserving the privacy and autonomy of participating clients. In a typical FL scenario, clients exhibit significant heterogeneity in terms of data distribution and hardware configurations. In this way, randomly sampling clients in each training round may not fully exploit the local updates from heterogeneous clients, resulting in lower model accuracy, slower convergence rate, degraded fairness, etc. In addition, malicious users could disseminate incorrect weights, which may decrease the accuracy of aggregated models and increase the time for convergence in FL. In this article, we introduce Resilience-aware Client Selection Mechanism for non-IID data and malicious clients in FL environment, called RICA. The proposed mechanism employs data size and entropy as criteria for client selection. In addition, RICA relies Centroid-Based Kernel Alignment (CKA) to identify and exclude potentially malicious clients. Our evaluation shows an improvement of 125% in Accuracy values in a scenario of malicious clients, which means the RICA+CKA demonstrates a more stable and resilient approach, reaching 90% accuracy in a few rounds compared to the default average approach, reached only around 30%. Therefore, results of the behavior of RICA+CKA in different datasets show the evaluation of different numbers of clients reaching around 90% while the other approach does not pass the 50% Accuracy. © 2024, Brazilian Computing Society. All rights reserved.
引用
收藏
页码:444 / 455
页数:11
相关论文
共 50 条
  • [41] Value of Information: A Comprehensive Metric for Client Selection in Federated Edge Learning
    Zou, Yifei
    Shen, Shikun
    Xiao, Mengbai
    Li, Peng
    Yu, Dongxiao
    Cheng, Xiuzhen
    IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (04) : 1152 - 1164
  • [42] FedSAR for Heterogeneous Federated learning:A Client Selection Algorithm Based on SARSA
    Chen, Dufeng
    Jing, Rui
    Wu, Jiaqi
    Wang, Zehua
    Tian, Zijian
    Zhang, Fan
    Chen, Wei
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT I, ICIC 2024, 2024, 14862 : 219 - 229
  • [43] Joint Client Selection and Privacy Compensation for Differentially Private Federated Learning
    Xu, Ruichen
    Zhang, Ying-Jun Angela
    Huang, Jianwei
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS, INFOCOM WKSHPS 2024, 2024,
  • [44] Residence Time Aware Client Selection in Federated Learning in Vehicular Network
    Sezgin, Selman
    Mokrani, Kahina
    Allio, Sylvain
    Yellas, Nour El Houda
    PROCEEDINGS OF 2024 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, NOMS 2024, 2024,
  • [45] Client Selection With Staleness Compensation in Asynchronous Federated Learning
    Zhu, Hongbin
    Kuang, Junqian
    Yang, Miao
    Qian, Hua
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (03) : 4124 - 4129
  • [46] Contribution-based Federated Learning client selection
    Lin, Weiwei
    Xu, Yinhai
    Liu, Bo
    Li, Dongdong
    Huang, Tiansheng
    Shi, Fang
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (10) : 7235 - 7260
  • [47] Stochastic Client Selection for Federated Learning With Volatile Clients
    Huang, Tiansheng
    Lin, Weiwei
    Shen, Li
    Li, Keqin
    Zomaya, Albert Y.
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (20) : 20055 - 20070
  • [48] Compressed Client Selection for Efficient Communication in Federated Learning
    Mohamed, Aissa Hadj
    Assumpcao, Nicolas R. G.
    Astudillo, Carlos A.
    de Souza, Allan M.
    Bittencourt, Luiz F.
    Villas, Leandro A.
    2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2023,
  • [49] An Incentive Auction for Heterogeneous Client Selection in Federated Learning
    Pang, Jinlong
    Yu, Jieling
    Zhou, Ruiting
    Lui, John C. S.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (10) : 5733 - 5750
  • [50] VFedCS: Optimizing Client Selection for Volatile Federated Learning
    Shi, Fang
    Hu, Chunchao
    Lin, Weiwei
    Fan, Lisheng
    Huang, Tiansheng
    Wu, Wentai
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) : 24995 - 25010