Data-Driven Participant Selection and Bandwidth Allocation for Heterogeneous Federated Edge Learning

被引:10
|
作者
Albaseer, Abdullatif [1 ]
Abdallah, Mohamed [1 ]
Al-Fuqaha, Ala [1 ]
Erbad, Aiman [1 ]
机构
[1] Hamad Bin Khalifa Univ, Coll Sci & Engn, Div Informat & Comp Technol, Doha, Qatar
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2023年 / 53卷 / 09期
关键词
Data diversity; edge computing; federated edge learning (FEEL); imbalanced data distribution; participants' selection; resource allocation; CLIENT SELECTION; NETWORKS; CONVERGENCE;
D O I
10.1109/TSMC.2023.3276329
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated edge learning (FEEL) is a rapidly growing distributed learning technique for next-generation wireless edge systems. Smart systems across various application domains face challenges, such as data heterogeneity, limited wireless resources, and device heterogeneity, which necessitate intelligent participant selection schemes that accelerate convergence rates. Consequently, this article presents joint participant selection and bandwidth allocation schemes to address these challenges. First, we formulate an optimization problem that considers communication and computation latencies, as well as imbalanced data distribution, while meeting round deadlines and bandwidth constraints. To address the combinatorial problems of participant selection, we employ a relaxation method followed by a proposed priority selection algorithm to select near-optimal participants. The proposed algorithm initially prioritizes participants with larger datasets, effective channel states, and better CPU speeds. To address data heterogeneity, we propose a randomized deadline-controlling algorithm that diversifies updates by allowing the edge server to include different participants with fewer data samples in training rounds. The proposed algorithms offer near-optimal performance compared to the brute-force method. Experiments demonstrate that our proposed scheme accelerates the convergence rate by up to 55% under extensive non-IID settings compared to benchmarks. Furthermore, the deadline-controlling algorithm improves performance at high levels of data heterogeneity, resulting in faster FEEL systems.
引用
收藏
页码:5848 / 5860
页数:13
相关论文
共 50 条
  • [1] Adaptive Participant Selection in Heterogeneous Federated Learning
    Albelaihi, Rana
    Sun, Xiang
    Craft, Warren D.
    Yu, Liangkun
    Wang, Chonggang
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [2] Client Selection with Bandwidth Allocation in Federated Learning
    Kuang, Junqian
    Yang, Miao
    Zhu, Hongbin
    Qian, Hua
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [3] Joint Client Selection and Bandwidth Allocation of Wireless Federated Learning by Deep Reinforcement Learning
    Mao, Wei
    Lu, Xingjian
    Jiang, Yuhui
    Zheng, Haikun
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (01) : 336 - 348
  • [4] Joint Client Selection and Bandwidth Allocation Algorithm for Federated Learning
    Ko, Haneul
    Lee, Jaewook
    Seo, Sangwon
    Pack, Sangheon
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (06) : 3380 - 3390
  • [5] Participant Selection for Hierarchical Federated Learning in Edge Clouds
    Wei, Xinliang
    Liu, Jiyao
    Shi, Xinghua
    Wang, Yu
    2022 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE AND STORAGE (NAS), 2022, : 65 - 72
  • [6] Probabilistic Node Selection for Federated Learning with Heterogeneous Data in Mobile Edge
    Wu, Hongda
    Wang, Ping
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 2453 - 2458
  • [7] Joint Participant and Learning Topology Selection for Federated Learning in Edge Clouds
    Wei, Xinliang
    Ye, Kejiang
    Shi, Xinghua
    Xu, Cheng-Zhong
    Wang, Yu
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (08) : 1456 - 1468
  • [8] Joint client selection and resource allocation for federated edge learning with imperfect CSI
    Zhou, Sheng
    Wang, Liangmin
    Wu, Weihua
    Feng, Li
    COMPUTER NETWORKS, 2025, 257
  • [9] Client Selection and Bandwidth Allocation for Federated Learning: An Online Optimization Perspective
    Ji, Yun
    Kou, Zhoubin
    Zhong, Xiaoxiong
    Li, Hangfan
    Yang, Fan
    Zhang, Sheng
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 5075 - 5080
  • [10] Enhancing Federated Learning Convergence With Dynamic Data Queue and Data-Entropy-Driven Participant Selection
    Herath, Charuka
    Liu, Xiaolan
    Lambotharan, Sangarapillai
    Rahulamathavan, Yogachandran
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (06): : 6646 - 6658