Data-Driven Participant Selection and Bandwidth Allocation for Heterogeneous Federated Edge Learning

被引:15
作者
Albaseer, Abdullatif [1 ]
Abdallah, Mohamed [1 ]
Al-Fuqaha, Ala [1 ]
Erbad, Aiman [1 ]
机构
[1] Hamad Bin Khalifa Univ, Coll Sci & Engn, Div Informat & Comp Technol, Doha, Qatar
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2023年 / 53卷 / 09期
关键词
Data diversity; edge computing; federated edge learning (FEEL); imbalanced data distribution; participants' selection; resource allocation; CLIENT SELECTION; NETWORKS; CONVERGENCE;
D O I
10.1109/TSMC.2023.3276329
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated edge learning (FEEL) is a rapidly growing distributed learning technique for next-generation wireless edge systems. Smart systems across various application domains face challenges, such as data heterogeneity, limited wireless resources, and device heterogeneity, which necessitate intelligent participant selection schemes that accelerate convergence rates. Consequently, this article presents joint participant selection and bandwidth allocation schemes to address these challenges. First, we formulate an optimization problem that considers communication and computation latencies, as well as imbalanced data distribution, while meeting round deadlines and bandwidth constraints. To address the combinatorial problems of participant selection, we employ a relaxation method followed by a proposed priority selection algorithm to select near-optimal participants. The proposed algorithm initially prioritizes participants with larger datasets, effective channel states, and better CPU speeds. To address data heterogeneity, we propose a randomized deadline-controlling algorithm that diversifies updates by allowing the edge server to include different participants with fewer data samples in training rounds. The proposed algorithms offer near-optimal performance compared to the brute-force method. Experiments demonstrate that our proposed scheme accelerates the convergence rate by up to 55% under extensive non-IID settings compared to benchmarks. Furthermore, the deadline-controlling algorithm improves performance at high levels of data heterogeneity, resulting in faster FEEL systems.
引用
收藏
页码:5848 / 5860
页数:13
相关论文
共 50 条
[21]   Data-Driven Bandwidth Selection for Nonstationary Semiparametric Models [J].
Sun, Yiguo ;
Li, Qi .
JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2011, 29 (04) :541-551
[22]   Energy-efficient device selection and resource allocation for edge-driven hierarchical federated learning [J].
Liu, Yongwen ;
Liu, Dongqing ;
Khoukhi, Lyes ;
Wang, Bo ;
Zhang, Lei ;
Xu, Yaoli .
RESULTS IN ENGINEERING, 2025, 27
[23]   Joint Scheduling and Resource Allocation for Hierarchical Federated Edge Learning [J].
Wen, Wanli ;
Chen, Zihan ;
Yang, Howard H. ;
Xia, Wenchao ;
Quek, Tony Q. S. .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (08) :5857-5872
[24]   Joint Edge Server Selection and Data Set Management for Federated-Learning-Enabled Mobile Traffic Prediction [J].
Kim, Doyeon ;
Shin, Seungjae ;
Jeong, Jaewon ;
Lee, Joohyung .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (03) :4971-4986
[25]   Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective [J].
Xu, Jie ;
Wang, Heqiang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (02) :1188-1200
[26]   Joint Optimization of Device Selection and Resource Allocation for Multiple Federations in Federated Edge Learning [J].
Fu, Shucun ;
Dong, Fang ;
Shen, Dian ;
Zhang, Jinghui ;
Huang, Zhaowu ;
He, Qiang .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (01) :251-262
[27]   AFL-HCS: asynchronous federated learning based on heterogeneous edge client selection [J].
Tang, Bing ;
Xiao, Yuqiang ;
Zhang, Li ;
Cao, Buqing ;
Tang, Mingdong ;
Yang, Qing .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (05) :6247-6264
[28]   Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing [J].
Biyao Gong ;
Tianzhang Xing ;
Zhidan Liu ;
Junfeng Wang ;
Xiuya Liu .
Mobile Networks and Applications, 2022, 27 :1520-1530
[29]   Federated Learning for Heterogeneous Mobile Edge Device: A Client Selection Game [J].
Liu, Tongfei ;
Wang, Hui ;
Ma, Maode .
2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, :897-902
[30]   Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing [J].
Gong, Biyao ;
Xing, Tianzhang ;
Liu, Zhidan ;
Wang, Junfeng ;
Liu, Xiuya .
MOBILE NETWORKS & APPLICATIONS, 2022, 27 (04) :1520-1530