Towards Fast and Energy-Efficient Hierarchical Federated Edge Learning: A Joint Design for Helper Scheduling and Resource Allocation

被引:2
|
作者
Went, Wanli [1 ,2 ]
Yang, Howard H. [3 ]
Xia, Wenchao [4 ]
Quek, Tony Q. S. [5 ]
机构
[1] Chongqing Univ, Sch Microelectron & Commun Engn, Chongqing, Peoples R China
[2] Southeast Univ, Nat Mobile Communicat Res Lab, Nanjing, Peoples R China
[3] Zhejiang Univ, Univ Illinois, Urbana Champaign Inst, Haining, Peoples R China
[4] Nanjing Univ Posts & Telecommunicat, Jiangsu Key Lab Wireless Communicat, Nanjing, Peoples R China
[5] Singapore Univ Technol & Design, Informat Syst Technol & Design Pillar, Singapore, Singapore
关键词
NETWORKS;
D O I
10.1109/ICC45855.2022.9838950
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Hierarchical federated edge learning (H-FEEL) has been recently proposed to enhance the federated learning model. Such a system generally consists of three entities, i.e., the server, helpers, and clients. Each helper collects the trained gradients from users nearby, aggregates them, and sends the result to the server for model update. Due to limited communication resources, only a portion of helpers can upload their aggregated gradients to the server, thereby necessitating a well design for helper scheduling and communication resources allocation. In this paper, we develop a training algorithm for H-FEEL which involves local gradient computing, weighted gradient uploading, and model updating phases. By characterizing these phases mathematically and analyzing the one-round convergence bound of the training algorithm, we formulate a problem to achieve the scheduling and resource allocation scheme. To solve the problem, we first transform it into an equivalent problem and then decompose the transformed problem into two subproblems: bit and sub-channel allocation problem and helper scheduling problem. For the first subproblem, we obtain a low-complexity suboptimal solution by using a four-stage method. For the second subproblem, we obtain a stationary point by using the penalty convex-concave procedure. The efficacy of our scheme is demonstrated via simulations, and the analytical framework is shown to provide valuable insights for the design of practical H-FEEL system.
引用
收藏
页码:5378 / 5383
页数:6
相关论文
共 50 条
  • [31] Decentralized Edge Intelligence: A Dynamic Resource Allocation Framework for Hierarchical Federated Learning
    Lim, Wei Yang Bryan
    Ng, Jer Shyuan
    Xiong, Zehui
    Jin, Jiangming
    Zhang, Yang
    Niyato, Dusit
    Leung, Cyril
    Miao, Chunyan
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (03) : 536 - 550
  • [32] Joint QoS and energy-efficient resource allocation and scheduling in 5G Network Slicing
    Saibharath, S.
    Mishra, Sudeepta
    Hota, Chittaranjan
    COMPUTER COMMUNICATIONS, 2023, 202 : 110 - 123
  • [33] Energy-Efficient Resource Management for Federated Edge Learning With CPU-GPU Heterogeneous Computing
    Zeng, Qunsong
    Du, Yuqing
    Huang, Kaibin
    Leung, Kin K.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (12) : 7947 - 7962
  • [34] Joint Adaptive Aggregation and Resource Allocation for Hierarchical Federated Learning Systems Based on Edge-Cloud Collaboration
    Su, Yi
    Fan, Wenhao
    Meng, Qingcheng
    Chen, Penghui
    Liu, Yuan'an
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2025, 13 (01) : 369 - 382
  • [35] Joint Client Scheduling and Wireless Resource Allocation for Heterogeneous Federated Edge Learning With Non-IID Data
    Yin, Tong
    Li, Lixin
    Lin, Wensheng
    Ni, Tao
    Liu, Ying
    Xu, Haitao
    Han, Zhu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5742 - 5754
  • [36] Joint User Scheduling and Resource Allocation for Federated Learning over Wireless Networks
    Yin, Benshun
    Chen, Zhiyong
    Tao, Meixia
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [37] Joint Resource Allocation and Scheduling for Wireless Power Transfer Aided Federated Learning
    Song, Yuxiao
    Ji, Guangyuan
    Dai, Minghui
    Wu, Yuan
    Qian, Liping
    Lin, Bin
    2022 31ST WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC), 2022, : 155 - 160
  • [38] Joint Client Scheduling and Resource Allocation Under Channel Uncertainty in Federated Learning
    Wadu, Madhusanka Manimel
    Samarakoon, Sumudu
    Bennis, Mehdi
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (09) : 5962 - 5974
  • [39] Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
    Shi, Wenqi
    Zhou, Sheng
    Niu, Zhisheng
    Jiang, Miao
    Geng, Lu
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 453 - 467
  • [40] Federated Learning under Channel Uncertainty: Joint Client Scheduling and Resource Allocation
    Wadu, Madhusanka Manimel
    Samarakoon, Sumudu
    Bennis, Mehdi
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,