Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning

被引:242
|
作者
Shi, Wenqi [1 ]
Zhou, Sheng [1 ]
Niu, Zhisheng [1 ]
Jiang, Miao [2 ]
Geng, Lu [2 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Hitachi China Res & Dev Cooperat, Beijing 100190, Peoples R China
关键词
Federated learning; wireless networks; resource allocation; scheduling; convergence analysis;
D O I
10.1109/TWC.2020.3025446
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning (FL), devices contribute to the global training by uploading their local model updates via wireless channels. Due to limited computation and communication resources, device scheduling is crucial to the convergence rate of FL. In this paper, we propose a joint device scheduling and resource allocation policy to maximize the model accuracy within a given total training time budget for latency constrained wireless FL. A lower bound on the reciprocal of the training performance loss, in terms of the number of training rounds and the number of scheduled devices per round, is derived. Based on the bound, the accuracy maximization problem is solved by decoupling it into two sub-problems. First, given the scheduled devices, the optimal bandwidth allocation suggests allocating more bandwidth to the devices with worse channel conditions or weaker computation capabilities. Then, a greedy device scheduling algorithm is introduced, which selects the device consuming the least updating time obtained by the optimal bandwidth allocation in each step, until the lower bound begins to increase, meaning that scheduling more devices will degrade the model accuracy. Experiments show that the proposed policy outperforms state-of-the-art scheduling policies under extensive settings of data distributions and cell radius.
引用
收藏
页码:453 / 467
页数:15
相关论文
共 50 条
  • [41] Joint Resource Allocation for Latency-Constrained Dynamic Computation Offloading with MEC
    Merluzzi, Mattia
    Di Lorenzo, Paolo
    Barbarossa, Sergio
    Frascolla, Valerio
    2019 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOP (WCNCW), 2019,
  • [42] Joint Device Selection and Power Control for Wireless Federated Learning
    Guo, Wei
    Li, Ran
    Huang, Chuan
    Qin, Xiaoqi
    Shen, Kaiming
    Zhang, Wei
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (08) : 2395 - 2410
  • [43] Resource allocation in wireless networks with federated learning: Network adaptability and learning acceleration
    Lee, Hyun-Suk
    Lee, Da-Eun
    ICT EXPRESS, 2022, 8 (01): : 31 - 36
  • [44] Federated Learning in Unreliable and Resource-Constrained Cellular Wireless Networks
    Salehi, Mohammad
    Hossain, Ekram
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (08) : 5136 - 5151
  • [45] AdaptiveMesh: Adaptive Federated Learning for Resource-Constrained Wireless Environments
    Shkurti, Lamir
    Selimi, Mennan
    INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING, 2024, 20 (14) : 22 - 37
  • [46] Joint Resource Allocation and Learning Optimization for UAV-Assisted Federated Learning
    Liu, Chaoyi
    Zhu, Qi
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [47] Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms
    Zeng, Tengchan
    Semiari, Omid
    Mozaffari, Mohammad
    Chen, Mingzhe
    Saad, Walid
    Bennis, Mehdi
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [48] Resource Allocation for Wireless Federated Edge Learning based on Data Importance
    He, Yinghui
    Ren, Jinke
    Yu, Guanding
    Yuan, Jiantao
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [49] Efficient Federated Learning Algorithm for Resource Allocation in Wireless IoT Networks
    Van-Dinh Nguyen
    Sharma, Shree Krishna
    Vu, Thang X.
    Chatzinotas, Symeon
    Ottersten, Bjorn
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05) : 3394 - 3409
  • [50] FEDRESOURCE: Federated Learning Based Resource Allocation in Modern Wireless Networks
    Satheesh, P. G.
    Sasikala, T.
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2023, 14 (09) : 1023 - 1030