Dynamic Scheduling for Over-the-Air Federated Edge Learning With Energy Constraints

被引:67
|
作者
Sun, Yuxuan [1 ]
Zhou, Sheng [1 ]
Niu, Zhisheng [1 ]
Gunduz, Deniz [2 ]
机构
[1] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Imperial Coll London, Dept Elect & Elect Engn, London SW7 2BT, England
基金
英国工程与自然科学研究理事会; 欧洲研究理事会;
关键词
Federated edge learning; over-the-air computation; energy constraints; dynamic scheduling; Lyapunov optimization; CONVERGENCE; OPTIMIZATION; CHALLENGES; ALLOCATION; NETWORKS; DESIGN;
D O I
10.1109/JSAC.2021.3126078
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Machine learning and wireless communication technologies are jointly facilitating an intelligent edge, where federated edge learning (FEEL) is emerging as a promising training framework. As wireless devices involved in FEEL are resource limited in terms of communication bandwidth, computing power and battery capacity, it is important to carefully schedule them to optimize the training performance. In this work, we consider an over-the-air FEEL system with analog gradient aggregation, and propose an energy-aware dynamic device scheduling algorithm to optimize the training performance within the energy constraints of devices, where both communication energy for gradient aggregation and computation energy for local training are considered. The consideration of computation energy makes dynamic scheduling challenging, as devices are scheduled before local training, but the communication energy for over-the-air aggregation depends on the l(2)-norm of local gradient, which is known only after local training. We thus incorporate estimation methods into scheduling to predict the gradient norm. Taking the estimation error into account, we characterize the performance gap between the proposed algorithm and its offline counterpart. Experimental results show that, under a highly unbalanced local data distribution, the proposed algorithm can increase the accuracy by 4.9% on CIFAR-10 dataset compared with the myopic benchmark, while satisfying the energy constraints.
引用
收藏
页码:227 / 242
页数:16
相关论文
共 50 条
  • [41] The Analysis and Optimization of Volatile Clients in Over-the-Air Federated Learning
    Shi, Fang
    Lin, Weiwei
    Wang, Xiumin
    Li, Keqin
    Zomaya, Albert Y.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 13144 - 13157
  • [42] Decentralized Over-the-Air Federated Learning by Second-Order Optimization Method
    Yang, Peng
    Jiang, Yuning
    Wen, Dingzhu
    Wang, Ting
    Jones, Colin N.
    Shi, Yuanming
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 5632 - 5647
  • [43] On the Differential Privacy in Federated Learning Based on Over-the-Air Computation
    Park, Sangjun
    Choi, Wan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (05) : 4269 - 4283
  • [44] Deep Compression for Efficient and Accelerated Over-the-Air Federated Learning
    Khan, Fazal Muhammad Ali
    Abou-Zeid, Hatem
    Hassan, Syed Ali
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (15): : 25802 - 25817
  • [45] Asynchronous Federated Learning via Over-the-Air Computation in LEO Satellite Networks
    Huang, Yansong
    Li, Xuan
    Zhao, Moke
    Li, Haiyan
    Peng, Mugen
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 19885 - 19901
  • [46] Channel and Gradient-Importance Aware Device Scheduling for Over-the-Air Federated Learning
    Sun, Yuchang
    Lin, Zehong
    Mao, Yuyi
    Jin, Shi
    Zhang, Jun
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 6905 - 6920
  • [47] Massive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning
    Qiao, Li
    Gao, Zhen
    Mashhadi, Mahdi Boloursaz
    Gunduz, Deniz
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2024, 42 (11) : 3078 - 3094
  • [48] Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning
    Fan, Dian
    Yuan, Xiaojun
    Zhang, Ying-Jun Angela
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3757 - 3771
  • [49] Federated Learning With Over-the-Air Aggregation Over Time-Varying Channels
    Tegin, Busra
    Duman, Tolga M.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (08) : 5671 - 5684
  • [50] Joint Power Control and Data Size Selection for Over-the-Air Computation-Aided Federated Learning
    An, Xuming
    Fan, Rongfei
    Zuo, Shiyuan
    Hu, Han
    Jiang, Hai
    Zhang, Ning
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (08): : 14031 - 14046