Asynchronous Federated Learning via Over-the-air Computation

被引:0
|
作者
Zheng, Zijian [1 ]
Deng, Yansha [2 ]
Liu, Xiaonan [1 ]
Nallanathan, Arumugam [1 ]
机构
[1] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London, England
[2] Kings Coll London, Dept Engn, London, England
来源
IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM | 2023年
关键词
Asynchronous federated learning; over-the-air computation; error accumulation;
D O I
10.1109/GLOBECOM54140.2023.10437951
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The emerging field of federated learning (FL) provides great potential for edge intelligence while protecting data privacy. However, as the system grows in scale or becomes more heterogeneous, new challenges, such as the spectrum shortage and stragglers issues, arise. These issues can potentially be addressed by over-the-air computation (AirComp) and asynchronous FL, respectively, however, their combination is difficult due to their conflicting requirements. In this paper, we propose a novel asynchronous FL with AirComp in a time-triggered manner (async-AirFed). The conventional async aggregation requests the historical data to be used for model updates, which can cause the accumulation of channel noise and interference when AirComp is applied. To address this issue, we propose a simple but effective truncation method which retains a limited length of historical data. Convergence analysis presents that our proposed async-AirFed converges on non-convex optimality function with sublinear rate. Simulation results show that our proposed scheme achieves more than 34% faster convergence than the benchmarks, by achieving an accuracy of 85%, which also improves the time utilization efficiency and reduces the impact of staleness and the channel.
引用
收藏
页码:1345 / 1350
页数:6
相关论文
共 50 条
  • [1] Federated Learning via Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (03) : 2022 - 2035
  • [2] Asynchronous Federated Learning via Over-the-Air Computation in LEO Satellite Networks
    Huang, Yansong
    Li, Xuan
    Zhao, Moke
    Li, Haiyan
    Peng, Mugen
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 19885 - 19901
  • [3] ROBUST FEDERATED LEARNING VIA OVER-THE-AIR COMPUTATION
    Sifaou, Houssem
    Li, Geoffrey Ye
    2022 IEEE 32ND INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2022,
  • [4] Semi-Asynchronous Federated Edge Learning for Over-the-air Computation
    Kou, Zhoubin
    Ji, Yun
    Zhong, Xiaoxiong
    Zhang, Sheng
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1351 - 1356
  • [5] Broadband Digital Over-the-Air Computation for Asynchronous Federated Edge Learning
    Zhao, Xinbo
    You, Lizhao
    Rui Cao
    Shao, Yulin
    Fu, Liqun
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 5359 - 5364
  • [6] Federated Linear Bandit Learning via Over-the-air Computation
    Wang, Jiali
    Jiang, Yuning
    Liu, Xin
    Wang, Ting
    Shi, Yuanming
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1363 - 1368
  • [7] Multiple Parallel Federated Learning via Over-the-Air Computation
    Shi, Gaoxin
    Guo, Shuaishuai
    Ye, Jia
    Saeed, Nasir
    Dang, Shuping
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 : 1252 - 1264
  • [8] Federated Learning Based on Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [9] Over-the-Air Computation for Vertical Federated Learning
    Zeng, Xiangyu
    Xia, Shuhao
    Yang, Kai
    Wu, Youlong
    Shi, Yuanming
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 788 - 793
  • [10] Federated Learning via Active RIS Assisted Over-the-Air Computation
    Zhang, Deyou
    Xiao, Ming
    Skoglund, Mikael
    Poor, H. Vincent
    2024 IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING FOR COMMUNICATION AND NETWORKING, ICMLCN 2024, 2024, : 201 - 207