ROBUST FEDERATED LEARNING VIA OVER-THE-AIR COMPUTATION

被引:7
|
作者
Sifaou, Houssem [1 ]
Li, Geoffrey Ye [1 ]
机构
[1] Imperial Coll London, Dept Elect & Elect Engn, London, England
关键词
Federated learning; Over-the-air computation; Byzantine attacks; STOCHASTIC GRADIENT DESCENT;
D O I
10.1109/MLSP55214.2022.9943401
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the robustness of over-the-air federated learning to Byzantine attacks. The simple averaging of the model updates via over-the-air computation makes the learning task vulnerable to random or intended modifications of the local model updates of some malicious clients. We propose a robust transmission and aggregation framework to such attacks while preserving the benefits of over-the-air computation for federated learning. For the proposed robust federated learning, the participating clients are randomly divided into groups and a transmission time slot is allocated to each group. The parameter server aggregates the results of the different groups using a robust aggregation technique and conveys the result to the clients for another training round. We also analyze the convergence of the proposed algorithm. Numerical simulations confirm the robustness of the proposed approach to Byzantine attacks.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Federated Learning via Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (03) : 2022 - 2035
  • [2] Asynchronous Federated Learning via Over-the-air Computation
    Zheng, Zijian
    Deng, Yansha
    Liu, Xiaonan
    Nallanathan, Arumugam
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1345 - 1350
  • [3] Federated Linear Bandit Learning via Over-the-air Computation
    Wang, Jiali
    Jiang, Yuning
    Liu, Xin
    Wang, Ting
    Shi, Yuanming
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1363 - 1368
  • [4] Multiple Parallel Federated Learning via Over-the-Air Computation
    Shi, Gaoxin
    Guo, Shuaishuai
    Ye, Jia
    Saeed, Nasir
    Dang, Shuping
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 : 1252 - 1264
  • [5] Robust Over-the-Air Federated Learning
    Kim, Hwanjin
    Nam, Hongjae
    Love, David J.
    2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS, 2024,
  • [6] Federated Learning Based on Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [7] Over-the-Air Computation for Vertical Federated Learning
    Zeng, Xiangyu
    Xia, Shuhao
    Yang, Kai
    Wu, Youlong
    Shi, Yuanming
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 788 - 793
  • [8] Federated Learning via Active RIS Assisted Over-the-Air Computation
    Zhang, Deyou
    Xiao, Ming
    Skoglund, Mikael
    Poor, H. Vincent
    2024 IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING FOR COMMUNICATION AND NETWORKING, ICMLCN 2024, 2024, : 201 - 207
  • [9] Federated Edge Learning With Misaligned Over-the-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) : 3951 - 3964
  • [10] Federated Edge Learning with Misaligned Over-The-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2021, : 236 - 240