Blind Federated Learning via Over-the-Air q-QAM

被引:0
作者
Razavikia, Saeed [1 ]
da Silva, José Mairton Barros [2 ]
Fischione, Carlo [3 ]
机构
[1] the School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm
[2] The Department of Information Technology, Uppsala University, Uppsala
[3] The School of Electrical Engineering and Computer Science and the Digital Futures, KTH Royal Institute of Technology, Stockholm
关键词
Blind federated learning; digital modulation; federated edge learning; over-the-air computation;
D O I
10.1109/TWC.2024.3485117
中图分类号
学科分类号
摘要
In this work, we investigate federated edge learning over a fading multiple access channel. To alleviate the communication burden between the edge devices and the access point, we introduce a pioneering digital over-the-air computation strategy employing q-ary quadrature amplitude modulation, culminating in a low latency communication scheme. Indeed, we propose a new federated edge learning framework in which edge devices use digital modulation for over-the-air uplink transmission to the edge server while they have no access to the channel state information. Furthermore, we incorporate multiple antennas at the edge server to overcome the fading inherent in wireless communication. We analyze the number of antennas required to mitigate the fading impact effectively. We prove a non-asymptotic upper bound for the mean squared error for the proposed federated learning with digital over-the-air uplink transmissions under both noisy and fading conditions. Leveraging the derived upper bound, we characterize the convergence rate of the learning process of a non-convex loss function in terms of the mean square error of gradients due to the fading channel. Furthermore, we substantiate the theoretical assurances through numerical experiments concerning mean square error and the convergence efficacy of the digital federated edge learning framework. Notably, the results demonstrate that augmenting the number of antennas at the edge server and adopting higher-order modulations improve the model accuracy up to 60%. © 2024 The Authors.
引用
收藏
页码:19570 / 19586
页数:16
相关论文
共 47 条
  • [1] Li T., Sahu A.K., Talwalkar A., Smith V., Federated learning: Challenges, methods, and future directions, IEEE Signal Process. Mag., 37, 3, pp. 50-60, (2020)
  • [2] Konec ny J., Brendan McMahan H., Yu F.X., Richtarik P., Theertha Suresh A., Bacon D., Federated learning: Strategies for improving communication efficiency, (2016)
  • [3] Azimi-Abarghouyi S.M., Fodor V., Scalable hierarchical over-the-air federated learning, IEEE Trans. Wireless Commun., 23, 8, pp. 8480-8496, (2024)
  • [4] McMahan B., Moore E., Ramage D., Hampson S., Arcas B.A.Y., Communication-efficient learning of deep networks from decentralized data, Proc. Artif. Intell. Statist., pp. 1273-1282, (2017)
  • [5] Tak A., Cherkaoui S., Federated edge learning: Design issues and challenges, IEEE Netw, 35, 2, pp. 252-258, (2021)
  • [6] Zhu G., Wang Y., Huang K., Broadband analog aggregation for low-latency federated edge learning, IEEE Trans. Wireless Commun., 19, 1, pp. 491-506, (2019)
  • [7] Perez-Neira A., Martinez-Gost M., Sahin A., Razavikia S., Fischione C., Huang K., Waveforms for computing over the air
  • [8] Goldenbaum M., Boche H., Stanczak S., Nomographic functions: Efficient computation in clustered Gaussian sensor networks, IEEE Trans. Wireless Commun., 14, 4, pp. 2093-2105, (2015)
  • [9] Hellstrom H., Et al., Wireless for machine learning: A survey, Found. Trends Signal Process., 15, 4, pp. 290-399, (2022)
  • [10] Yang K., Jiang T., Shi Y., Ding Z., Federated learning via over-the-air computation, IEEE Trans. Wireless Commun., 19, 3, pp. 2022-2035, (2020)