Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures

被引:0
作者
Dahl, Martin [1 ]
Larsson, Erik G. [1 ]
机构
[1] Linkoping Univ, Dept Elect Engn ISY, Linkoping, Sweden
来源
2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS | 2024年
基金
瑞典研究理事会;
关键词
Federated learning; Wireless networks; COMPUTATION;
D O I
10.1109/CISS59072.2024.10480215
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wirelessly connected devices can collaborately train a machine learning model using federated learning, where the aggregation of model updates occurs using over-the-air computation. Carrier frequency offset caused by imprecise clocks in devices will cause the phase of the over-the-air channel to drift randomly, such that late symbols in a coherence block are transmitted with lower quality than early symbols. To mitigate the effect of degrading symbol quality, we propose a scheme where one of the permutations Roll, Flip and Sort are applied on gradients before transmission. Through simulations we show that the permutations can both improve and degrade learning performance. Furthermore, we derive the expectation and variance of the gradient estimate, which is shown to grow exponentially with the number of symbols in a coherence block.
引用
收藏
页数:6
相关论文
共 26 条
  • [1] Abari O, 2015, IEEE INFOCOM SER
  • [2] Alistarh D, 2018, ADV NEUR IN, V31
  • [3] Optimized Power Control for Over-the-Air Computation in Fading Channels
    Cao, Xiaowen
    Zhu, Guangxu
    Xu, Jie
    Huang, Kaibin
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (11) : 7498 - 7513
  • [4] Chen Y., 2022 IEEE 23 INT WOR, P1
  • [5] Demir A, 1998, 1998 DESIGN AUTOMATION CONFERENCE, PROCEEDINGS, P26, DOI 10.1109/DAC.1998.724434
  • [6] Federated Learning: A signal processing perspective
    Gafni, Tomer
    Shlezinger, Nir
    Cohen, Kobi
    Eldar, Yonina C.
    Poor, H. Vincent
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2022, 39 (03) : 14 - 41
  • [7] Nomographic Functions: Efficient Computation in Clustered Gaussian Sensor Networks
    Goldenbaum, Mario
    Boche, Holger
    Stanczak, Slawomir
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2015, 14 (04) : 2093 - 2105
  • [8] Robust Analog Function Computation via Wireless Multiple-Access Channels
    Goldenbaum, Mario
    Stanczak, Slawomir
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2013, 61 (09) : 3863 - 3877
  • [9] Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1
  • [10] Over-the-Air Aggregation for Federated Learning: Waveform Superposition and Prototype Validation
    Guo, Huayan
    Zhu, Yifan
    Ma, Haoyu
    Lau, Vincent K. N.
    Huang, Kaibin
    Li, Xiaofan
    Nong, Huabin
    Zhou, Mingyu
    [J]. Journal of Communications and Information Networks, 2021, 6 (04) : 429 - 442