Joint Optimization for Federated Learning Over the Air

被引:0
作者
Fan, Xin [1 ]
Wang, Yue [2 ]
Huo, Yan [1 ]
Tian, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing, Peoples R China
[2] George Mason Univ, Dept Elect & Comp Engn, Fairfax, VA USA
来源
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022) | 2022年
基金
美国国家科学基金会; 北京市自然科学基金; 中国国家自然科学基金;
关键词
Federated learning; analog aggregation; convergence analysis; joint optimization; worker scheduling; power scaling;
D O I
10.1109/ICC45855.2022.9838269
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In this paper, we focus on federated learning (FL) over the air based on analog aggregation transmission in realistic wireless networks. We first derive a closed-form expression for the expected convergence rate of FL over the air, which theoretically quantifies the impact of analog aggregation on FL. Based on that, we further develop a joint optimization model for accurate FL implementation, which allows a parameter server to select a subset of edge devices and determine an appropriate power scaling factor. Such a joint optimization of device selection and power control for FL over the air is then formulated as an mixed integer programming problem. Finally, we efficiently solve this problem via a simple finite-set search method. Simulation results show that the proposed solutions developed for wireless channels outperform a benchmark method, and could achieve comparable performance of the ideal case where FL is implemented over reliable and error-free wireless channels.
引用
收藏
页码:2798 / 2803
页数:6
相关论文
共 18 条
  • [1] Federated Learning Over Wireless Fading Channels
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) : 3546 - 3557
  • [2] Collaborative Machine Learning at the Wireless Edge with Blind Transmitters
    Amiri, Mohammad Mohammadi
    Duman, Tolga M.
    Gunduz, Deniz
    [J]. 2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,
  • [3] Bertsekas D., 1996, NEURO DYNAMIC PROGRA
  • [4] A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Yang, Zhaohui
    Saad, Walid
    Yin, Changchuan
    Poor, H. Vincent
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 269 - 283
  • [5] Fan X., 2021, P IEEE INT C COMM WO, P1
  • [6] Fan X., 2021, ARXIV211009660
  • [7] Fan X., 2021, ARXIV210316055
  • [8] Fan X., 2021, ARXIV210403490
  • [9] HYBRID DETERMINISTIC-STOCHASTIC METHODS FOR DATA FITTING
    Friedlander, Michael P.
    Schmidt, Mark
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2012, 34 (03) : A1380 - A1405
  • [10] Konen J., 2016, ARXIV161002527, P1