Joint Optimization for Federated Learning Over the Air

被引:0
作者
Fan, Xin [1 ]
Wang, Yue [2 ]
Huo, Yan [1 ]
Tian, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing, Peoples R China
[2] George Mason Univ, Dept Elect & Comp Engn, Fairfax, VA USA
来源
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022) | 2022年
基金
美国国家科学基金会; 北京市自然科学基金; 中国国家自然科学基金;
关键词
Federated learning; analog aggregation; convergence analysis; joint optimization; worker scheduling; power scaling;
D O I
10.1109/ICC45855.2022.9838269
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In this paper, we focus on federated learning (FL) over the air based on analog aggregation transmission in realistic wireless networks. We first derive a closed-form expression for the expected convergence rate of FL over the air, which theoretically quantifies the impact of analog aggregation on FL. Based on that, we further develop a joint optimization model for accurate FL implementation, which allows a parameter server to select a subset of edge devices and determine an appropriate power scaling factor. Such a joint optimization of device selection and power control for FL over the air is then formulated as an mixed integer programming problem. Finally, we efficiently solve this problem via a simple finite-set search method. Simulation results show that the proposed solutions developed for wireless channels outperform a benchmark method, and could achieve comparable performance of the ideal case where FL is implemented over reliable and error-free wireless channels.
引用
收藏
页码:2798 / 2803
页数:6
相关论文
共 18 条
  • [11] Liu YH, 2019, CONF REC ASILOMAR C, P1496, DOI [10.1109/ieeeconf44664.2019.9048719, 10.1109/IEEECONF44664.2019.9048719]
  • [12] McMahan H.B., 2016, arXiv preprint arXiv:1602.05629 2, V1, DOI 10.48550/arXiv.1602.05629
  • [13] Computation over multiple-access channels
    Nazer, Bobak
    Gastpar, Michael
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53 (10) : 3498 - 3516
  • [14] Wang J., 2018, ARXIV180807576
  • [15] Wang S., 2019, CoRR
  • [16] Federated Learning via Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (03) : 2022 - 2035
  • [17] ON THE CONVERGENCE OF DECENTRALIZED GRADIENT DESCENT
    Yuan, Kun
    Ling, Qing
    Yin, Wotao
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (03) : 1835 - 1854
  • [18] Broadband Analog Aggregation for Low-Latency Federated Edge Learning
    Zhu, Guangxu
    Wang, Yong
    Huang, Kaibin
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (01) : 491 - 506