Online Optimization for Over-the-Air Federated Learning With Energy Harvesting

被引:4
作者
An, Qiaochu [1 ]
Zhou, Yong [1 ]
Wang, Zhibin [1 ]
Shan, Hangguan [2 ]
Shi, Yuanming [1 ]
Bennis, Mehdi [3 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
[3] Univ Oulu, Ctr Wireless Commun, Oulu 90570, Finland
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Training; Optimization; Performance evaluation; Servers; Atmospheric modeling; Convergence; Uplink; Federated learning; Lyapunov optimization; energy harvesting; over-the-air computation; CONVERGENCE;
D O I
10.1109/TWC.2023.3339298
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Federated learning (FL) is recognized as a promising privacy-preserving distributed machine learning paradigm, given its potential to enable collaborative model training among distributed devices without sharing their raw data. However, supporting FL over wireless networks confronts the critical challenges of periodically executing power-hungry training tasks on energy-constrained devices and transmitting high-dimensional model updates over spectrum-limited channels. In this paper, we reap the benefits of both energy harvesting (EH) and over-the-air computation (AirComp) to alleviate the battery limitation by harvesting ambient energy to support both the training and transmission of local models, and to achieve low-latency model aggregation by concurrently transmitting local gradients via AirComp. We characterize the convergence of the proposed FL by deriving an upper bound of the expected optimality gap, revealing that the convergence depends on the accumulated errors due to partial device participation and model distortion, both of which further depend on dynamic energy levels. To accelerate the convergence, we formulate a joint AirComp transceiver design and device scheduling problem, which is then tackled by developing an efficient Lyapunov-based online optimization algorithm. Simulations demonstrate that, by appropriately scheduling devices and allocating energy across multiple communication rounds, our proposed algorithm achieves a much better learning performance than benchmarks.
引用
收藏
页码:7291 / 7306
页数:16
相关论文
共 43 条
[1]  
Abari Omid, 2015, 2015 IEEE Conference on Computer Communications (INFOCOM). Proceedings, P1742, DOI 10.1109/INFOCOM.2015.7218555
[2]   Convergence of Update Aware Device Scheduling for Federated Learning at the Wireless Edge [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz ;
Kulkarni, Sanjeev R. ;
Poor, H. Vincent .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (06) :3643-3658
[3]   Federated Learning Over Wireless Fading Channels [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) :3546-3557
[4]   Online Power Control Optimization for Wireless Transmission With Energy Harvesting and Storage [J].
Amirnavaei, Fatemeh ;
Dong, Min .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2016, 15 (07) :4888-4901
[5]   Energy Efficient Online Power Allocation for Two Users With Energy Harvesting [J].
Ashraf, Mateen ;
Jung, Jaehoon ;
Shin, Hun Min ;
Lee, Inkyu .
IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (01) :24-28
[6]  
Bertsekas DimitriP., 2017, DYNAMIC PROGRAMMING, V1
[7]   Optimized Power Control Design for Over-the-Air Federated Edge Learning [J].
Cao, Xiaowen ;
Zhu, Guangxu ;
Xu, Jie ;
Wang, Zhiqin ;
Cui, Shuguang .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (01) :342-358
[8]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[9]   Federated Learning Over Energy Harvesting Wireless Networks [J].
Hamdi, Rami ;
Chen, Mingzhe ;
Ben Said, Ahmed ;
Qaraqe, Marwa ;
Poor, H. Vincent .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (01) :92-103
[10]  
Hu Lin, 2022, Journal of Communications and Information Networks, V7, P145, DOI [10.23919/jcin.2022.9815198, 10.23919/JCIN.2022.9815198]