UAV-Enabled Asynchronous Federated Learning

被引:0
作者
Zhai, Zhiyuan [1 ]
Yuan, Xiaojun [2 ]
Wang, Xin [1 ]
Yang, Huiyuan [2 ]
机构
[1] Fudan Univ, Dept Commun Sci & Engn, Shanghai 200438, Peoples R China
[2] Univ Elect Sci & Technol China, Natl Key Lab Wireless Commun, Chengdu 611731, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational modeling; Wireless networks; Autonomous aerial vehicles; Training; Data models; Analytical models; Federated learning; Uplink; Performance evaluation; Servers; Asynchronous federated learning; UAV communication; over-the-air computation; staleness; device selection; trajectory optimization; COMMUNICATION; DESIGN;
D O I
10.1109/TWC.2024.3520501
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To exploit unprecedented data generation in mobile edge networks, federated learning (FL) has emerged as a promising alternative to the conventional centralized machine learning (ML). By collectively training a unified learning model on edge devices, FL bypasses the need of direct data transmission, thereby addressing problems such as latency issues and privacy concerns inherent in centralized ML. However, in practical deployment FL suffers from low learning efficiency due to the involved straggler issue and huge uplink overhead. In this paper, we develop a UAV-enabled over-the-air asynchronous FL (UAV-AFL) framework to address this problem. This framework significantly enhance the learning efficiency by supporting the UAV as the parameter server (UAV-PS) in collecting data over-the-air and updating model continuously. We conduct a convergence analysis to quantitatively capture the impact of model asynchrony, device selection and communication errors on the UAV-AFL learning efficiency. Based on this analysis, a unified communication-learning problem is formulated to maximize asymptotical learning accuracy by optimizing the UAV-PS trajectory, device selection and over-the-air transceiver design. Simulation results reveal valuable insights for the system design and demonstrate that the proposed UAV-AFL scheme achieves substantially improvement in learning efficiency compared with the state-of-the-art approaches.
引用
收藏
页码:2358 / 2372
页数:15
相关论文
共 40 条
[1]   Staleness Analysis in Asynchronous Optimization [J].
Al-Lawati, Haider ;
Draper, Stark .
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2022, 8 :404-420
[2]   UAV assistance paradigm: State-of-the-art in applications and challenges [J].
Alzahrani, Bander ;
Oubbati, Omar Sami ;
Barnawi, Ahmed ;
Atiquzzaman, Mohammed ;
Alghazzawi, Daniyal .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2020, 166
[3]   Convergence of Federated Learning Over a Noisy Downlink [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz ;
Kulkarni, Sanjeev R. ;
Poor, H. Vincent .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (03) :1422-1437
[4]   Federated Learning Over Wireless Fading Channels [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) :3546-3557
[5]   Revisiting Asynchronous Linear Solvers: Provable Convergence Rate Through Randomization [J].
Avron, H. ;
Druinsky, A. ;
Gupta, A. .
2014 IEEE 28TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM, 2014,
[6]  
Bertsekas D.P., 1995, NONLINEAR PROGRAMMIN, DOI [10.1057/palgrave.jors.2600425, DOI 10.1057/PALGRAVE.JORS.2600425]
[7]  
Bertsekas DP, 1995, PROCEEDINGS OF THE 34TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, P560, DOI 10.1109/CDC.1995.478953
[8]  
Boyd S., 2004, Convex Optimization, DOI 10.1017/CBO9780511804441
[9]   An Overview on Over-the-Air Federated Edge Learning [J].
Cao, Xiaowen ;
Lyu, Zhonghao ;
Zhu, Guangxu ;
Xu, Jie ;
Xu, Lexi ;
Cui, Shuguang .
IEEE WIRELESS COMMUNICATIONS, 2024, 31 (03) :202-210
[10]   Cooperative Interference Management for Over-the-Air Computation Networks [J].
Cao, Xiaowen ;
Zhu, Guangxu ;
Xu, Jie ;
Huang, Kaibin .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) :2634-2651