Convergence Time Optimization for Decentralized Federated Learning With LEO Satellites via Number Control

被引:8
作者
Yan, Zhigang [1 ]
Li, Dong [1 ]
机构
[1] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau 999078, Peoples R China
关键词
Decentralized federated learning; low earth orbit; satellite communication;
D O I
10.1109/TVT.2023.3322461
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Decentralized Federated Learning (DFL) is a federated learning framework without any central controllers. With the development of Low Earth Orbit (LEO) satellite constellations, LEO satellites can be used to train a machine learning model collaboratively through DFL. However, due to the energy limitations of the satellites, DFL with satellites has higher requirements on the latency. In this article, we investigate how to minimize the convergence time of DFL with satellites by designing the number of satellites in each orbit and the number of orbits. In addition to considering the total energy cost and the distance constraints in satellite communication, we also consider guaranteeing the DFL performance in the problem of minimizing the convergence time. However, obtaining closed-form solutions to this problem is difficult since the target is non-convex and the performance is hard to evaluate directly. To address these issues, we derive an upper bound on the convergence time and transform it into a quasi-convex function first. Then, we derive the convergence bound of DFL with respect to the number of satellites and orbits. Based on these two bounds, we reformulate the problem and obtain the closed-form expressions of the optimal number of satellites and orbits. Simulation results confirm the impact of these numbers on the convergence time and verify the effectiveness of the proposed scheme.
引用
收藏
页码:4517 / 4522
页数:6
相关论文
共 22 条
[1]   A Decentralized Federated Learning Framework via Committee Mechanism With Convergence Guarantee [J].
Che, Chunjiang ;
Li, Xiaoli ;
Chen, Chuan ;
He, Xiaoyu ;
Zheng, Zibin .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) :4783-4800
[2]   Convergence Time Optimization for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Poor, H. Vincent ;
Saad, Walid ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) :2457-2471
[3]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[4]  
Dinkelbach W., 1967, MANAGE SCI, V13, P492, DOI [242488, DOI 10.1287/MNSC.13.7.492]
[5]  
Elmahallawy M, 2023, Arxiv, DOI arXiv:2302.13447
[6]   Wireless Federated Learning With Asynchronous and Quantized Updates [J].
Huang, Peishan ;
Li, Dong ;
Yan, Zhigang .
IEEE COMMUNICATIONS LETTERS, 2023, 27 (09) :2393-2397
[7]   Federated Learning with Dynamic Aggregation Based on Connection Density at Satellites and Ground Stations [J].
Lin, Jian ;
Xu, Jianlong ;
Li, Yusen ;
Xu, Zhuo .
2022 IEEE INTERNATIONAL CONFERENCE ON SATELLITE COMPUTING, SATELLITE, 2022, :31-36
[8]   Decentralized Federated Learning: Balancing Communication and Computing Costs [J].
Liu, Wei ;
Chen, Li ;
Zhang, Wenyi .
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2022, 8 :131-143
[9]  
Mateo-Garcia Gonzalo, Towards global flood mapping onboard low cost satellites with machine learning
[10]  
McMahan HB, 2017, PR MACH LEARN RES, V54, P1273