Olive Branch Learning: A Topology-Aware Federated Learning Framework for Space-Air-Ground Integrated Network

被引:16
作者
Fang, Qingze [1 ]
Zhai, Zhiwei [1 ]
Yu, Shuai [1 ]
Wu, Qiong [1 ]
Gong, Xiaowen [2 ]
Chen, Xu [1 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Auburn Univ, Dept Elect & Comp Engn, Auburn, AL 36849 USA
基金
美国国家科学基金会;
关键词
Space-air-ground integrated networks; Atmospheric modeling; Satellites; Space vehicles; Training; Data models; Servers; boldsymbol Federated Learning (FL); space-air-ground integrated network (SAGIN); Index Terms; in-orbit computing; SUPPORTING INTERNET; RESOURCE-ALLOCATION; EDGE INTELLIGENCE; SATELLITE;
D O I
10.1109/TWC.2022.3226867
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The space-air-ground integrated network (SAGIN), one of the key technologies for next-generation mobile communication systems, can facilitate data transmission for users all over the world, especially in some remote areas where vast amounts of informative data are collected by Internet of remote things (IoRT) devices to support various data-driven artificial intelligence (AI) services. However, training AI models centrally with the assistance of SAGIN faces the challenges of highly constrained network topology, inefficient data transmission, and privacy issues. To tackle these challenges, we first propose a novel topology-aware federated learning framework for the SAGIN, namely Olive Branch Learning (OBL). Specifically, the IoRT devices in the ground layer leverage their private data to perform model training locally, while the air nodes in the air layer and the ring-structured low earth orbit (LEO) satellite constellation in the space layer are in charge of model aggregation (synchronization) at different scales. To further enhance communication efficiency and inference performance of OBL, an efficient Communication and Non-IID-aware Air node-Satellite Assignment (CNASA) algorithm is designed by taking the data class distribution of the air nodes as well as their geographic locations into account. Furthermore, we extend our OBL framework and CNASA algorithm to adapt to more complex multi-orbit satellite networks. We analyze the convergence of our OBL framework and conclude that the CNASA algorithm contributes to the fast convergence of the global model. Extensive experiments based on realistic datasets corroborate the superior performance of our algorithm over the benchmark policies.
引用
收藏
页码:4534 / 4551
页数:18
相关论文
共 45 条
[1]  
Blot M, 2016, Arxiv, DOI arXiv:1611.09726
[2]  
Caroli M, 2010, LECT NOTES COMPUT SC, V6049, P462, DOI 10.1007/978-3-642-13193-6_39
[3]   FedAT: A High-Performance and Communication -Efficient Federated Learning System with Asynchronous Tiers [J].
Chai, Zheng ;
Chen, Yujing ;
Anwar, Ali ;
Zhao, Liang ;
Cheng, Yue ;
Rangwala, Huzefa .
SC21: INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2021,
[4]   Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach [J].
Cheng, Nan ;
Lyu, Feng ;
Quan, Wei ;
Zhou, Conghao ;
He, Hongli ;
Shi, Weisen ;
Shen, Xuemin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (05) :1117-1129
[5]   On Implementing 2D Rectangular Assignment Algorithms [J].
Crouse, David F. .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2016, 52 (04) :1679-1696
[6]   Satellite Communications Supporting Internet of Remote Things [J].
De Sanctis, Mauro ;
Cianca, Ernestina ;
Araniti, Giuseppe ;
Bisio, Igor ;
Prasad, Ramjee .
IEEE INTERNET OF THINGS JOURNAL, 2016, 3 (01) :113-123
[7]   UAVs as an Intelligent Service: Boosting Edge Intelligence for Air-Ground Integrated Networks [J].
Dong, Chao ;
Shen, Yun ;
Qu, Yuben ;
Wang, Kun ;
Zheng, Jianchao ;
Wu, Qihui ;
Wu, Fan .
IEEE NETWORK, 2021, 35 (04) :167-175
[8]   Self-Balancing Federated Learning With Global Imbalanced Data in Mobile Systems [J].
Duan, Moming ;
Liu, Duo ;
Chen, Xianzhang ;
Liu, Renping ;
Tan, Yujuan ;
Liang, Liang .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (01) :59-71
[9]  
Gibiansky A., 2021, Bringing HPC techniques ro deep learning
[10]  
Hard A, 2019, Arxiv, DOI arXiv:1811.03604