Federated deep reinforcement learning based computation offloading in a low Earth orbit satellite edge computing system

被引:0
作者
Jia, Min [1 ]
Wu, Jian [1 ]
Wang, Xinyu [1 ]
Guo, Qing [1 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150006, Peoples R China
基金
中国国家自然科学基金;
关键词
Federated learning; Low Earth orbit satellite; Mobile edge computing; Deep reinforcement learning; Computation offloading; TN929.5; DESIGN;
D O I
10.1631/FITEE.2400448
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent studies have shown that system capacity is very important for cellular networks. In this paper, we consider maximizing the weighted sum-rate of the cellular network downlink and uplink, where each cell consists of a full-duplex (FD) base station (BS) and half-duplex (HD) users. Federated learning (FL) can train models in the absence of centralized data, which can achieve privacy protection of user data. A low Earth orbit (LEO) satellite edge computing system (LSECS) can be formed by placing the mobile edge computing (MEC) servers on LEO satellites, which greatly increases the processing capacities of the satellites. Therefore, we consider a combination of FL and MEC and propose an FL-based computation offloading algorithm to maximize the weighted sum-rate while ensuring the security of user data. We consider solving the sub-channel assignment and power allocation problems using deep reinforcement learning (DRL) algorithms with excellent global search capabilities. The simulation results show that our proposed algorithm achieves the maximum weighted sum-rate compared with the baseline algorithms and excellent convergence.
引用
收藏
页码:805 / 815
页数:11
相关论文
共 35 条
[1]   Multi-Band Full Duplex MAC Protocol (MB-FDMAC) [J].
Alkhrijah, Yazeed ;
Camp, Joseph ;
Rajan, Dinesh .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (09) :2864-2878
[2]   Satellite-Based Computing Networks with Federated Learning [J].
Chen, Hao ;
Xiao, Ming ;
Pang, Zhibo .
IEEE WIRELESS COMMUNICATIONS, 2022, 29 (01) :78-84
[3]   Satellite Internet of Things: challenges, solutions, and development trends [J].
Chen, Xiaoming ;
Xu, Zhaobin ;
Shang, Lin .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2023, 24 (07) :935-944
[4]   Image-based traffic signal control via world models [J].
Dai, Xingyuan ;
Zhao, Chen ;
Wang, Xiao ;
Lv, Yisheng ;
Lin, Yilun ;
Wang, Fei-Yue .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2022, 23 (12) :1795-1813
[5]   Resource Allocation in Multi-User Cellular Networks: A Transformer-Based Deep Reinforcement Learning Approach [J].
Di, Zhao ;
Zhong, Zheng ;
Pengfei, Qin ;
Hao, Qin ;
Bin, Song .
CHINA COMMUNICATIONS, 2024, 21 (05) :77-96
[6]   Federated Deep Reinforcement Learning for Efficient Jamming Attack Mitigation in O-RAN [J].
El Houda, Zakaria Abou ;
Moudoud, Hajar ;
Brik, Bouziane .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (07) :9334-9343
[7]   Queue-Aware Resource Allocation in Full-Duplex Multi-Cellular Wireless Networks [J].
Fawaz, Hassan ;
Lahoud, Samer ;
El Helou, Melhem ;
Khawam, Kinda .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (09) :2852-2863
[8]   Deep Learning-Based Joint Pilot Design and Channel Estimation for OFDM Systems [J].
Fu, Heng ;
Si, Weijian ;
Kim, Il-Min .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (08) :4577-4590
[9]   Game-Based Computation Offloading and Power Allocation for LEO Constellation Networks in Distributed and Dynamic Environment [J].
Gao, Yufang ;
Ji, Zhi ;
Zhao, Kanglian ;
de Cola, Tomaso ;
Li, Wenfeng .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (04) :7040-7058
[10]   Cooperative Federated Learning Over Ground-to-Satellite Integrated Networks: Joint Local Computation and Data Offloading [J].
Han, Dong-Jun ;
Hosseinalipour, Seyyedali ;
Love, David J. ;
Chiang, Mung ;
Brinton, Christopher G. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2024, 42 (05) :1080-1096