Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

被引:5
|
作者
Li, Fengqi [1 ,2 ]
Zhang, Kaiyang [1 ,2 ]
Wang, Jiaheng [1 ,2 ]
Li, Yudong [1 ,2 ]
Xu, Fengqiang [1 ,2 ]
Wang, Yanjuan [3 ,4 ]
Tong, Ning [1 ,2 ]
机构
[1] Dalian Jiaotong Univ, Sch Software, Dalian, Peoples R China
[2] Dalian Jiaotong Univ, Dalian Key Lab Blockchain Technol & Applicat, Dalian 116028, Peoples R China
[3] Dalian Jiaotong Univ, Software Inst, Dalian, Peoples R China
[4] Yunnan Univ Finance & Econ, Yunnan Key Lab Serv Comp, Kunming 650221, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 12期
关键词
Deep federated learning (DFL); Markov decision process (MDP); traffic offloading; unmanned aerial vehicle (UAV); DEPLOYMENT;
D O I
10.1109/JIOT.2024.3363188
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the exponential growth in mobile data volume, cellular networks are under severe capacity pressure. To address this issue, unmanned aerial vehicles (UAVs) are being used as mobile base stations (BSs) for traffic offloading. However, coordinating and scheduling traffic across multiple UAVs and BSs remains a challenge in complex environments. This article proposes a solution that optimizes UAV deployment locations and user resource allocation, the goal is to maximize traffic offloading and minimize UAV energy consumption simultaneously. We introduce a hierarchical intelligent traffic offloading network optimization framework based on deep federated learning (DFL). Through federated learning, the UAV swarm is organized hierarchically. Additionally, we developed the CPRAFT algorithm, which uses capacity values as criterion to select the leader UAV (L-UAV). The L-UAV then becomes the top-level central server for model aggregation in the federated learning environment. Furthermore, we formalize the traffic offloading problem as a Markov decision process (MDP). Based on MDP, this article proposes an FL-SNTD3 algorithm to optimize dynamic decision making, which adapts to the ever-changing network environment and fluctuating traffic demands. Simulation experiments demonstrate that the proposed framework and algorithm exhibit outstanding performance in various aspects, providing robust support for future research in intelligent traffic offloading networks.
引用
收藏
页码:21312 / 21324
页数:13
相关论文
共 50 条
  • [1] Computation offloading over multi-UAV MEC network: A distributed deep reinforcement learning approach
    Wei, Dawei
    Ma, Jianfeng
    Luo, Linbo
    Wang, Yunbo
    He, Lei
    Li, Xinghua
    COMPUTER NETWORKS, 2021, 199 (199)
  • [2] An Offloading Optimization Scheme for Multi-UAV Aided Network in Mobile Computing
    Gao, Ang
    Wang, Qi
    Hu, Yansu
    Duan, Weijun
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 1468 - 1473
  • [3] Optimization Design of Multi-UAV Communication Network Based on Reinforcement Learning
    Cao, Zhengyang
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [4] Federated Learning Assisted Multi-UAV Networks
    Zhang, Hongming
    Hanzo, Lajos
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) : 14104 - 14109
  • [5] Machine Learning-Based Multi-UAV Deployment for Uplink Traffic Sizing and Offloading in Cellular Networks
    Mostafa, Ahmed Fahim
    Abdel-Kader, Mohamed
    Gadallah, Yasser
    Elayat, Omar
    IEEE ACCESS, 2023, 11 : 71314 - 71325
  • [6] Federated Deep Reinforcement Learning-Based Multi-UAV Navigation for Heterogeneous NOMA Systems
    Rezwan, Sifat
    Chun, Chanjun
    Choi, Wooyeol
    IEEE SENSORS JOURNAL, 2023, 23 (23) : 29722 - 29732
  • [7] Multi-UAV Assisted Offloading Optimization: A Game Combined Reinforcement Learning Approach
    Gao, Ang
    Wang, Qi
    Chen, Kaiyue
    Liang, Wei
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (08) : 2629 - 2633
  • [8] Joint Multi-UAV Deployment and Resource Allocation based on Personalized Federated Deep Reinforcement Learning
    Xu, Xinyi
    Feng, Gang
    Qin, Shuang
    Liu, Yijing
    Sun, Yao
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 5677 - 5682
  • [9] Deep Reinforcement Learning Based Computation Offloading and Trajectory Planning for Multi-UAV Cooperative Target Search
    Luo, Quyuan
    Luan, Tom H.
    Shi, Weisong
    Fan, Pingzhi
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (02) : 504 - 520
  • [10] A Deep Learning Approach for Task Offloading in Multi-UAV Aided Mobile Edge Computing
    Ebrahim, Moshira A.
    Ebrahim, Gamal A.
    Mohamed, Hoda K.
    Abdellatif, Sameh O.
    IEEE ACCESS, 2022, 10 : 101716 - 101731