Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

被引:5
|
作者
Li, Fengqi [1 ,2 ]
Zhang, Kaiyang [1 ,2 ]
Wang, Jiaheng [1 ,2 ]
Li, Yudong [1 ,2 ]
Xu, Fengqiang [1 ,2 ]
Wang, Yanjuan [3 ,4 ]
Tong, Ning [1 ,2 ]
机构
[1] Dalian Jiaotong Univ, Sch Software, Dalian, Peoples R China
[2] Dalian Jiaotong Univ, Dalian Key Lab Blockchain Technol & Applicat, Dalian 116028, Peoples R China
[3] Dalian Jiaotong Univ, Software Inst, Dalian, Peoples R China
[4] Yunnan Univ Finance & Econ, Yunnan Key Lab Serv Comp, Kunming 650221, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 12期
关键词
Deep federated learning (DFL); Markov decision process (MDP); traffic offloading; unmanned aerial vehicle (UAV); DEPLOYMENT;
D O I
10.1109/JIOT.2024.3363188
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the exponential growth in mobile data volume, cellular networks are under severe capacity pressure. To address this issue, unmanned aerial vehicles (UAVs) are being used as mobile base stations (BSs) for traffic offloading. However, coordinating and scheduling traffic across multiple UAVs and BSs remains a challenge in complex environments. This article proposes a solution that optimizes UAV deployment locations and user resource allocation, the goal is to maximize traffic offloading and minimize UAV energy consumption simultaneously. We introduce a hierarchical intelligent traffic offloading network optimization framework based on deep federated learning (DFL). Through federated learning, the UAV swarm is organized hierarchically. Additionally, we developed the CPRAFT algorithm, which uses capacity values as criterion to select the leader UAV (L-UAV). The L-UAV then becomes the top-level central server for model aggregation in the federated learning environment. Furthermore, we formalize the traffic offloading problem as a Markov decision process (MDP). Based on MDP, this article proposes an FL-SNTD3 algorithm to optimize dynamic decision making, which adapts to the ever-changing network environment and fluctuating traffic demands. Simulation experiments demonstrate that the proposed framework and algorithm exhibit outstanding performance in various aspects, providing robust support for future research in intelligent traffic offloading networks.
引用
收藏
页码:21312 / 21324
页数:13
相关论文
共 50 条
  • [41] On Designing Multi-UAV Aided Wireless Powered Dynamic Communication via Hierarchical Deep Reinforcement Learning
    Zhao, Ze Yu
    Che, Yue Ling
    Luo, Sheng
    Luo, Gege
    Wu, Kaishun
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 13991 - 14004
  • [42] Multi-UAV Dynamic Wireless Networking With Deep Reinforcement Learning
    Wang, Qiang
    Zhang, Wenqi
    Liu, Yuanwei
    Liu, Ying
    IEEE COMMUNICATIONS LETTERS, 2019, 23 (12) : 2243 - 2246
  • [43] Trajectory and Beamforming Vector Optimization for Multi-UAV Multicast Network
    Feng, Chengcheng
    Zhang, Chao
    Luo, Xinmin
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
  • [44] Joint Power and QoE Optimization Scheme for Multi-UAV Assisted Offloading in Mobile Computing
    Wang, Qi
    Gao, Ang
    Hu, Yansu
    IEEE ACCESS, 2021, 9 : 21206 - 21217
  • [45] Energy optimization and age of information enhancement in multi-UAV networks using deep reinforcement learning
    Kim, Jeena
    Park, Seunghyun
    Park, Hyunhee
    ELECTRONICS LETTERS, 2024, 60 (20)
  • [46] Multi-UAV-Assisted MEC Offloading-Optimization Method on Deep Reinforcement Learning
    Sun, Chao
    Li, Zhihua
    INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2025, 21 (01)
  • [47] Three-Dimension Trajectory Design for Multi-UAV Wireless Network With Deep Reinforcement Learning
    Zhang, Wenqi
    Wang, Qiang
    Liu, Xiao
    Liu, Yuanwei
    Chen, Yue
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (01) : 600 - 612
  • [48] Federated Learning-Based Task Offloading in a UAV-Aided Cloud Computing Mobile Network
    Agarwal, Nipun
    Joshi, Sandeep
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (10) : 15751 - 15756
  • [49] On the Optimization of UAV-Assisted Wireless Networks for Hierarchical Federated Learning
    Khelf, Roumaissa
    Driouch, Elmahdi
    Ajib, Wessam
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [50] Age-of-Information based Multi-UAV Trajectories Using Deep Reinforcement Learning
    Kaur, Amanjot
    Jha, Shashi Shekhar
    IETE TECHNICAL REVIEW, 2024, 41 (06) : 659 - 671