Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

被引:5
作者
Li, Fengqi [1 ,2 ]
Zhang, Kaiyang [1 ,2 ]
Wang, Jiaheng [1 ,2 ]
Li, Yudong [1 ,2 ]
Xu, Fengqiang [1 ,2 ]
Wang, Yanjuan [3 ,4 ]
Tong, Ning [1 ,2 ]
机构
[1] Dalian Jiaotong Univ, Sch Software, Dalian, Peoples R China
[2] Dalian Jiaotong Univ, Dalian Key Lab Blockchain Technol & Applicat, Dalian 116028, Peoples R China
[3] Dalian Jiaotong Univ, Software Inst, Dalian, Peoples R China
[4] Yunnan Univ Finance & Econ, Yunnan Key Lab Serv Comp, Kunming 650221, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 12期
关键词
Deep federated learning (DFL); Markov decision process (MDP); traffic offloading; unmanned aerial vehicle (UAV); DEPLOYMENT;
D O I
10.1109/JIOT.2024.3363188
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the exponential growth in mobile data volume, cellular networks are under severe capacity pressure. To address this issue, unmanned aerial vehicles (UAVs) are being used as mobile base stations (BSs) for traffic offloading. However, coordinating and scheduling traffic across multiple UAVs and BSs remains a challenge in complex environments. This article proposes a solution that optimizes UAV deployment locations and user resource allocation, the goal is to maximize traffic offloading and minimize UAV energy consumption simultaneously. We introduce a hierarchical intelligent traffic offloading network optimization framework based on deep federated learning (DFL). Through federated learning, the UAV swarm is organized hierarchically. Additionally, we developed the CPRAFT algorithm, which uses capacity values as criterion to select the leader UAV (L-UAV). The L-UAV then becomes the top-level central server for model aggregation in the federated learning environment. Furthermore, we formalize the traffic offloading problem as a Markov decision process (MDP). Based on MDP, this article proposes an FL-SNTD3 algorithm to optimize dynamic decision making, which adapts to the ever-changing network environment and fluctuating traffic demands. Simulation experiments demonstrate that the proposed framework and algorithm exhibit outstanding performance in various aspects, providing robust support for future research in intelligent traffic offloading networks.
引用
收藏
页码:21312 / 21324
页数:13
相关论文
共 50 条
  • [1] Hierarchical pigeon inspired optimization based Multi-UAV obstacle avoidance control
    Wu, Hao
    Duan, Haibin
    AEROSPACE SCIENCE AND TECHNOLOGY, 2025, 159
  • [2] Multi-UAV Redeployment Optimization Based on Multi-Agent Deep Reinforcement Learning Oriented to Swarm Performance Restoration
    Wu, Qilong
    Geng, Zitao
    Ren, Yi
    Feng, Qiang
    Zhong, Jilong
    SENSORS, 2023, 23 (23)
  • [3] Three-Dimension Trajectory Design for Multi-UAV Wireless Network With Deep Reinforcement Learning
    Zhang, Wenqi
    Wang, Qiang
    Liu, Xiao
    Liu, Yuanwei
    Chen, Yue
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (01) : 600 - 612
  • [4] Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking
    Moon, Jiseon
    Papaioannou, Savvas
    Laoudias, Christos
    Kolios, Panayiotis
    Kim, Sunwoo
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (20) : 15441 - 15455
  • [5] Deep Reinforcement Learning Based Energy Efficient Multi-UAV Data Collection for IoT Networks
    Khodaparast, Seyed Saeed
    Lu, Xiao
    Wang, Ping
    Uyen Trang Nguyen
    IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2021, 2 : 249 - 260
  • [6] Joint optimization of communication and mission performance for multi-UAV collaboration network: A multi-agent reinforcement learning method
    He, Yuan
    Xie, Jun
    Hu, Guyu
    Liu, Yaqun
    Luo, Xijian
    AD HOC NETWORKS, 2024, 164
  • [7] An adaptive Q-learning based particle swarm optimization for multi-UAV path planning
    Tan L.
    Zhang H.
    Liu Y.
    Yuan T.
    Jiang X.
    Shang Z.
    Soft Computing, 2024, 28 (13-14) : 7931 - 7946
  • [8] Deep-Reinforcement-Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network
    Lin, Na
    Bai, Lu
    Hawbani, Ammar
    Guan, Yunchong
    Mao, Chaojin
    Liu, Zhi
    Zhao, Liang
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 17249 - 17263
  • [9] Toward Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches
    Bai, Yu
    Zhao, Hui
    Zhang, Xin
    Chang, Zheng
    Jantti, Riku
    Yang, Kun
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2023, 25 (04): : 3038 - 3067
  • [10] Dynamic Migration Scheme for Load Balancing and Average Delay Optimization in SDN-Based Multi-UAV Relay Network
    Pan, Wu
    Lv, Na
    IEEE ACCESS, 2023, 11 : 107404 - 107411