Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

被引:5
作者
Li, Fengqi [1 ,2 ]
Zhang, Kaiyang [1 ,2 ]
Wang, Jiaheng [1 ,2 ]
Li, Yudong [1 ,2 ]
Xu, Fengqiang [1 ,2 ]
Wang, Yanjuan [3 ,4 ]
Tong, Ning [1 ,2 ]
机构
[1] Dalian Jiaotong Univ, Sch Software, Dalian, Peoples R China
[2] Dalian Jiaotong Univ, Dalian Key Lab Blockchain Technol & Applicat, Dalian 116028, Peoples R China
[3] Dalian Jiaotong Univ, Software Inst, Dalian, Peoples R China
[4] Yunnan Univ Finance & Econ, Yunnan Key Lab Serv Comp, Kunming 650221, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 12期
关键词
Deep federated learning (DFL); Markov decision process (MDP); traffic offloading; unmanned aerial vehicle (UAV); DEPLOYMENT;
D O I
10.1109/JIOT.2024.3363188
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the exponential growth in mobile data volume, cellular networks are under severe capacity pressure. To address this issue, unmanned aerial vehicles (UAVs) are being used as mobile base stations (BSs) for traffic offloading. However, coordinating and scheduling traffic across multiple UAVs and BSs remains a challenge in complex environments. This article proposes a solution that optimizes UAV deployment locations and user resource allocation, the goal is to maximize traffic offloading and minimize UAV energy consumption simultaneously. We introduce a hierarchical intelligent traffic offloading network optimization framework based on deep federated learning (DFL). Through federated learning, the UAV swarm is organized hierarchically. Additionally, we developed the CPRAFT algorithm, which uses capacity values as criterion to select the leader UAV (L-UAV). The L-UAV then becomes the top-level central server for model aggregation in the federated learning environment. Furthermore, we formalize the traffic offloading problem as a Markov decision process (MDP). Based on MDP, this article proposes an FL-SNTD3 algorithm to optimize dynamic decision making, which adapts to the ever-changing network environment and fluctuating traffic demands. Simulation experiments demonstrate that the proposed framework and algorithm exhibit outstanding performance in various aspects, providing robust support for future research in intelligent traffic offloading networks.
引用
收藏
页码:21312 / 21324
页数:13
相关论文
共 50 条
  • [21] Cooperative Multiagent Deep Reinforcement Learning for Reliable Surveillance via Autonomous Multi-UAV Control
    Yun, Won Joon
    Park, Soohyun
    Kim, Joongheon
    Shin, MyungJae
    Jung, Soyi
    Mohaisen, David A.
    Kim, Jae-Hyun
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (10) : 7086 - 7096
  • [22] Energy-Efficient Computing Offloading Based on Multi-UAV Dispatch via NOMA in Emergency Communication Networks
    Xiangrui Guan
    Jianbin Xue
    Wireless Personal Communications, 2023, 133 : 199 - 226
  • [23] Energy-Efficient Computing Offloading Based on Multi-UAV Dispatch via NOMA in Emergency Communication Networks
    Guan, Xiangrui
    Xue, Jianbin
    WIRELESS PERSONAL COMMUNICATIONS, 2023, 133 (01) : 199 - 226
  • [24] Cooperative Multi-UAV Positioning for Aerial Internet Service Management: A Multi-Agent Deep Reinforcement Learning Approach
    Kim, Joongheon
    Park, Soohyun
    Jung, Soyi
    Cordeiro, Carlos
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (04): : 3797 - 3812
  • [25] Differentiated Federated Reinforcement Learning Based Traffic Offloading on Space-Air-Ground Integrated Networks
    Qin, Yeguang
    Yang, Yilin
    Tang, Fengxiao
    Yao, Xin
    Zhao, Ming
    Kato, Nei
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 11000 - 11013
  • [26] Multi-UAV obstacle avoidance control via multi-objective social learning pigeon-inspired optimization
    Ruan, Wan-ying
    Duan, Hai-bin
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2020, 21 (05) : 740 - 748
  • [27] Multi-UAV Cooperative Searching and Tracking for Moving Targets Based on Multi-Agent Reinforcement Learning
    Su, Kai
    Qian, Feng
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [28] Secure Video Offloading in Multi-UAV-Enabled MEC Networks: A Deep Reinforcement Learning Approach
    Zhao, Tantan
    Li, Fan
    He, Lijun
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (02) : 2950 - 2963
  • [29] Multi-UAV Relay Connectivity Optimization for Heterogeneous Users Based on Load Balancing and Throughput Maximization
    Pan, Wu
    Lv, Na
    IEEE ACCESS, 2023, 11 : 38944 - 38956
  • [30] Path Planning for Multi-UAV Formation Rendezvous Based on Distributed Cooperative Particle Swarm Optimization
    Shao, Zhuang
    Yan, Fei
    Zhou, Zhou
    Zhu, Xiaoping
    APPLIED SCIENCES-BASEL, 2019, 9 (13):