Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

被引:5
作者
Li, Fengqi [1 ,2 ]
Zhang, Kaiyang [1 ,2 ]
Wang, Jiaheng [1 ,2 ]
Li, Yudong [1 ,2 ]
Xu, Fengqiang [1 ,2 ]
Wang, Yanjuan [3 ,4 ]
Tong, Ning [1 ,2 ]
机构
[1] Dalian Jiaotong Univ, Sch Software, Dalian, Peoples R China
[2] Dalian Jiaotong Univ, Dalian Key Lab Blockchain Technol & Applicat, Dalian 116028, Peoples R China
[3] Dalian Jiaotong Univ, Software Inst, Dalian, Peoples R China
[4] Yunnan Univ Finance & Econ, Yunnan Key Lab Serv Comp, Kunming 650221, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 12期
关键词
Deep federated learning (DFL); Markov decision process (MDP); traffic offloading; unmanned aerial vehicle (UAV); DEPLOYMENT;
D O I
10.1109/JIOT.2024.3363188
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the exponential growth in mobile data volume, cellular networks are under severe capacity pressure. To address this issue, unmanned aerial vehicles (UAVs) are being used as mobile base stations (BSs) for traffic offloading. However, coordinating and scheduling traffic across multiple UAVs and BSs remains a challenge in complex environments. This article proposes a solution that optimizes UAV deployment locations and user resource allocation, the goal is to maximize traffic offloading and minimize UAV energy consumption simultaneously. We introduce a hierarchical intelligent traffic offloading network optimization framework based on deep federated learning (DFL). Through federated learning, the UAV swarm is organized hierarchically. Additionally, we developed the CPRAFT algorithm, which uses capacity values as criterion to select the leader UAV (L-UAV). The L-UAV then becomes the top-level central server for model aggregation in the federated learning environment. Furthermore, we formalize the traffic offloading problem as a Markov decision process (MDP). Based on MDP, this article proposes an FL-SNTD3 algorithm to optimize dynamic decision making, which adapts to the ever-changing network environment and fluctuating traffic demands. Simulation experiments demonstrate that the proposed framework and algorithm exhibit outstanding performance in various aspects, providing robust support for future research in intelligent traffic offloading networks.
引用
收藏
页码:21312 / 21324
页数:13
相关论文
共 50 条
  • [31] Multi-UAV obstacle avoidance control via multi-objective social learning pigeon-inspired optimization
    Wan-ying Ruan
    Hai-bin Duan
    Frontiers of Information Technology & Electronic Engineering, 2020, 21 : 740 - 748
  • [32] Deep Learning Empowered Traffic Offloading in Intelligent Software Defined Cellular V2X Networks
    Fan, Bo
    He, Zhengbing
    Wu, Yuan
    He, Jia
    Chen, Yanyan
    Jiang, Li
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) : 13328 - 13340
  • [33] A Joint Strategy for CUAV-based Traffic Offloading via Deep Reinforcement Learning
    Li, Xuanheng
    Cheng, Sike
    Zhao, Nan
    Yao, Nianmin
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [34] Edge Computing Task Offloading Optimization for a UAV-Assisted Internet of Vehicles via Deep Reinforcement Learning
    Yan, Ming
    Xiong, Rui
    Wang, Yan
    Li, Chunguo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5647 - 5658
  • [35] Joint AP Selection and Task Offloading Based on Deep Reinforcement Learning for Urban-Micro Cell-Free UAV Network
    Pan, Chunyu
    Wang, Jincheng
    Yue, Xinwei
    Guo, Linyan
    Yang, Zhaohui
    ELECTRONICS, 2023, 12 (23)
  • [36] Distributed Energy-Efficient Multi-UAV Navigation for Long-Term Communication Coverage by Deep Reinforcement Learning
    Liu, Chi Harold
    Ma, Xiaoxin
    Gao, Xudong
    Tang, Jian
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (06) : 1274 - 1285
  • [37] Infrastructure-Assisted Cooperative Multi-UAV Deep Reinforcement Energy Trading Learning for Big-Data Processing
    Jung, Soyi
    Yun, Won Joon
    Kim, Joongheon
    Kim, Jae-Hyun
    35TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2021), 2021, : 159 - 162
  • [38] A Deep Reinforcement Learning-Based Dynamic Traffic Offloading in Space-Air-Ground Integrated Networks (SAGIN)
    Tang, Fengxiao
    Hofner, Hans
    Kato, Nei
    Kaneko, Kazuma
    Yamashita, Yasutaka
    Hangai, Masatake
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (01) : 276 - 289
  • [39] MO-AVC: Deep-Reinforcement-Learning-Based Trajectory Control and Task Offloading in Multi-UAV-Enabled MEC Systems
    Gao, Zhen
    Yang, Lei
    Dai, Yu
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (07) : 11395 - 11414
  • [40] Cooperative Data Sensing and Computation Offloading in UAV-Assisted Crowdsensing With Multi-Agent Deep Reinforcement Learning
    Cai, Ting
    Yang, Zhihua
    Chen, Yufei
    Chen, Wuhui
    Zheng, Zibin
    Yu, Yang
    Dai, Hong-Ning
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (05): : 3197 - 3211