Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

被引:5
作者
Li, Fengqi [1 ,2 ]
Zhang, Kaiyang [1 ,2 ]
Wang, Jiaheng [1 ,2 ]
Li, Yudong [1 ,2 ]
Xu, Fengqiang [1 ,2 ]
Wang, Yanjuan [3 ,4 ]
Tong, Ning [1 ,2 ]
机构
[1] Dalian Jiaotong Univ, Sch Software, Dalian, Peoples R China
[2] Dalian Jiaotong Univ, Dalian Key Lab Blockchain Technol & Applicat, Dalian 116028, Peoples R China
[3] Dalian Jiaotong Univ, Software Inst, Dalian, Peoples R China
[4] Yunnan Univ Finance & Econ, Yunnan Key Lab Serv Comp, Kunming 650221, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 12期
关键词
Deep federated learning (DFL); Markov decision process (MDP); traffic offloading; unmanned aerial vehicle (UAV); DEPLOYMENT;
D O I
10.1109/JIOT.2024.3363188
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the exponential growth in mobile data volume, cellular networks are under severe capacity pressure. To address this issue, unmanned aerial vehicles (UAVs) are being used as mobile base stations (BSs) for traffic offloading. However, coordinating and scheduling traffic across multiple UAVs and BSs remains a challenge in complex environments. This article proposes a solution that optimizes UAV deployment locations and user resource allocation, the goal is to maximize traffic offloading and minimize UAV energy consumption simultaneously. We introduce a hierarchical intelligent traffic offloading network optimization framework based on deep federated learning (DFL). Through federated learning, the UAV swarm is organized hierarchically. Additionally, we developed the CPRAFT algorithm, which uses capacity values as criterion to select the leader UAV (L-UAV). The L-UAV then becomes the top-level central server for model aggregation in the federated learning environment. Furthermore, we formalize the traffic offloading problem as a Markov decision process (MDP). Based on MDP, this article proposes an FL-SNTD3 algorithm to optimize dynamic decision making, which adapts to the ever-changing network environment and fluctuating traffic demands. Simulation experiments demonstrate that the proposed framework and algorithm exhibit outstanding performance in various aspects, providing robust support for future research in intelligent traffic offloading networks.
引用
收藏
页码:21312 / 21324
页数:13
相关论文
共 50 条
  • [41] A modified consensus algorithm for multi-UAV formations based on pigeon-inspired optimization with a slow diving strategy
    ZHANG Tianjie
    DUAN Haibin
    智能系统学报, 2017, 12 (04) : 570 - 581
  • [42] Multi-Agent Deep Reinforcement Learning for Joint Decoupled User Association and Trajectory Design in Full-Duplex Multi-UAV Networks
    Dai, Chen
    Zhu, Kun
    Hossain, Ekram
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (10) : 6056 - 6070
  • [43] Learning-Based User Association in Multi-UAV Emergency Networks with Ground D2D
    Cheng, Fen
    Li, Dongdong
    Jiang, Fan
    Zhao, Nan
    2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2019,
  • [44] Multi-UAV Trajectory Planning for Energy-Efficient Content Coverage: A Decentralized Learning-Based Approach
    Zhao, Chenxi
    Liu, Junyu
    Sheng, Min
    Teng, Wei
    Zheng, Yang
    Li, Jiandong
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (10) : 3193 - 3207
  • [45] Capability-Oriented Decision-Making in Multi-UAV Deployment and Task Allocation: A Hierarchical Game-Based Framework
    Hai, Xingshuo
    Feng, Qiang
    Chen, Weike
    Wen, Changyun
    Khong, Andy W. H.
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025,
  • [46] Secure Offloading With Adversarial Multi-Agent Reinforcement Learning Against Intelligent Eavesdroppers in UAV-Enabled Mobile Edge Computing
    Li, Xulong
    Wei, Huangfu
    Xu, Xinyi
    Huo, Jiahao
    Long, Keping
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 13914 - 13928
  • [47] Optimization for Master-UAV-Powered Auxiliary-Aerial-IRS-Assisted IoT Networks: An Option-Based Multi-Agent Hierarchical Deep Reinforcement Learning Approach
    Xu, Jingren
    Kang, Xin
    Zhang, Ronghaixiang
    Liang, Ying-Chang
    Sun, Sumei
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (22): : 22887 - 22902
  • [48] Blockchain-Based Trusted Traffic Offloading in Space-Air-Ground Integrated Networks (SAGIN): A Federated Reinforcement Learning Approach
    Tang, Fengxiao
    Wen, Cong
    Luo, Linfeng
    Zhao, Ming
    Kato, Nei
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (12) : 3501 - 3516
  • [49] Urban Traffic Density Estimation Based on Ultrahigh-Resolution UAV Video and Deep Neural Network
    Zhu, Jiasong
    Sun, Ke
    Jia, Sen
    Li, Qingquan
    Hou, Xianxu
    Lin, Weidong
    Liu, Bozhi
    Qiu, Guoping
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (12) : 4968 - 4981
  • [50] Traffic Offloading in Two-Tier Multi-Mode Small Cell Networks over Unlicensed Bands: A Hierarchical Learning Framework
    Sun, Youming
    Shao, Hongxiang
    Liu, Xin
    Zhang, Jian
    Qiu, Junfei
    Xu, Yuhua
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2015, 9 (11): : 4291 - 4310