Deep Reinforcement Learning Based Trajectory Design and Resource Allocation for UAV-Assisted Communications

被引：5
|
作者：
Zhang, Chiya [1 ]
Li, Zhukun [1 ]
He, Chunlong [2 ]
Wang, Kezhi [3 ]
Pan, Cunhua [4 ]
机构：
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Shenzhen 518055, Peoples R China
[2] Shenzhen Univ, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[3] Brunel Univ London, Dept Comp Sci, London UB8 3PH, England
[4] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 211189, Peoples R China
来源：
IEEE COMMUNICATIONS LETTERS | 2023年 / 27卷 / 09期
基金：
中国国家自然科学基金;
关键词：
Unmanned aerial vehicles; deep reinforcement learning; 3-D trajectory design; uncertain flight time;
D O I：
10.1109/LCOMM.2023.3292816
中图分类号：
TN [电子技术、通信技术];
学科分类号：
0809 ;
摘要：
In this letter, we investigate the Unmanned Aerial Vehicles (UAVs)-assisted communications in three dimensional (3-D) environment, where one UAV is deployed to serve multiple user equipments (UEs). The locations and quality of service (QoS) requirement of the UEs are varying and the flying time of the UAV is unknown which depends on the battery of the UAVs. To address the issue, a proximal policy optimization 2 (PPO2)-based deep reinforcement learning (DRL) algorithm is proposed, which can control the UAV in an online manner. Specifically, it can allow the UAV to adjust its speed, direction and altitude so as to minimize the serving time of the UAV while satisfying the QoS requirement of the UEs. Simulation results are provided to demonstrate the effectiveness of the proposed framework.
引用
收藏
页码：2398 / 2402
页数：5
相关论文
共 50 条
  • [41] Learning Based Dynamic Resource Allocation in UAV-assisted Mobile Crowdsensing Networks
    Liu, Wenshuai
    Zhou, Yuzhi
    Fu, Yaru
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [42] Joint Resource Allocation and Learning Optimization for UAV-Assisted Federated Learning
    Liu, Chaoyi
    Zhu, Qi
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [43] Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning
    Qi, Huamei
    Zhou, Zheng
    APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [44] Layerwise Quantum Deep Reinforcement Learning for Joint Optimization of UAV Trajectory and Resource Allocation
    Silvirianti
    Narottama, Bhaskara
    Shin, Soo Young
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (01) : 430 - 443
  • [45] Bandwidth Allocation and Trajectory Control in UAV-Assisted IoV Edge Computing Using Multiagent Reinforcement Learning
    Wang, Juzhen
    Zhang, Xiaoli
    He, Xingshi
    Sun, Yongqiang
    IEEE TRANSACTIONS ON RELIABILITY, 2023, 72 (02) : 599 - 608
  • [46] Dynamic Cache Placement and Trajectory Design for UAV-Assisted Networks: A Two-Timescale Deep Reinforcement Learning Approach
    Liu, Binghong
    Liu, Chenxi
    Peng, Mugen
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5516 - 5530
  • [47] Resource Allocation and Trajectories Design for UAV-Assisted Jamming Cognitive UAV Networks
    Tao, Zhenhui
    Zhou, Fuhui
    Wang, Yuhao
    Liu, Xiaodong
    Wu, Qihui
    CHINA COMMUNICATIONS, 2022, 19 (05) : 206 - 217
  • [48] Trajectory Planning in UAV-Assisted Wireless Networks via Reinforcement Learning
    He, Simeng
    Zhang, Shangwei
    2022 IEEE 23RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE SWITCHING AND ROUTING (IEEE HPSR), 2022, : 232 - 237
  • [49] Resource Allocation and Trajectories Design for UAV-Assisted Jamming Cognitive UAV Networks
    Zhenhui Tao
    Fuhui Zhou
    Yuhao Wang
    Xiaodong Liu
    Qihui Wu
    China Communications, 2022, 19 (05) : 206 - 217
  • [50] Neural Combinatorial Deep Reinforcement Learning for Age-Optimal Joint Trajectory and Scheduling Design in UAV-Assisted Networks
    Ferdowsi, Aidin
    Abd-Elmagid, Mohamed A.
    Saad, Walid
    Dhillon, Harpreet S.
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (05) : 1250 - 1265
12345