Intelligent Trajectory Planning in UAV-Mounted Wireless Networks: A Quantum-Inspired Reinforcement Learning Perspective

被引:31
|
作者
Li, Yuanjian [1 ]
Aghvami, A. Hamid [1 ]
Dong, Daoyi [2 ]
机构
[1] Kings Coll London, Ctr Telecommun Res, London WC2R 2LS, England
[2] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2600, Australia
关键词
UAV; trajectory planning; quantum computation; quantum-inspired reinforcement learning (QiRL); DESIGN;
D O I
10.1109/LWC.2021.3089876
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we consider a wireless uplink transmission scenario in which an unmanned aerial vehicle (UAV) serves as an aerial base station collecting data from ground users. To optimize the expected sum uplink transmit rate without any prior knowledge of ground users (e.g., locations, channel state information and transmit power), the trajectory planning problem is optimized via the quantum-inspired reinforcement learning (QiRL) approach. Specifically, the QiRL method adopts novel probabilistic action selection policy and new reinforcement strategy, which are inspired by the collapse phenomenon and amplitude amplification in quantum computation theory, respectively. Numerical results demonstrate that the proposed QiRL solution can offer natural balancing between exploration and exploitation via ranking collapse probabilities of possible actions, compared to the traditional reinforcement learning approaches that are highly dependent on tuned exploration parameters.
引用
收藏
页码:1994 / 1998
页数:5
相关论文
共 50 条
  • [21] A Deep Reinforcement Learning Algorithm for Trajectory Planning of Swarm UAV Fulfilling Wildfire Reconnaissance
    Demir, Kubilay
    Tumen, Vedat
    Kosunalp, Selahattin
    Iliev, Teodor
    ELECTRONICS, 2024, 13 (13)
  • [22] Deep Reinforcement Learning-Based Joint Sequence Scheduling and Trajectory Planning in Wireless Rechargeable Sensor Networks
    Jiang, Chengpeng
    Chen, Wencong
    Wang, Ziyang
    Xiao, Wendong
    IEEE SENSORS JOURNAL, 2024, 24 (08) : 13699 - 13711
  • [23] Trajectory Planning of Multiple Dronecells in Vehicular Networks: A Reinforcement Learning Approach
    Samir, Moataz
    Ebrahimi, Dariush
    Assi, Chadi
    Sharafeddine, Sanaa
    Ghrayeb, Ali
    IEEE Networking Letters, 2020, 2 (01): : 14 - 18
  • [24] Decentralized Trajectory and Power Control Based on Multi-Agent Deep Reinforcement Learning in UAV Networks
    Chen, Binqiang
    Liu, Dong
    Hanzo, Lajos
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 3983 - 3988
  • [25] Resource Allocation in UAV-Assisted Wireless Networks Using Reinforcement Learning
    Luong, Phuong
    Gagnon, Francois
    Labeau, Fabrice
    2020 IEEE 92ND VEHICULAR TECHNOLOGY CONFERENCE (VTC2020-FALL), 2020,
  • [26] Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach
    Wu, Qianqian
    Liu, Qiang
    Wu, Zefan
    Zhang, Jiye
    FUTURE INTERNET, 2023, 15 (11)
  • [27] Multi-UAV Path Planning for Wireless Data Harvesting With Deep Reinforcement Learning
    Bayerlein, Harald
    Theile, Mirco
    Caccamo, Marco
    Gesbert, David
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2021, 2 : 1171 - 1187
  • [28] Exploiting Deep Reinforcement Learning for Stochastic AoI Minimization in Multi-UAV-assisted Wireless Networks
    Long, Yusi
    Zhuang, Jialin
    Gong, Shimin
    Gu, Bo
    Xu, Jing
    Deng, Jing
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [29] Hybrid energy-Efficient distributed aided frog leaping dynamic A* with reinforcement learning for enhanced trajectory planning in UAV swarms large-scale networks
    Jebi, R. Christal
    Baulkani, S.
    Femila, L.
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (24)
  • [30] Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches
    Chang, Zheng
    Deng, Hengwei
    You, Li
    Min, Geyong
    Garg, Sahil
    Kaddoum, Georges
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (05): : 2940 - 2951