Intelligent Trajectory Planning in UAV-Mounted Wireless Networks: A Quantum-Inspired Reinforcement Learning Perspective

被引:31
|
作者
Li, Yuanjian [1 ]
Aghvami, A. Hamid [1 ]
Dong, Daoyi [2 ]
机构
[1] Kings Coll London, Ctr Telecommun Res, London WC2R 2LS, England
[2] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2600, Australia
关键词
UAV; trajectory planning; quantum computation; quantum-inspired reinforcement learning (QiRL); DESIGN;
D O I
10.1109/LWC.2021.3089876
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we consider a wireless uplink transmission scenario in which an unmanned aerial vehicle (UAV) serves as an aerial base station collecting data from ground users. To optimize the expected sum uplink transmit rate without any prior knowledge of ground users (e.g., locations, channel state information and transmit power), the trajectory planning problem is optimized via the quantum-inspired reinforcement learning (QiRL) approach. Specifically, the QiRL method adopts novel probabilistic action selection policy and new reinforcement strategy, which are inspired by the collapse phenomenon and amplitude amplification in quantum computation theory, respectively. Numerical results demonstrate that the proposed QiRL solution can offer natural balancing between exploration and exploitation via ranking collapse probabilities of possible actions, compared to the traditional reinforcement learning approaches that are highly dependent on tuned exploration parameters.
引用
收藏
页码:1994 / 1998
页数:5
相关论文
共 50 条
  • [1] Trajectory Planning in UAV-Assisted Wireless Networks via Reinforcement Learning
    He, Simeng
    Zhang, Shangwei
    2022 IEEE 23RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE SWITCHING AND ROUTING (IEEE HPSR), 2022, : 232 - 237
  • [2] UAV Trajectory Planning in Wireless Sensor Networks for Energy Consumption Minimization by Deep Reinforcement Learning
    Zhu, Botao
    Bedeer, Ebrahim
    Nguyen, Ha H.
    Barton, Robert
    Henry, Jerome
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (09) : 9540 - 9554
  • [3] UAV-Mounted Intelligent Reflecting Surface in Maritime Wireless Powered Communication Network
    Yuan, Liu
    Han, Fengxia
    Zhao, Shengjie
    CHINA COMMUNICATIONS, 2025, 22 (03) : 254 - 269
  • [4] Priority-aware path planning and user scheduling for UAV-mounted MEC networks: A deep reinforcement learning approach
    Zheng, Xiangdong
    Wu, Yuxin
    Zhang, Lianhong
    Tang, Maobin
    Zhu, Fusheng
    PHYSICAL COMMUNICATION, 2024, 62
  • [5] Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks
    Luo, Xiaoling
    Chen, Che
    Zeng, Chunnian
    Li, Chengtao
    Xu, Jing
    Gong, Shimin
    SENSORS, 2023, 23 (10)
  • [6] Deep Reinforcement Learning With Quantum-Inspired Experience Replay
    Wei, Qing
    Ma, Hailan
    Chen, Chunlin
    Dong, Daoyi
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (09) : 9326 - 9338
  • [7] Deep Reinforcement Learning for Real-Time Trajectory Planning in UAV Networks
    Li, Kai
    Ni, Wei
    Tovar, Eduardo
    Guizani, Mohsen
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 958 - 963
  • [8] Reinforcement Learning-Based Collision Avoidance and Optimal Trajectory Planning in UAV Communication Networks
    Hsu, Yu-Hsin
    Gau, Rung-Hung
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (01) : 306 - 320
  • [9] A Quantum Inspired Reinforcement Learning Technique for Beyond Next Generation Wireless Networks
    Nuuman, Sinan
    Grace, David
    Clarke, Tim
    2015 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), 2015, : 271 - 275
  • [10] Bayesian Optimization Enhanced Deep Reinforcement Learning for Trajectory Planning and Network Formation in Multi-UAV Networks
    Gong, Shimin
    Wang, Meng
    Gu, Bo
    Zhang, Wenjie
    Dinh Thai Hoang
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10933 - 10948