Intelligent Trajectory Planning in UAV-Mounted Wireless Networks: A Quantum-Inspired Reinforcement Learning Perspective

被引:31
|
作者
Li, Yuanjian [1 ]
Aghvami, A. Hamid [1 ]
Dong, Daoyi [2 ]
机构
[1] Kings Coll London, Ctr Telecommun Res, London WC2R 2LS, England
[2] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2600, Australia
关键词
UAV; trajectory planning; quantum computation; quantum-inspired reinforcement learning (QiRL); DESIGN;
D O I
10.1109/LWC.2021.3089876
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we consider a wireless uplink transmission scenario in which an unmanned aerial vehicle (UAV) serves as an aerial base station collecting data from ground users. To optimize the expected sum uplink transmit rate without any prior knowledge of ground users (e.g., locations, channel state information and transmit power), the trajectory planning problem is optimized via the quantum-inspired reinforcement learning (QiRL) approach. Specifically, the QiRL method adopts novel probabilistic action selection policy and new reinforcement strategy, which are inspired by the collapse phenomenon and amplitude amplification in quantum computation theory, respectively. Numerical results demonstrate that the proposed QiRL solution can offer natural balancing between exploration and exploitation via ranking collapse probabilities of possible actions, compared to the traditional reinforcement learning approaches that are highly dependent on tuned exploration parameters.
引用
收藏
页码:1994 / 1998
页数:5
相关论文
共 50 条
  • [41] Intelligent Land-Vehicle Model Transfer Trajectory Planning Method Based on Deep Reinforcement Learning
    Yu, Lingli
    Shao, Xuanya
    Wei, Yadong
    Zhou, Kaijun
    SENSORS, 2018, 18 (09)
  • [42] Multi-Agent Deep Reinforcement Learning-Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing
    Wang, Liang
    Wang, Kezhi
    Pan, Cunhua
    Xu, Wei
    Aslam, Nauman
    Hanzo, Lajos
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (01) : 73 - 84
  • [43] AoI-Minimal Trajectory Planning and Data Collection in UAV-Assisted Wireless Powered IoT Networks
    Hu, Huimin
    Xiong, Ke
    Qu, Gang
    Ni, Qiang
    Fan, Pingyi
    Ben Letaief, Khaled
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (02) : 1211 - 1223
  • [44] Reinforcement Learning and Trajectory Planning based on Model Approximation with Neural Networks applied to Transition Problems
    Pritzkoleit, Max
    Knoll, Carsten
    Roebenack, Klaus
    IFAC PAPERSONLINE, 2020, 53 (02): : 1581 - 1587
  • [45] Trajectory Control in Self-sustainable UAV-aided mmWave Networks: A Constrained Multi-agent Reinforcement Learning Approach
    Chen, Wei
    Chang, Deng-Kai
    Chen, Yu-Jia
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 1017 - 1022
  • [46] Joint AoI-Aware UAVs Trajectory Planning and Data Collection in UAV-Based IoT Systems: A Deep Reinforcement Learning Approach
    Xiao, Xiongbing
    Wang, Xiumin
    Lin, Weiwei
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (04) : 6484 - 6495
  • [47] Task Offloading and Trajectory Optimization in UAV Networks: A Deep Reinforcement Learning Method Based on SAC and A-Star
    Liu, Jianhua
    Xie, Peng
    Liu, Jiajia
    Tu, Xiaoguang
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 141 (02): : 1243 - 1273
  • [48] UAV Enhanced Target-Barrier Coverage Algorithm for Wireless Sensor Networks Based on Reinforcement Learning
    Li, Li
    Chen, Hongbin
    SENSORS, 2022, 22 (17)
  • [49] Model-aided Deep Reinforcement Learning for Sample-efficient UAV Trajectory Design in IoT Networks
    Esrafilian, Omid
    Bayerlein, Harald
    Gesbert, David
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [50] Intelligent Vehicle Decision-Making and Trajectory Planning Method Based on Deep Reinforcement Learning in the Frenet Space
    Wang, Jiawei
    Chu, Liang
    Zhang, Yao
    Mao, Yabin
    Guo, Chong
    SENSORS, 2023, 23 (24)