Energy efficiency analysis of Drone Small Cells positioning based on reinforcement learning

被引:2
作者
dos Reis, Ana Flavia [1 ]
Brante, Glauber [1 ]
Parisotto, Rafaela [2 ]
Souza, Richard D. [2 ]
Klaine, Paulo H., V [3 ]
Battistella, Joao Pedro [3 ]
Imran, Muhammad A. [3 ]
机构
[1] Fed Univ Technol Parana UTFPR, Curitiba, Parana, Brazil
[2] Fed Univ Santa Catarina UFSC, Florianopolis, SC, Brazil
[3] Univ Glasgow, Glasgow, Lanark, Scotland
基金
英国工程与自然科学研究理事会;
关键词
drone small cells; energy efficiency; reinforcement learning;
D O I
10.1002/itl2.166
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
This work proposes an algorithm to optimize the positioning and the transmit power of Drone Small Cells (DSCs) based on Q-learning, a technique where the agents learn to maximize a given reward. We consider two different rewards in this work, the first focusing on coverage, while the second maximizes the lifetime. Then, the Q-learning solution determines the best positioning of the DSC in the 3D space, as well as the optimal transmit power. Results show that the optimization of the transmit power is of paramount importance to reduce the outage probability. In addition, we show that the second reward can considerably increase the network lifetime with a small penalty to the coverage.
引用
收藏
页数:6
相关论文
共 12 条
  • [1] Al-Hourani A, 2014, IEEE GLOB COMM CONF, P2898, DOI 10.1109/GLOCOM.2014.7037248
  • [2] 3-D Placement of an Unmanned Aerial Vehicle Base Station (UAV-BS) for Energy-Efficient Maximal Coverage
    Alzenad, Mohamed
    El-Keyi, Amr
    Lagum, Faraj
    Yanikomeroglu, Halim
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2017, 6 (04) : 434 - 437
  • [3] [Anonymous], 2003, SERIES-J SPAN ECON
  • [4] Interference Management for Cellular-Connected UAVs: A Deep Reinforcement Learning Approach
    Challita, Ursula
    Saad, Walid
    Bettstetter, Christian
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (04) : 2125 - 2140
  • [5] UAVs as Mobile Infrastructure: Addressing Battery Lifetime
    Galkin, Boris
    Kibilda, Jacek
    DaSilva, Luiz A.
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (06) : 132 - 137
  • [6] Distributed Drone Base Station Positioning for Emergency Cellular Networks Using Reinforcement Learning
    Klaine, Paulo V.
    Nadas, Joao P. B.
    Souza, Richard D.
    Imran, Muhammad A.
    [J]. COGNITIVE COMPUTATION, 2018, 10 (05) : 790 - 804
  • [7] Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs
    Mozaffari, Mohammad
    Saad, Walid
    Bennis, Mehdi
    Debbah, Merouane
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2016, 15 (06) : 3949 - 3963
  • [8] Parisotto RD, 2019, INT SYM WIRELESS COM, P213, DOI [10.1109/iswcs.2019.8877247, 10.1109/ISWCS.2019.8877247]
  • [9] Multi-UAV Dynamic Wireless Networking With Deep Reinforcement Learning
    Wang, Qiang
    Zhang, Wenqi
    Liu, Yuanwei
    Liu, Ying
    [J]. IEEE COMMUNICATIONS LETTERS, 2019, 23 (12) : 2243 - 2246
  • [10] Energy Minimization for Wireless Communication With Rotary-Wing UAV
    Zeng, Yong
    Xu, Jie
    Zhang, Rui
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (04) : 2329 - 2345