Prioritized User Association for Sum-Rate Maximization in UAV-Assisted Emergency Communication: A Reinforcement Learning Approach

被引:17
作者
Siddiqui, Abdul Basit [1 ]
Aqeel, Iraj [1 ]
Alkhayyat, Ahmed [2 ]
Javed, Umer [1 ]
Kaleem, Zeeshan [1 ]
机构
[1] COMSATS Univ Islamabad, Dept Elect & Comp Engn, Wah Campus, Islamabad 47040, Pakistan
[2] Islamic Univ, Coll Tech Engn, Najaf 54001, Iraq
关键词
aerial base station; reinforcement learning; k-means clustering; line of sight; non line of sight; UNMANNED AERIAL VEHICLES; RESOURCE-ALLOCATION; PLACEMENT; ALTITUDE;
D O I
10.3390/drones6020045
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Unmanned air vehicles (UAVs) used as aerial base stations (ABSs) can provide communication services in areas where cellular network is not functional due to a calamity. ABSs provide high coverage and high data rates to the user because of the advantage of a high altitude. ABSs can be static or mobile; they can adjust their position according to real-time location of ground user and maintain a good line-of-sight link with ground users. In this paper, a reinforcement learning framework is proposed to maximize the number of served users by optimizing the ABS 3D location and power. We also design a reward function that prioritize the emergency users to establish a connection with the ABS using Q-learning. Simulation results reveal that the proposed scheme clearly outperforms the baseline schemes.
引用
收藏
页数:15
相关论文
共 25 条
  • [1] Sum-Rate Maximization for IRS-Assisted UAV OFDMA Communication Systems
    Wei, Zhiqiang
    Cai, Yuanxin
    Sun, Zhuo
    Ng, Derrick Wing Kwan
    Yuan, Jinhong
    Zhou, Mingyu
    Sun, Lixin
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) : 2530 - 2550
  • [2] Sum-Rate Maximization for UAV-Assisted Visible Light Communications Using NOMA: Swarm Intelligence Meets Machine Learning
    Quoc-Viet Pham
    Thien Huynh-The
    Alazab, Mamoun
    Zhao, Jun
    Hwang, Won-Joo
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10): : 10375 - 10387
  • [3] Reinforcement Learning for Energy-Efficient User Association in UAV-Assisted Cellular Networks
    Kaleem, Zeeshan
    Khalid, Waqas
    Ahmad, Ayaz
    Yu, Heejung
    Almasoud, Abdullah M.
    Yuen, Chau
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (02) : 2474 - 2481
  • [4] Energy Efficiency Maximization for UAV-Assisted Emergency Communication Networks
    Niu, Haibin
    Zhao, Xinyu
    Hou, Liming
    Ma, Dongjun
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [5] Energy efficiency maximization for WPT-enabled UAV-assisted emergency communication with user mobility
    Sun, Jie
    Sheng, Zhichao
    Nasir, Ali Arshad
    Huang, Zhiyu
    Yu, Hongwen
    Fang, Yong
    PHYSICAL COMMUNICATION, 2023, 61
  • [6] Deep Reinforcement Learning for UAV-Assisted Emergency Response
    Lee, Isabella
    Babu, Vignesh
    Caesar, Matthew
    Nicol, David
    PROCEEDINGS OF THE 17TH EAI INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING AND SERVICES (MOBIQUITOUS 2020), 2021, : 327 - 336
  • [7] Digital twin based DDPG reinforcement learning for sum-rate maximization of AI-UAV communications
    Lee, Jeongyoon
    Park, Taeje
    Sung, Wonjin
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2024, 2024 (01)
  • [8] Resource management for sum-rate maximization in SCMA-assisted UAV system
    Chaturvedi, Saumya
    Bohara, Vivek Ashok
    Liu, Zilong
    Srivastava, Anand
    Xiao, Pei
    VEHICULAR COMMUNICATIONS, 2024, 45
  • [9] Active Inference for Sum Rate Maximization in UAV-Assisted Cognitive NOMA Networks
    Obite, Felix
    Krayani, Ali
    Alam, Atm S.
    Marcenaro, Lucio
    Nallanathan, Arumugam
    Regazzoni, Carlo
    2023 IEEE 9TH WORLD FORUM ON INTERNET OF THINGS, WF-IOT, 2023,
  • [10] UAV-assisted Semantic Communication with Hybrid Action Reinforcement Learning
    Si, Peiyuan
    Zhao, Jun
    Lam, Kwok-Yan
    Yang, Qing
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 3801 - 3806