Reinforcement Learning for Energy-Efficient User Association in UAV-Assisted Cellular Networks

被引:5
作者
Kaleem, Zeeshan [1 ]
Khalid, Waqas [2 ]
Ahmad, Ayaz [1 ]
Yu, Heejung [3 ]
Almasoud, Abdullah M. [4 ]
Yuen, Chau [5 ]
机构
[1] COMSATS Univ Islamabad, Dept Elect & Comp Engn, Wah Campus, Wah Cantt 47040, Pakistan
[2] Korea Univ, Inst Ind Technol, Sejong 30019, South Korea
[3] Korea Univ, Dept Elect & Informat Engn, Sejong 30019, South Korea
[4] Prince Sattam Bin Abdulaziz Univ, Dept Elect Engn, Al Kharj 11942, Saudi Arabia
[5] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
新加坡国家研究基金会;
关键词
Energy efficiency; Autonomous aerial vehicles; Resource management; Quality of service; Base stations; Simulation; Optimization; Cellular networks; energy efficiency; reinforcement learning (RL); unmanned aerial vehicles (UAVs); user association (UA); RESOURCE-ALLOCATION; POWER ALLOCATION; PLACEMENT; DEPLOYMENT;
D O I
10.1109/TAES.2024.3353724
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
In unmanned aerial vehicle (UAV)-assisted communications, there are two significant challenges that need to be addressed-optimized UAV placement and energy-efficient user association. These challenges are crucial in meeting the quality-of-service requirements of users. To overcome these challenges, a reinforcement-learning-based intelligent solution is proposed along with a reward function that associates users with UAVs in an intelligent manner. This solution aims to improve the system's sum rate performance by consuming less energy. Simulation results are presented to demonstrate the effectiveness of the proposed approach. The results indicate that the proposed approach is more energy efficient than the benchmark scheme while improving the system's sum rate.
引用
收藏
页码:2474 / 2481
页数:8
相关论文
共 25 条
[1]   Optimal LAP Altitude for Maximum Coverage [J].
Al-Hourani, Akram ;
Kandeepan, Sithamparanathan ;
Lardner, Simon .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2014, 3 (06) :569-572
[2]   3-D Placement of an Unmanned Aerial Vehicle Base Station for Maximum Coverage of Users With Different QoS Requirements [J].
Alzenad, Mohamed ;
El-Keyi, Amr ;
Yanikomeroglu, Halim .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2018, 7 (01) :38-41
[3]   Reinforcement Learning for Energy-Efficient Trajectory Design of UAVs [J].
Arani, Atefeh Hajijamali ;
Azari, M. Mahdi ;
Hu, Peng ;
Zhu, Yeying ;
Yanikomeroglu, Halim ;
Safavi-Naeini, Safieddin .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (11) :9060-9070
[4]   AI-Assisted MAC for Reconfigurable Intelligent-Surface-Aided Wireless Networks: Challenges and Opportunities [J].
Cao, Xuelin ;
Yang, Bo ;
Huang, Chongwen ;
Yuen, Chau ;
Di Renzo, Marco ;
Han, Zhu ;
Niyato, Dusit ;
Poor, H. Vincent ;
Hanzo, Lajos .
IEEE COMMUNICATIONS MAGAZINE, 2021, 59 (06) :21-27
[5]   Neural Combinatorial Deep Reinforcement Learning for Age-Optimal Joint Trajectory and Scheduling Design in UAV-Assisted Networks [J].
Ferdowsi, Aidin ;
Abd-Elmagid, Mohamed A. ;
Saad, Walid ;
Dhillon, Harpreet S. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (05) :1250-1265
[6]   UAV Trajectory, User Association, and Power Control for Multi-UAV-Enabled Energy-Harvesting Communications: Offline Design and Online Reinforcement Learning [J].
Fu, Chien-Wei ;
Ku, Meng-Lin ;
Chen, Yu-Jia ;
Quek, Tony Q. S. .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (06) :9781-9800
[7]   Machine-Learning-Based UAV-Assisted Agricultural Information Security Architecture and Intrusion Detection [J].
Fu, Rui ;
Ren, Xiaojun ;
Li, Ye ;
Wu, Yongtang ;
Sun, Hao ;
Al-Absi, Mohammed Abdulhakim .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (21) :18589-18598
[8]  
Guan X, 2020, CHINA COMMUN, V17, P110, DOI 10.23919/JCC.2020.12.008
[9]   Enhanced Max-Min Rate of Users in UAV-Assisted Emergency Networks Using Reinforcement Learning [J].
Kaleem, Zeeshan ;
Ahmad, Ayaz ;
Chughtai, Omer ;
Rodrigues, Joel J. P. C. .
IEEE Networking Letters, 2022, 4 (03) :104-107
[10]   Learning-Aided UAV 3D Placement and Power Allocation for Sum-Capacity Enhancement Under Varying Altitudes [J].
Kaleem, Zeeshan ;
Khalid, Waqas ;
Muqaibel, Ali ;
Nasir, Ali Arshad ;
Yuen, Chau ;
Karagiannidis, George K. .
IEEE COMMUNICATIONS LETTERS, 2022, 26 (07) :1633-1637