Reinforcement Learning for Energy-Efficient User Association in UAV-Assisted Cellular Networks

被引:5
作者
Kaleem, Zeeshan [1 ]
Khalid, Waqas [2 ]
Ahmad, Ayaz [1 ]
Yu, Heejung [3 ]
Almasoud, Abdullah M. [4 ]
Yuen, Chau [5 ]
机构
[1] COMSATS Univ Islamabad, Dept Elect & Comp Engn, Wah Campus, Wah Cantt 47040, Pakistan
[2] Korea Univ, Inst Ind Technol, Sejong 30019, South Korea
[3] Korea Univ, Dept Elect & Informat Engn, Sejong 30019, South Korea
[4] Prince Sattam Bin Abdulaziz Univ, Dept Elect Engn, Al Kharj 11942, Saudi Arabia
[5] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
新加坡国家研究基金会;
关键词
Energy efficiency; Autonomous aerial vehicles; Resource management; Quality of service; Base stations; Simulation; Optimization; Cellular networks; energy efficiency; reinforcement learning (RL); unmanned aerial vehicles (UAVs); user association (UA); RESOURCE-ALLOCATION; POWER ALLOCATION; PLACEMENT; DEPLOYMENT;
D O I
10.1109/TAES.2024.3353724
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
In unmanned aerial vehicle (UAV)-assisted communications, there are two significant challenges that need to be addressed-optimized UAV placement and energy-efficient user association. These challenges are crucial in meeting the quality-of-service requirements of users. To overcome these challenges, a reinforcement-learning-based intelligent solution is proposed along with a reward function that associates users with UAVs in an intelligent manner. This solution aims to improve the system's sum rate performance by consuming less energy. Simulation results are presented to demonstrate the effectiveness of the proposed approach. The results indicate that the proposed approach is more energy efficient than the benchmark scheme while improving the system's sum rate.
引用
收藏
页码:2474 / 2481
页数:8
相关论文
共 25 条
[11]   Multiagent Q-Learning-Based Multi-UAV Wireless Networks for Maximizing Energy Efficiency: Deployment and Power Control Strategy Design [J].
Lee, Seungmin ;
Yu, Heejung ;
Lee, Howon .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (09) :6434-6442
[12]   Deep Learning-Based Network-Wide Energy Efficiency Optimization in Ultra-Dense Small Cell Networks [J].
Lee, Woongsup ;
Lee, Howon ;
Choi, Hyun-Ho .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (06) :8244-8249
[13]   Energy-Efficient Multi-UAVs Deployment and Movement for Emergency Response [J].
Li, Linpei ;
Wen, Xiangming ;
Lu, Zhaoming ;
Jing, Wenpeng ;
Zhang, Haijun .
IEEE COMMUNICATIONS LETTERS, 2021, 25 (05) :1625-1629
[14]   Optimal Tethered-UAV Deployment in A2G Communication Networks: Multi-Agent Q-Learning Approach [J].
Lim, Suhyeon ;
Yu, Heejung ;
Lee, Howon .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (19) :18539-18549
[15]   Ruin Theory for Energy-Efficient Resource Allocation in UAV-Assisted Cellular Networks [J].
Manzoor, Aunas ;
Kim, Kitae ;
Pandey, Shashi Raj ;
Kazmi, S. M. Ahsan ;
Tran, Nguyen H. ;
Saad, Walid ;
Hong, Choong Seon .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (06) :3943-3956
[16]   Three-Dimensional Multi-UAV Placement and Resource Allocation for Energy-Efficient IoT Communication [J].
Nouri, Nima ;
Abouei, Jamshid ;
Sepasian, Ali Reza ;
Jaseemuddin, Muhammad ;
Anpalagan, Alagan ;
Plataniotis, Konstantinos N. .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (03) :2134-2152
[17]   Joint Power and 3D Trajectory Optimization for UAV-Enabled Wireless Powered Communication Networks With Obstacles [J].
Pan, Hongyang ;
Liu, Yanheng ;
Sun, Geng ;
Fan, Junsong ;
Liang, Shuang ;
Yuen, Chau .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (04) :2364-2380
[18]   Joint Optimization of UAV 3-D Placement and Path-Loss Factor for Energy-Efficient Maximal Coverage [J].
Shakoor, Shanza ;
Kaleem, Zeeshan ;
Dinh-Thuan Do ;
Dobre, Octavia A. ;
Jamalipour, Abbas .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (12) :9776-9786
[19]   Role of UAVs in Public Safety Communications: Energy Efficiency Perspective [J].
Shakoor, Shanza ;
Kaleem, Zeeshan ;
Baig, Muhammad Iram ;
Chughtai, Omer ;
Duong, Trung Q. ;
Nguyen, Long D. .
IEEE ACCESS, 2019, 7 :140665-140679
[20]   SecBoost: Secrecy-Aware Deep Reinforcement Learning Based Energy-Efficient Scheme for 5G HetNets [J].
Sharma, Himanshu ;
Kumar, Neeraj ;
Tekchandani, Raj Kumar .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (02) :1401-1415