REINFORCEMENT LEARNING FOR SCHEDULING AND MIMO BEAM SELECTION USING CAVIAR SIMULATIONS

被引：0

作者：

Tavares Borges, Joao Paulo ^{[1
]}

de Oliveira, Ailton Pinto ^{[1
]}

Bastos e Bastos, Felipe Henrique ^{[1
]}

Ne do Nascimento Suzuki, Daniel Takashi ^{[1
]}

de Oliveira Junior, Emerson Santos ^{[1
]}

Bezerra, Lucas Matni ^{[2
]}

Nahum, Cleverson Veloso ^{[1
]}

Batista, Pedro dos Santos ^{[3
]}

da Rocha Klautau Junior, Aldebaro Barreto ^{[1
]}

机构：

[1] Fed Univ Para, BR-66075110 Belem, Para, Brazil

[2] Univ Estacio Sa, BR-66055260 Belem, Para, Brazil

[3] Ericsson Res, S-16480 Stockholm, Sweden

来源：

2021 ITU KALEIDOSCOPE CONFERENCE: CONNECTING PHYSICAL AND VIRTUAL WORLDS (ITU K) | 2021年

关键词：

5G; 6G; beam selection; MIMO; mmWave; RL; NETWORKS;

D O I：

10.23919/ITUK53220.2021.9662100

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper describes a framework for research on Reinforcement Learning (RL) applied to scheduling and MIMO beam selection. This framework consists of asking the RL agent to schedule a user and then choose the index of a beamforming codebook to serve it. A key aspect of this problem is that the simulation of the communication system and the artificial intelligence engine is based on a virtual world created with AirSim and the Unreal Engine. These components enable the so-called CAVIAR methodology, which leads to highly realistic 3D scenarios. This paper describes the communication and RL modeling adopted in the framework and also presents statistics concerning the implemented RL environment, such as data traffic, as well as results for three baseline systems.

引用

页码：141 / 148

页数：8

共 50 条

[21] Reinforcement learning-based model for the prevention of beam-forming vector attacks on massive MIMO system
Paranthaman, R. Nithya
Sonker, Abhishek
Varalakshmi, S.
Madiajagan, M.
Sagar, K. V. Daya
Malathi, M.
OPTICAL AND QUANTUM ELECTRONICS, 2024, 56 (01)
[22] Beam Selection in mm-Wave Multiuser MIMO Systems Using Compressive Sensing
Choi, Jinho
IEEE TRANSACTIONS ON COMMUNICATIONS, 2015, 63 (08) : 2936 - 2947
[23] Beamspace MIMO Systems With Reduced Beam Selection Complexity
Cetinkaya, Sinasi
Arslan, Huseyin
IEEE COMMUNICATIONS LETTERS, 2023, 27 (05) : 1427 - 1431
[24] Energy Efficient AP Selection for Cell-Free Massive MIMO Systems: Deep Reinforcement Learning Approach
Ghiasi, Niyousha
Mashhadi, Shima
Farahmand, Shahrokh
Razavizadeh, S. Mohammad
Lee, Inkyu
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (01): : 29 - 41
[25] Statistical Learning Based Joint Antenna Selection and User Scheduling for Single-Cell Massive MIMO Systems
Guo, Mangqing
Gursoy, M. Cenk
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2021, 5 (01): : 471 - 483
[26] Online Beam Learning With Interference Nulling for Millimeter Wave MIMO Systems
Zhang, Yu
Osman, Tawfik
Alkhateeb, Ahmed
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (05) : 5109 - 5124
[27] Joint Relay Selection and Beam Management Based on Deep Reinforcement Learning for Millimeter Wave Vehicular Communication
Kim, Dohyun
Castellanos, Miguel R.
Heath, Robert W., Jr.
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (10) : 13067 - 13080
[28] Optimal User Scheduling in Multi Antenna System Using Multi Agent Reinforcement Learning
Naeem, Muddasar
Coronato, Antonio
Ullah, Zaib
Bashir, Sajid
Paragliola, Giovanni
SENSORS, 2022, 22 (21)
[29] Low Complexity and Near-Optimal Beam Selection for Millimeter Wave MIMO Systems
Niu, Yong
Feng, Ziqi
Li, Yong
Zhong, Zhangdui
Wu, Dapeng
2017 13TH INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING CONFERENCE (IWCMC), 2017, : 634 - 639
[30] Multiple-Beam Selection With Limited Feedback for Hybrid Beamforming in Massive MIMO Systems
Ren, Yuwei
Wang, Yingmin
Qi, Can
Liu, Yinjun
IEEE ACCESS, 2017, 5 : 13327 - 13335

← 1 2 3 4 5 →