DRL-Based Joint RAT Association, Power and Bandwidth Optimization for Future HetNets

被引:2
作者
Alwarafy, Abdulmalik [1 ]
Ciftler, Bekir Sait [1 ]
Abdallah, Mohamed [1 ]
Hamdi, Mounir [1 ]
Al-Dhahir, Naofal [2 ]
机构
[1] Hamad Bin Khalifa Univ, Coll Sci & Engn, Div Informat & Comp Technol, Doha, Qatar
[2] Univ Texas Dallas, Erik Jonsson Sch Engn & Comp Sci, Elect & Comp Engn Dept, Richardson, TX 75080 USA
关键词
Radio access technologies; Channel allocation; Bandwidth; Resource management; Rats; Optimization; Downlink; RAT association; power; bandwidth; deep reinforcement learning; heterogeneous networks; USER ASSOCIATION; REINFORCEMENT; NETWORKS;
D O I
10.1109/LWC.2022.3177250
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-radio access technologies (RATs) networks, where various heterogeneous networks (HetNets) coexist, are in service nowadays and considered a main enabling technology for future networks. In such networks, managing radio resources is challenge. In this letter, we address the problem of RATs-edge devices (EDs) association and joint power and bandwidth allocation in multi-RAT multi-homing HetNets. The problem is formulated as mixed-integer non-linear programming, whose objective is to cost-effectively maximize the network constrained sum-rate. Due to the high complexity of the problem, we propose a multi-agent deep reinforcement learning (DRL)-based scheme to solve it. Simulation results show that our proposed scheme efficiently learns the optimal policy and enhances the network sum-rate by 80.95% compared to key benchmarks.
引用
收藏
页码:1503 / 1507
页数:5
相关论文
共 12 条
[1]   AI-Based Radio Resource Allocation in Support of the Massive Heterogeneity of 6G Networks [J].
Alwarafy, Abdulmalik ;
Albaseer, Abdullatif ;
Ciftler, Bekir Sait ;
Abdallah, Mohamed ;
Al-Fuqaha, Ala .
2021 IEEE 4TH 5G WORLD FORUM (5GWF 2021), 2021, :464-469
[2]   Hierarchical Multi-Agent DRL-Based Framework for Joint Multi-RAT Assignment and Dynamic Resource Allocation in Next-Generation HetNets [J].
Alwarafy, Abdulmalik ;
Ciftler, Bekir Sait ;
Abdallah, Mohamed ;
Hamdi, Mounir ;
Al-Dhahir, Naofal .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04) :2481-2494
[3]   The Frontiers of Deep Reinforcement Learning for Resource Management in Future Wireless HetNets: Techniques, Challenges, and Research Directions [J].
Alwarafy, Abdulmalik ;
Abdallah, Mohamed ;
Ciftler, Bekir Sait ;
Al-Fuqaha, Ala ;
Hamdi, Mounir .
IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 :322-365
[4]   DeepRAT: A DRL-Based Framework for Multi-RAT Assignment and Power Allocation in HetNets [J].
Alwarafy, Abdulmalik ;
Ciftler, Bekir Sait ;
Abdallah, Mohamed ;
Hamdi, Mounir .
2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2021,
[5]   Deep Reinforcement Learning for Network Selection Over Heterogeneous Health Systems [J].
Chkirbene, Zina ;
Abdellatif, Alaa Awad ;
Mohamed, Amr ;
Erbad, Aiman ;
Guizani, Mohsen .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (01) :258-270
[6]   Distributed DRL-Based Downlink Power Allocation for Hybrid RF/VLC Networks [J].
Ciftler, Bekir Sait ;
Alwarafy, Abdulmalik ;
Abdallah, Mohamed .
IEEE PHOTONICS JOURNAL, 2022, 14 (03)
[7]   User Association for Load Balancing in Vehicular Networks: An Online Reinforcement Learning Approach [J].
Li, Zhong ;
Wang, Cheng ;
Jiang, Chang-Jun .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (08) :2217-2228
[8]   Deep Reinforcement Learning Based Resource Management in UAV-Assisted IoT Networks [J].
Munaye, Yirga Yayeh ;
Juang, Rong-Terng ;
Lin, Hsin-Piao ;
Tarekegn, Getaneh Berie ;
Lin, Ding-Bing .
APPLIED SCIENCES-BASEL, 2021, 11 (05) :1-20
[9]   Deep Reinforcement Learning-Based Intelligent Reflecting Surface for Secure Wireless Communications [J].
Yang, Helin ;
Xiong, Zehui ;
Zhao, Jun ;
Niyato, Dusit ;
Xiao, Liang ;
Wu, Qingqing .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :375-388
[10]   Artificial-Intelligence-Enabled Intelligent 6G Networks [J].
Yang, Helin ;
Alphones, Arokiaswami ;
Xiong, Zehui ;
Niyato, Dusit ;
Zhao, Jun ;
Wu, Kaishun .
IEEE NETWORK, 2020, 34 (06) :272-280