Deep Reinforcement Learning for QoS provisioning at the MAC layer: A Survey

被引:19
作者
Abbasi, Mahmoud [1 ]
Shahraki, Amin [2 ,4 ]
Piran, Md. Jalil [3 ]
Taherkordi, Amir [2 ]
机构
[1] Islamic Azad Univ, Dept Comp Sci, Mashhad, Razavi Khorasan, Iran
[2] Univ Oslo, Dept Informat IFI, Oslo, Norway
[3] Sejong Univ, Dept Comp Sci & Engn, Seoul 05006, South Korea
[4] Ostfold Univ Coll, Fac Comp Sci, Halden, Norway
关键词
Quality of Service; Medium Access Control; Rate control; Resource sharing and scheduling; Deep Reinforcement Learning; Survey; RESOURCE-ALLOCATION; USER ASSOCIATION; BIG DATA; NETWORKING; FRAMEWORK; ENERGY; IOT; MANAGEMENT; ALGORITHM; HETNETS;
D O I
10.1016/j.engappai.2021.104234
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Quality of Service (QoS) provisioning is based on various network management techniques including resource management and medium access control (MAC). Various techniques have been introduced to automate networking decisions, particularly at the MAC layer. Deep reinforcement learning (DRL), as a solution to sequential decision making problems, is a combination of the power of deep learning (DL), to represent and comprehend the world, with reinforcement learning (RL), to understand the environment and act rationally. In this paper, we present a survey on the applications of DRL in QoS provisioning at the MAC layer. First, we present the basic concepts of QoS and DRL. Second, we classify the main challenges in the context of QoS provisioning at the MAC layer, including medium access and data rate control, and resource sharing and scheduling. Third, we review various DRL algorithms employed to support QoS at the MAC layer, by analyzing, comparing, and identifying their pros and cons. Furthermore, we outline a number of important open research problems and suggest some avenues for future research.
引用
收藏
页数:20
相关论文
共 150 条
[41]   State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow's Intelligent Network Traffic Control Systems [J].
Fadlullah, Zubair Md. ;
Tang, Fengxiao ;
Mao, Bomin ;
Kato, Nei ;
Akashi, Osamu ;
Inoue, Takeru ;
Mizutani, Kimihiro .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2017, 19 (04) :2432-2455
[42]   Dealing with Limited Backhaul Capacity in Millimeter-Wave Systems: A Deep Reinforcement Learning Approach [J].
Feng, Mingjie ;
Mao, Shiwen .
IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (03) :50-55
[43]   Joint Resource Allocation and User Association for Heterogeneous Wireless Cellular Networks [J].
Fooladivanda, Dariush ;
Rosenberg, Catherine .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2013, 12 (01) :248-257
[44]  
Fortunato M., 2018, INT C LEARNING REPRE
[45]  
Fu F., 2020, IEEE INTERNET THINGS
[46]  
Fu Z., 2017, Wireless Communications and Networking Conference (WCNC), 2017 IEEE, P1
[47]   D-DASH: A Deep Q-Learning Framework for DASH Video Streaming [J].
Gadaleta, Matteo ;
Chiariotti, Federico ;
Rossi, Michele ;
Zanella, Andrea .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2017, 3 (04) :703-718
[48]  
Gu Z., 2020, ARXIV PREPRINT ARXIV
[49]  
Guo D., 2020, IEEE T VEH TECHNOL
[50]  
Haarnoja T., 2018, ARXIV180101290