IEACC: An Intelligent Edge-Aided Congestion Control Scheme for Named Data Networking With Deep Reinforcement Learning

被引:10
作者
Yang, Jiayu [1 ]
Chen, Yuxin [1 ]
Xue, Kaiping [1 ]
Han, Jiangping [1 ]
Li, Jian [1 ]
Wei, David S. L. [2 ]
Sun, Qibin [1 ]
Lu, Jun [3 ,4 ]
机构
[1] Univ Sci & Technol China, Sch Cyber Sci & Technol, Hefei 230027, Anhui, Peoples R China
[2] Fordham Univ, Comp & Informat Sci Dept, Bronx, NY 10458 USA
[3] Univ Sci & Technol China, Sch Cyber Sci & Technol, Hefei 230027, Anhui, Peoples R China
[4] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT | 2022年 / 19卷 / 04期
基金
中国国家自然科学基金;
关键词
Packet loss; Bandwidth; Reinforcement learning; Image edge detection; Internet; Detectors; TCPIP; Named data networking; congestion control; reinforcement learning; fairness; CONTROL PROTOCOL; DESIGN;
D O I
10.1109/TNSM.2022.3196344
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a promising implementation of Information-Centric Networking (ICN), Named Data Networking (NDN) has potential advantages over the TCP/IP network in content distribution, mobility support, etc. However, the research on NDN is still in its infancy, and congestion control, NDN's most important functional element, poses many challenges, such as congestion detection, excessive window reduction for non-congested paths, and unfairness. In this paper, we propose an Intelligent Edge-Aided Congestion Control (IEACC) scheme for the NDN network based on Deep Reinforcement Learning (DRL). The proposed IEACC provides a proactive congestion detector that utilizes intermediate routers to transmit accurate congestion information along the path to consumers through data packets. Furthermore, considering the multi-source transmission in NDN, IEACC divides data packets into different congestion degrees by a lightweight clustering algorithm and provides suitable inputs for DRL, thereby obtaining a reasonable transmission rate. Then, it distributes the estimated bandwidth resources to consumers with transmission needs to maintain fairness. Finally, we implement our proposed scheme in the simulation platform and evaluate the performance in different scenarios. The results show that it can improve data transmission rate, reduce packet loss, and maintain fairness compared with others.
引用
收藏
页码:4932 / 4947
页数:16
相关论文
共 44 条
[1]   Active Queue Management: A Survey [J].
Adams, Richelle .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2013, 15 (03) :1425-1476
[2]   IoT Services Allocation at the Edge via Named Data Networking: From Optimal Bounds to Practical Design [J].
Amadeo, Marica ;
Ruggeri, Giuseppe ;
Campolo, Claudia ;
Molinaro, Antonella .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2019, 16 (02) :661-674
[3]  
Amadeo M, 2014, IEEE CONF COMPUT, P464, DOI 10.1109/INFCOMW.2014.6849276
[4]  
[Anonymous], PYTORCH
[5]  
[Anonymous], 2010, Mobile data traffic surpasses voice
[6]  
[Anonymous], 2013, PROC IEEE INT C COMP
[7]  
Carofiglio Giovanna, 2013, 2013 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), P363, DOI 10.1109/INFCOMW.2013.6970718
[8]   Optimal multipath congestion control and request forwarding in information-centric networks: Protocol design and experimentation [J].
Carofiglio, Giovanna ;
Gallo, Massimo ;
Muscariello, Luca .
COMPUTER NETWORKS, 2016, 110 :104-117
[9]   Joint Hop-by-hop and Receiver-Driven Interest Control Protocol for Content-Centric Networks [J].
Carofiglio, Giovanna ;
Gallo, Massimo ;
Muscariello, Luca .
ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2012, 42 (04) :491-496
[10]  
Carofiglio G, 2012, IEEE CONF COMPUT, P304, DOI 10.1109/INFCOMW.2012.6193510