TCP-Drinc: Smart Congestion Control Based on Deep Reinforcement Learning

被引:44
|
作者
Xiao, Kefan [1 ]
Mao, Shiwen [1 ]
Tugnait, Jitendra K. [1 ]
机构
[1] Auburn Univ, Dept Elect & Comp Engn, Auburn, AL 36849 USA
关键词
Congestion control; deep convolutional neural network (DCNN); deep reinforcement learning (DRL); long short term memory (LSTM); machine learning;
D O I
10.1109/ACCESS.2019.2892046
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As wired/wireless networks become more and more complex, the fundamental assumptions made by many existing TCP variants may not hold true anymore. In this paper, we develop a modelfree, smart congestion control algorithm based on deep reinforcement learning, which has a high potential in dealing with the complex and dynamic network environment. We present TCP-Deep ReInforcement learNing-based Congestion control (Drinc) which learns from past experience in the form of a set of measured features to decide how to adjust the congestion window size. We present the TCP-Drinc design and validate its performance with extensive ns-3 simulations and comparison with five benchmark schemes.
引用
收藏
页码:11892 / 11904
页数:13
相关论文
共 50 条
  • [21] A Novel Technique for TCP based Congestion Control
    Hruby, Martin
    Olsovsky, Michal
    Kotocova, Margareta
    PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON DATA COMMUNICATION NETWORKING (DCNET 2013), 2013, : 34 - 41
  • [22] TRCC: Transferable Congestion Control With Reinforcement Learning
    Zheng, Zhicong
    Xia, Zhenchang
    Chou, Yu-Cheng
    Chen, Yanjiao
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (02) : 2273 - 2285
  • [23] Deep Reinforcement Learning-Based Distributed Congestion Control in Cellular V2X Networks
    Choi, Joo-Young
    Jo, Han-Shin
    Mun, Cheol
    Yook, Jong-Gwan
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (11) : 2582 - 2586
  • [24] A congestion control method of SDN data center based on reinforcement learning
    Jin, Rong
    Li, Jiaojiao
    Tuo, Xin
    Wang, Weiming
    Li, Xiaolin
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2018, 31 (17)
  • [25] PBQ-Enhanced QUIC: QUIC with Deep Reinforcement Learning Congestion Control Mechanism
    Zhang, Zhifei
    Li, Shuo
    Ge, Yiyang
    Xiong, Ge
    Zhang, Yu
    Xiong, Ke
    ENTROPY, 2023, 25 (02)
  • [26] A New Method for TCP Congestion Control Based on AODV Congestion Indication
    Lv Heng
    Ge Weimin
    Luo Yongmei
    Zhao Dongxue
    2009 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP 2009), 2009, : 442 - 445
  • [27] Machine-Learning based Loss Discrimination Algorithm for Wireless TCP Congestion Control
    Han, Kimoon
    Lee, Jae Yong
    Kim, Byung Chul
    2019 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2019, : 125 - 126
  • [28] Deep reinforcement learning for tuning active vibration control on a smart piezoelectric beam
    Febvre, Maryne
    Rodriguez, Jonathan
    Chesne, Simon
    Collet, Manuel
    JOURNAL OF INTELLIGENT MATERIAL SYSTEMS AND STRUCTURES, 2024, 35 (14) : 1149 - 1165
  • [29] Delay-based Congestion Control for Multipath TCP
    Guo, Wenlan
    Huang, Jin
    Zhang, Yun
    INTERNATIONAL JOURNAL OF FUTURE GENERATION COMMUNICATION AND NETWORKING, 2014, 7 (01): : 97 - 104
  • [30] An intelligent scheme for congestion control: When active queue management meets deep reinforcement learning
    Ma, Huihui
    Xu, Du
    Dai, Yueyue
    Dong, Qing
    COMPUTER NETWORKS, 2021, 200