TCP-Drinc: Smart Congestion Control Based on Deep Reinforcement Learning

被引:44
|
作者
Xiao, Kefan [1 ]
Mao, Shiwen [1 ]
Tugnait, Jitendra K. [1 ]
机构
[1] Auburn Univ, Dept Elect & Comp Engn, Auburn, AL 36849 USA
关键词
Congestion control; deep convolutional neural network (DCNN); deep reinforcement learning (DRL); long short term memory (LSTM); machine learning;
D O I
10.1109/ACCESS.2019.2892046
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As wired/wireless networks become more and more complex, the fundamental assumptions made by many existing TCP variants may not hold true anymore. In this paper, we develop a modelfree, smart congestion control algorithm based on deep reinforcement learning, which has a high potential in dealing with the complex and dynamic network environment. We present TCP-Deep ReInforcement learNing-based Congestion control (Drinc) which learns from past experience in the form of a set of measured features to decide how to adjust the congestion window size. We present the TCP-Drinc design and validate its performance with extensive ns-3 simulations and comparison with five benchmark schemes.
引用
收藏
页码:11892 / 11904
页数:13
相关论文
共 50 条
  • [31] Pareto: Fair Congestion Control With Online Reinforcement Learning
    Emara, Salma
    Wang, Fei
    Li, Baochun
    Zeyl, Timothy
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (05): : 3731 - 3748
  • [32] DeePCCI: Deep Learning-based Passive Congestion Control Identification
    Sander, Constantin
    Rueth, Jan
    Hohlfeld, Oliver
    Wehrle, Klaus
    NETAI'19: PROCEEDINGS OF THE 2019 ACM SIGCOMM WORKSHOP ON NETWORK MEETS AI & ML, 2019, : 37 - 43
  • [33] Control strategy of hydraulic cylinder based on Deep Reinforcement Learning
    Wyrwal, Daniel
    Lindner, Tymoteusz
    Nowak, Patryk
    Bialek, Marcin
    15TH INTERNATIONAL CONFERENCE MECHATRONIC SYSTEMS AND MATERIALS, MSM'20, 2020, : 169 - 173
  • [34] Learning to Sail Dynamic Networks: The MARLIN Reinforcement Learning Framework for Congestion Control in Tactical Environments
    Galliera, Raffaele
    Zaccarini, Mattia
    Morelli, Alessandro
    Fronteddu, Roberto
    Poltronieri, Filippo
    Suri, Niranjan
    Tortonesi, Mauro
    MILCOM 2023 - 2023 IEEE MILITARY COMMUNICATIONS CONFERENCE, 2023,
  • [35] Deep Reinforcement Learning Based Coalition Formation for Energy Trading in Smart Grid
    Sadeghi, Mohammad
    Erol-Kantarci, Melike
    2021 IEEE 4TH 5G WORLD FORUM (5GWF 2021), 2021, : 200 - 205
  • [36] A Method for Road Accident Prevention in Smart Cities based on Deep Reinforcement Learning
    Crincoli, Giuseppe
    Fierro, Fabiana
    Iadarola, Giacomo
    La Rocca, Piera Elena
    Martinelli, Fabio
    Mercaldo, Francesco
    Santone, Antonella
    SECRYPT : PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SECURITY AND CRYPTOGRAPHY, 2022, : 513 - 518
  • [37] A cache-aware congestion control mechanism using deep reinforcement learning for wireless sensor networks
    Alipio, Melchizedek
    Bures, Miroslav
    AD HOC NETWORKS, 2025, 166
  • [38] ReCoCo: Reinforcement learning-based Congestion control for Real-time applications
    Markudova, Dena
    Meo, Michela
    2023 IEEE 24TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE SWITCHING AND ROUTING, HPSR, 2023,
  • [39] Intelligent TCP Congestion Control Scheme in Internet of Deep Space Things Communication
    Masood, Arooj
    Ha, Taeyun
    Lakew, Demeke Shumeye
    Dao, Nhu-Ngoc
    Cho, Sungrae
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (03): : 1472 - 1486
  • [40] NCC: Neighbor-aware Congestion Control based on Reinforcement Learning for Datacenter Networks
    Wang, Haoyu
    Zheng, Kevin
    Reiss, Charles
    Shen, Haiying
    51ST INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2022, 2022,