Intelligent Parameter Tuning Using Deep Q-Network for RED Algorithm in Adaptive Queue Management Systems<bold> </bold>

被引:0
|
作者
Basheer, Ayman [1 ]
Hassan, Hassan Jaleel [1 ]
Muttasher, Gaida [1 ]
机构
[1] Univ Technol Baghdad, Dept Comp Engn, Baghdad, Iraq
关键词
Adaptive queue management; AQM; RED; Network congestion; Network traffic management; Deep Q-network; Reinforcement learning<bold>; </bold>;
D O I
10.1007/978-981-16-8721-1_42
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Network traffic is growing with every passing day, making it more critical than ever to deal with the exploding amounts of Internet traffic and reduce delays; thus, self-learning network management systems are a must for efficient network management; such systems are called active queue management systems or AQM. This paper discusses the use of machine learning to auto-tune the parameters of AQM algorithms by training a deep reinforcement learning model to balance the queuing delay and through putto get the maximum possible network score which is also known as the reward system. Deep Q-Network (DQN) is used as the foundation to control and auto-tune the parameters of the RED algorithm. Results from the NS3 simulation suggest that the DQN algorithm has better network reliability and is thus preferable to the RED active queue control algorithm.<bold> </bold>
引用
收藏
页码:439 / 446
页数:8
相关论文
共 31 条
  • [21] Cooling channel designs of a prismatic battery pack for electric vehicle using the deep Q-network algorithm
    Kim, Y. T.
    Han, S. Y.
    APPLIED THERMAL ENGINEERING, 2023, 219
  • [22] Intelligent fault diagnosis for rotating machinery using deep Q-network based health state classification: A deep reinforcement learning approach
    Ding, Yu
    Ma, Liang
    Ma, Jian
    Suo, Mingliang
    Tao, Laifa
    Cheng, Yujie
    Lu, Chen
    ADVANCED ENGINEERING INFORMATICS, 2019, 42
  • [23] UE Centric DU Placement with Carrier Aggregation in O-RAN using Deep Q-Network Algorithm
    Joda, Roghayeh
    Naseri, Sima
    Hashemi, Mona
    Richards, Christopher
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [24] Analysis of user pairing non-orthogonal multiple access network using deep Q-network algorithm for defense applications
    Ravi, Shankar
    Kulkarni, Gopal Ramchandra
    Ray, Samrat
    Ravisankar, Malladi
    Krishnan, V. Gokula
    Chakravarthy, D. S. K.
    JOURNAL OF DEFENSE MODELING AND SIMULATION-APPLICATIONS METHODOLOGY TECHNOLOGY-JDMS, 2022, 20 (03): : 303 - 316
  • [25] A multi-setpoint cooling control approach for air-cooled data centers using the deep Q-network algorithm
    Chen, Yaohua
    Guo, Weipeng
    Liu, Jinwen
    Shen, Songyu
    Lin, Jianpeng
    Cui, Delong
    MEASUREMENT & CONTROL, 2024, 57 (06): : 782 - 793
  • [26] Listen-After-Collision Mechanism for Dynamic Spectrum Access Using Deep Q-Network With an Improved Thompson Sampling Algorithm
    He, Ming
    Jin, Ming
    Guo, Qinghua
    Xu, Weiqiang
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (04): : 6596 - 6606
  • [27] Risk-informed operation and maintenance of complex lifeline systems using parallelized multi-agent deep Q-network
    Lee, Dongkyu
    Song, Junho
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 239
  • [28] A load frequency control strategy based on double deep Q-network and upper confidence bound algorithm of multi-area interconnected power systems
    Zhang, Jing
    Peng, Feifei
    Wang, Lulu
    Yang, Yang
    Li, Yingna
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 120
  • [29] Intelligent energy management for an on-grid hydrogen refueling station based on dueling double deep Q network algorithm with NoisyNet
    Qi, Yunying
    Xu, Xiao
    Liu, Youbo
    Pan, Li
    Liu, Junyong
    Hu, Weihao
    RENEWABLE ENERGY, 2024, 222
  • [30] Intelligent Resource Management Using Multiagent Double Deep Q-Networks to Guarantee Strict Reliability and Low Latency in IoT Network
    Salh, Adeb
    Ngah, Razali
    Hussain, Ghasan Ali
    Audah, Lukman
    Alhartomi, Mohammed
    Abdullah, Qazwan
    Alsulami, Ruwaybih
    Alzahrani, Saeed
    Alzahmi, Ahmed
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 : 2245 - 2257