Service Function Chain Deployment Algorithm Based on Multi-Agent Deep Reinforcement Learning

被引:0
|
作者
Huang, Wanwei [1 ]
Zhang, Qiancheng [1 ]
Liu, Tao [2 ]
Xu, Yaoli [1 ]
Zhang, Dalei [3 ]
机构
[1] Zhengzhou Univ Light Ind, Software Engn Coll, Zhengzhou 450007, Peoples R China
[2] Henan Jiuyu Tenglong Informat Engn Co Ltd, Zhengzhou 450052, Peoples R China
[3] Henan Xinan Commun Technol Co Ltd, Zhengzhou 450001, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 80卷 / 03期
关键词
Network function virtualization; service function chain; Markov decision process; multi-agent reinforcement learning;
D O I
10.32604/cmc.2024.055622
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the rapid growth of network services, which leads to the problems of long service request processing time and high deployment cost in the deployment of network function virtualization service function chain (SFC) under 5G networks, this paper proposes a multi-agent deep deterministic policy gradient optimization algorithm for SFC deployment (MADDPG-SD). Initially, an optimization model is devised to enhance the request acceptance rate, minimizing the latency and deploying the cost SFC is constructed for the network resource-constrained case. Subsequently, we model the dynamic problem as a Markov decision process (MDP), facilitating adaptation to the evolving states of network resources. Finally, by allocating SFCs to different agents and adopting a collaborative deployment strategy, each agent aims to maximize the request acceptance rate or minimize latency and costs. These agents learn strategies from historical data of virtual network functions in SFCs to guide server node selection, and achieve approximately optimal SFC deployment strategies through a cooperative framework of centralized training and distributed execution. Experimental simulation results indicate that the proposed method, while simultaneously meeting performance requirements and resource capacity constraints, has effectively increased the acceptance rate of requests compared to the comparative algorithms, reducing the end-to-end latency by 4.942% and the deployment cost by 8.045%.
引用
收藏
页码:4875 / 4893
页数:19
相关论文
共 50 条
  • [1] Reliability deployment of service function chain based on multi-agent reinforcement learning
    Liu, Guangyuan
    Huang, Shucui
    Li, Kai
    2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 1574 - 1578
  • [2] GCN-Based Multi-Agent Deep Reinforcement Learning for Dynamic Service Function Chain Deployment in IoT
    Wang, Shuyi
    Cao, Haotong
    Yang, Longxiang
    Garg, Sahil
    Kaddoum, Georges
    Alrashoud, Mubarak
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (03) : 6105 - 6118
  • [3] Reliable Deployment Algorithm of Service Function Chain Based on Deep Reinforcement Learning
    Tang Lun
    Cao Rui
    Liao Hao
    Wang Zhaokun
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (12) : 2931 - 2938
  • [4] Deployment Algorithm of Service Function Chain Based on Multi-Agent Soft Actor-Critic Learning
    Tang, Lun
    Li, Shirui
    Du, Yucong
    Chen, Qianbin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (08) : 2893 - 2901
  • [5] Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning
    Qu, Hua
    Wang, Ke
    Zhao, Jihong
    SENSORS, 2021, 21 (08)
  • [6] Dynamic Service Function Chain Deployment and Readjustment Method Based on Deep Reinforcement Learning
    Ran, Jing
    Wang, Wenkai
    Hu, Hefei
    SENSORS, 2023, 23 (06)
  • [7] A Dynamic Pre-Deployment Strategy of UAVs Based on Multi-Agent Deep Reinforcement Learning
    Tang, Lun
    Li, Zhixuan
    Pu, Hao
    Wang, Zhiping
    Chen, Qianbin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 46 (06) : 2007 - 2015
  • [8] Service Function Chain Deployment Algorithm Based on Deep Reinforcement Learning in Space-Air-Ground Integrated Network
    Feng, Xu
    He, Mengyang
    Zhuang, Lei
    Song, Yanrui
    Peng, Rumeng
    FUTURE INTERNET, 2024, 16 (01)
  • [9] Function approximation based multi-agent reinforcement learning
    Abul, O
    Polat, F
    Alhajj, R
    12TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2000, : 36 - 39
  • [10] NFVdeep: Adaptive Online Service Function Chain Deployment with Deep Reinforcement Learning
    Xiao, Yikai
    Zhang, Qixia
    Liu, Fangming
    Wang, Jia
    Zhao, Miao
    Zhang, Zhongxing
    Zhang, Jiaxing
    PROCEEDINGS OF THE IEEE/ACM INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS 2019), 2019,