Combining graph neural network with deep reinforcement learning for resource allocation in computing force networks

被引:2
作者
Han, Xueying [1 ]
Xie, Mingxi [2 ]
Yu, Ke [2 ]
Huang, Xiaohong [1 ]
Du, Zongpeng [3 ]
Yao, Huijuan [3 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[3] China Mobile Res Inst, Dept Infrastructure Network Technol Res, Beijing 100032, Peoples R China
关键词
Computing force network; Routing optimization; Deep learning; Graph neural network; Resource allocation; CLOUD; MANAGEMENT;
D O I
10.1631/FITEE.2300009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Fueled by the explosive growth of ultra-low-latency and real-time applications with specific computing and network performance requirements, the computing force network (CFN) has become a hot research subject. The primary CFN challenge is to leverage network resources and computing resources. Although recent advances in deep reinforcement learning (DRL) have brought significant improvement in network optimization, these methods still suffer from topology changes and fail to generalize for those topologies not seen in training. This paper proposes a graph neural network (GNN) based DRL framework to accommodate network traffic and computing resources jointly and efficiently. By taking advantage of the generalization capability in GNN, the proposed method can operate over variable topologies and obtain higher performance than the other DRL methods.
引用
收藏
页码:701 / 712
页数:12
相关论文
共 31 条
[1]  
Almasan Paul., 2020, arXiv
[2]   Towards more realistic network models based on Graph Neural Networks [J].
Badia-Sampera, Arnau ;
Suarez-Varela, Jose ;
Almasan, Paul ;
Rusek, Krzysztof ;
Barlet-Ros, Pere ;
Cabellos-Aparicio, Albert .
CONEXT'19 COMPANION: PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON EMERGING NETWORKING EXPERIMENTS AND TECHNOLOGIES, 2019, :14-16
[3]   Communicating While Computing [Distributed mobile cloud computing over 5G heterogeneous networks] [J].
Barbarossa, Sergio ;
Sardellitti, Stefania ;
Di Lorenzo, Paolo .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (06) :45-55
[4]  
Ferriol-Galmés M, 2021, Arxiv, DOI arXiv:2010.06686
[5]  
Geyer F., 2017, P 11 EAI INT C PERF, DOI DOI 10.1145/3150928.3150941
[6]  
Gilmer J, 2017, PR MACH LEARN RES, V70
[7]   Trusted Cloud-Edge Network Resource Management: DRL-Driven Service Function Chain Orchestration for IoT [J].
Guo, Shaoyong ;
Dai, Yao ;
Xu, Siya ;
Qiu, Xuesong ;
Qi, Feng .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) :6010-6022
[8]   Edge Computing Aware NOMA for 5G Networks [J].
Kiani, Abbas ;
Ansari, Nirwan .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (02) :1299-1306
[9]  
Li M, 2019, P IEEE GLOB COMM C, P1, DOI [10.1109/GLOBECOM38437.2019.9013366, DOI 10.1109/GLOBECOM38437.2019.9013366]
[10]   CFN-dyncast: Load Balancing the Edges via the Network [J].
Liu, Bing ;
Mao, Jianwei ;
Xu, Ling ;
Hu, Ruizhao ;
Chen, Xia .
2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOPS (WCNCW), 2021,