Local search resource allocation algorithm for space-based backbone network in Deep Reinforcement Learning method

被引:0
作者
Zhang, Peiying [1 ,2 ]
Cui, Zixuan [1 ]
Kumar, Neeraj [3 ]
Wang, Jian [4 ]
Zhang, Wei [2 ,5 ]
Tan, Lizhuang [2 ,5 ]
机构
[1] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[2] Qilu Univ Technol, Key Lab Comp Power Network & Informat Secur, Shandong Comp Sci Ctr,Minist Educ, Natl Supercomp Ctr Jinan,Shandong Acad Sci, Jinan 250014, Peoples R China
[3] Thapar Univ, Dept Comp Sci & Engn, Patiala 147004, India
[4] China Univ Petr East China, Coll Sci, Qingdao 266580, Peoples R China
[5] Shandong Fundamental Res Ctr Comp Sci, Shandong Prov Key Lab Comp Networks, Jinan 250014, Peoples R China
基金
中国国家自然科学基金;
关键词
Virtual network embedding; Resource allocation; Space-based backbone network; Deep reinforcement learning; Local search;
D O I
10.1016/j.adhoc.2024.103575
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the evolution of Space -based backbone networks, the demand for enhanced efficiency and stability in network resource allocation has become increasingly critical, presenting a substantial challenge to conventional allocation methods. In response, we introduce an innovative resource allocation algorithm for space -based backbone networks. This algorithm represents a synergistic fusion of Deep Reinforcement Learning (DRL) and Local Search (LS) methodologies. It is specifically designed to reduce the extensive training duration associated with traditional policy networks, a crucial aspect in assuring optimal service quality. Our algorithm is structured within a two -stage framework that seamlessly integrates DRL and LS. A distinctive feature of our approach is the incorporation of link reliability into the algorithmic design. This element is meticulously tailored to address the dynamic and heterogeneous nature of space -based networks, ensuring effective resource management. The effectiveness of our approach is substantiated through extensive simulation results. These results demonstrate that the integration of DRL with LS not only enhances training efficiency but also exhibits significant improvements in resource allocation outcomes. Our work represents a noteworthy contribution to the development of practical optimization strategies in space -based networks, merging DRL with traditional methodologies for improved performance.
引用
收藏
页数:12
相关论文
共 50 条
[21]   Deep Reinforcement Learning based Dynamic Resource Allocation Method for NOMA in AeroMACS [J].
Yu, Lanchenhui ;
Zhao, Jingjing ;
Zhu, Yanbo ;
Chen, RunZe ;
Cai, Kaiquan .
2024 INTEGRATED COMMUNICATIONS, NAVIGATION AND SURVEILLANCE CONFERENCE, ICNS, 2024,
[22]   Deep Reinforcement Learning for Resource Allocation in Blockchain-based Federated Learning [J].
Dai, Yueyue ;
Yang, Huijiong ;
Yang, Huiran .
ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, :179-184
[23]   A Graph Convolutional Network-Based Deep Reinforcement Learning Approach for Resource Allocation in a Cognitive Radio Network [J].
Zhao, Di ;
Qin, Hao ;
Song, Bin ;
Han, Beichen ;
Du, Xiaojiang ;
Guizani, Mohsen .
SENSORS, 2020, 20 (18) :1-23
[24]   Computation offloading and resource allocation strategy based on deep reinforcement learning [J].
Zeng F. ;
Zhang Z. ;
Chen Z. .
Tongxin Xuebao/Journal on Communications, 2023, 44 (07) :124-135
[25]   Fair Resource Allocation Based on Deep Reinforcement Learning in Fog Networks [J].
Xu, Huihui ;
Zu, Yijun ;
Shen, Fei ;
Yan, Feng ;
Qin, Fei ;
Shen, Lianfeng .
AD HOC NETWORKS, ADHOCNETS 2019, 2019, 306 :135-148
[26]   UAV spatiotemporal crowdsourcing resource allocation based on deep reinforcement learning [J].
面向工业场景的无人机时空众包资源分配 .
Huangfu, Wei (huangfuwei@ustb.edu.cn), 2025, 47 (01) :91-100
[27]   Intelligent Reflective Surface Resource Allocation Algorithm Based on Deep Reinforcement Learning in Internet of Vehicles System [J].
Zeng, Rong ;
Feng, Zhenhui ;
Zhang, Zaichen ;
Ying, Na ;
Wang, Hao ;
Yao, Yingbiao .
IEEE COMMUNICATIONS LETTERS, 2024, 28 (08) :1885-1888
[28]   A Resource Allocation Algorithm for Ultra-Dense Networks Based on Deep Reinforcement Learning [J].
Zhang, H. S. ;
Wang, T. M. ;
Shen, H. W. .
INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2021, 16 (02) :1-11
[29]   Wireless Virtual Network Embedding Algorithm Based on Deep Reinforcement Learning [J].
Gao, Qi ;
Lyu, Na ;
Miao, Jingcheng ;
Pan, Wu .
ELECTRONICS, 2022, 11 (14)
[30]   Deep Reinforcement Learning-Based Resource Allocation for Integrated Sensing, Communication, and Computation in Vehicular Network [J].
Yang, Liu ;
Wei, Yifei ;
Feng, Zhiyong ;
Zhang, Qixun ;
Han, Zhu .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) :18608-18622