Local search resource allocation algorithm for space-based backbone network in Deep Reinforcement Learning method

被引:0
|
作者
Zhang, Peiying [1 ,2 ]
Cui, Zixuan [1 ]
Kumar, Neeraj [3 ]
Wang, Jian [4 ]
Zhang, Wei [2 ,5 ]
Tan, Lizhuang [2 ,5 ]
机构
[1] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[2] Qilu Univ Technol, Key Lab Comp Power Network & Informat Secur, Shandong Comp Sci Ctr,Minist Educ, Natl Supercomp Ctr Jinan,Shandong Acad Sci, Jinan 250014, Peoples R China
[3] Thapar Univ, Dept Comp Sci & Engn, Patiala 147004, India
[4] China Univ Petr East China, Coll Sci, Qingdao 266580, Peoples R China
[5] Shandong Fundamental Res Ctr Comp Sci, Shandong Prov Key Lab Comp Networks, Jinan 250014, Peoples R China
基金
中国国家自然科学基金;
关键词
Virtual network embedding; Resource allocation; Space-based backbone network; Deep reinforcement learning; Local search;
D O I
10.1016/j.adhoc.2024.103575
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the evolution of Space -based backbone networks, the demand for enhanced efficiency and stability in network resource allocation has become increasingly critical, presenting a substantial challenge to conventional allocation methods. In response, we introduce an innovative resource allocation algorithm for space -based backbone networks. This algorithm represents a synergistic fusion of Deep Reinforcement Learning (DRL) and Local Search (LS) methodologies. It is specifically designed to reduce the extensive training duration associated with traditional policy networks, a crucial aspect in assuring optimal service quality. Our algorithm is structured within a two -stage framework that seamlessly integrates DRL and LS. A distinctive feature of our approach is the incorporation of link reliability into the algorithmic design. This element is meticulously tailored to address the dynamic and heterogeneous nature of space -based networks, ensuring effective resource management. The effectiveness of our approach is substantiated through extensive simulation results. These results demonstrate that the integration of DRL with LS not only enhances training efficiency but also exhibits significant improvements in resource allocation outcomes. Our work represents a noteworthy contribution to the development of practical optimization strategies in space -based networks, merging DRL with traditional methodologies for improved performance.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A Resource Allocation Algorithm for Space-Air-Ground Integrated Network Based on Deep Reinforcement Learning
    Liu, Xuefang
    Mao, Weihao
    Yang, Qinghai
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (07): : 2831 - 2841
  • [2] Resource allocation algorithm for MEC based on Deep Reinforcement Learning
    Wang, Yijie
    Chen, Xin
    Chen, Ying
    Du, Shougang
    2021 IEEE INTERNATIONAL PERFORMANCE, COMPUTING, AND COMMUNICATIONS CONFERENCE (IPCCC), 2021,
  • [3] Network Resource Allocation Strategy Based on Deep Reinforcement Learning
    Zhang, Shidong
    Wang, Chao
    Zhang, Junsan
    Duan, Youxiang
    You, Xinhong
    Zhang, Peiying
    IEEE OPEN JOURNAL OF THE COMPUTER SOCIETY, 2020, 1 (01): : 86 - 94
  • [4] Research on Resource Allocation Method of Space Information Networks Based on Deep Reinforcement Learning
    Meng, Xiangli
    Wu, Lingda
    Yu, Shaobo
    REMOTE SENSING, 2019, 11 (04)
  • [5] Resource Allocation Based on Alternating Direction Multiplier Method and Deep Reinforcement Learning Algorithm
    Guo, Xingkang
    Sun, Jun
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2022, 45 (06): : 122 - 126
  • [6] Deep reinforcement learning based resource allocation algorithm in cellular networks
    Liao X.
    Yan S.
    Shi J.
    Tan Z.
    Zhao Z.
    Li Z.
    Tongxin Xuebao/Journal on Communications, 2019, 40 (02): : 11 - 18
  • [7] Intelligent Deep Reinforcement Learning based Resource Allocation in Fog network
    Divya, V
    Sri, Leena R.
    2019 26TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA AND ANALYTICS WORKSHOP (HIPCW 2019), 2019, : 18 - 22
  • [8] An Optimized Resource Allocation Method Based on Deep Reinforcement Learning for the Ad Hoc Network of TACS
    Shi, Yi
    Bu, Bing
    Li, Qichang
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 5536 - 5541
  • [9] Reinforcement Learning-Based Resource Allocation for Streaming in a Multi-Modal Deep Space Network
    Ha, Taeyun
    Oh, Junsuk
    Lee, Donghyun
    Lee, Jeonghwa
    Jeon, Yongin
    Cho, Sungrae
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 201 - 206
  • [10] Radio Resource Allocation Method for Network Slicing using Deep Reinforcement Learning
    Abiko, Yu
    Saito, Takato
    Ikeda, Daizo
    Ohta, Ken
    Mizuno, Tadanori
    Mineno, Hiroshi
    2020 34TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2020), 2020, : 420 - 425