Computation offloading and resource allocation strategy based on deep reinforcement learning

被引:0
|
作者
Zeng F. [1 ]
Zhang Z. [1 ]
Chen Z. [1 ]
机构
[1] School of Computer Science and Engineering, Central South University, Changsha
来源
Tongxin Xuebao/Journal on Communications | 2023年 / 44卷 / 07期
基金
中国国家自然科学基金;
关键词
computation offloading; deep reinforcement learning; resource allocation; space-air-ground integrated vehicle network;
D O I
10.11959/j.issn.1000-436x.2023139
中图分类号
学科分类号
摘要
In order to expand the coverage and computing power of vehicle edge network, a computation offloading architecture was proposed for space-air-ground integrated vehicle network (SAGVN). With the consideration of the delay and energy consumption constraints of computing tasks, as well as the spectrum, computing and storage constraints in the SAGVN, the joint optimization problem of computation offloading decision and resource allocation was modeled as a mixed integer nonlinear programming problem. Based on the reinforcement learning method, the original problem was transformed into a Markov process, and a deep reinforcement learning algorithm was proposed to solve the problem. The proposed algorithm has the good convergence. The simulation results show that the proposed algorithm outperforms other algorithms in terms of task delay and success rate. © 2023 Editorial Board of Journal on Communications. All rights reserved.
引用
收藏
页码:124 / 135
页数:11
相关论文
共 39 条
  • [1] LI Z Y, WANG Q, CHEN Y F, Et al., A survey on task offloading research in vehicular edge computing, Chinese Journal of Computers, 44, 5, pp. 963-982, (2021)
  • [2] LIN H, ZEADALLY S, CHEN Z H, Et al., A survey on computation offloading modeling for edge computing, Journal of Network and Computer Applications, 169, (2020)
  • [3] LIU Y J, WANG S G, HUANG J, Et al., A computation offloading algorithm based on game theory for vehicular edge networks, Proceedings of 2018 IEEE International Conference on Communications, pp. 1-6, (2018)
  • [4] ZHOU H, JIANG K, LIU X X, Et al., Deep reinforcement learning for energy-efficient computation offloading in mobile-edge computing, IEEE Internet of Things Journal, 9, 2, pp. 1517-1530, (2022)
  • [5] CHEN J, XING H L, XIAO Z W, Et al., A DRL agent for jointly optimizing computation offloading and resource allocation in MEC, IEEE Internet of Things Journal, 8, 24, pp. 17508-17524, (2021)
  • [6] SEID A M, BOATENG G O, ANOKYE S, Et al., Collaborative computation offloading and resource allocation in multi-UAV-assisted IoT networks: a deep reinforcement learning approach, IEEE Internet of Things Journal, 8, 15, pp. 12203-12218, (2021)
  • [7] GONG Y K, YAO H P, WANG J J, Et al., Edge intelligence-driven joint offloading and resource allocation for future 6G industrial Internet of things, IEEE Transactions on Network Science and Engineering, (2022)
  • [8] HUANG X M, YU R, LIU J Q, Et al., Parked vehicle edge computing: exploiting opportunistic resources for distributed mobile applications, IEEE Access, 6, pp. 66649-66663, (2018)
  • [9] LI C H, WANG S M, HUANG X M, Et al., Parked vehicular computing for energy-efficient Internet of vehicles: a contract theoretic approach, IEEE Internet of Things Journal, 6, 4, pp. 6079-6088, (2019)
  • [10] ZHANG L, ZHAO Z, WU Q W, Et al., Energy-aware dynamic resource allocation in UAV assisted mobile edge computing over social Internet of vehicles, IEEE Access, 6, pp. 56700-56715, (2018)