An optimized task offloading strategy based on deep reinforcement learning combined with channel reliability prediction

被引:0
|
作者
Tang, Weicheng [1 ,4 ]
Yang, Yubin [1 ]
Gao, Donghui [1 ]
Chen, Juan [1 ]
Huang, Suqun [1 ]
Chen, Ningjiang [1 ,2 ,3 ]
机构
[1] Guangxi Univ, Sch Comp & Elect & Informat, Nanning 530004, Peoples R China
[2] Guangxi Univ, Educ Dept Guangxi Zhuang Autonomous Reg, Key Lab Parallel Distributed & Intelligent Comp, Nanning 530004, Peoples R China
[3] Guangxi Intelligent Digital Serv Res Ctr Engn Tech, Nanning 530004, Peoples R China
[4] Guangxi Police Coll, Sch Informat Technol, Nanning 530004, Peoples R China
基金
中国国家自然科学基金;
关键词
Edge computing; Task offloading; Channel reliability; Deep Reinforcement Learning; MOBILE-EDGE; RESOURCE-ALLOCATION;
D O I
10.1007/s11276-024-03838-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing provides a new solution to meet the computing demands of emerging applications such as the industrial Internet, which cannot be fully met by the resources on the device side. However, the edge nodes and transmission channels are not always completely reliable. When the network channel is unreliable, it is easy to cause task transmission failure and lower service quality. In this paper, an optimized task offloading strategy based on deep reinforcement learning combined with channel reliability prediction is proposed, named deep deterministic policy gradient-based strategy combined with hindsight experience replay and LSTM (HL-DDPG). The HL-DDPG strategy uses long short-term memory (LSTM) to mine the time dependence between the channel reliability states. The task offloading is then modeled using the Markov decision process (MDP), and the joint optimization problem is solved using the DRL method based on the Actor-Critic framework. Meanwhile, Hindsight experience replay (HER) is used to improve the learning ability of the algorithm. The experimental results show that compared with four baseline algorithms, HL-DDPG has a lower overall offloading error probability and a lower task timeout rate, which effectively improves the reliability of the edge offloading system and reduces the risk of task transmission failure.
引用
收藏
页码:1663 / 1682
页数:20
相关论文
共 50 条
  • [1] Deep Reinforcement Learning-based Task Offloading Decision in the Time Varying Channel
    Jeong, Jinkyo
    Kim, Il-Min
    Hong, Daesik
    2021 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2021,
  • [2] Task offloading strategy and scheduling optimization for internet of vehicles based on deep reinforcement learning
    Zhao, Xu
    Liu, Mingzhen
    Li, Maozhen
    AD HOC NETWORKS, 2023, 147
  • [3] Task Offloading Based-on Deep Reinforcement Learning for Microgrid
    Wang, Ye
    Jin, Xianzhi
    Xu, Ren
    Shao, Wenyi
    Lin, Fei
    2022 IEEE 10TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATION AND NETWORKS (ICICN 2022), 2022, : 281 - 285
  • [4] Research on Dependent Task Offloading Based on Deep Reinforcement Learning
    Zhu, Qianwen
    Guo, Juan
    2024 6TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING, ICNLP 2024, 2024, : 705 - 709
  • [5] Deep Reinforcement Learning Based Task Offloading Strategy Under Dynamic Pricing in Edge Computing
    Shi, Bing
    Chen, Feiyang
    Tang, Xing
    SERVICE-ORIENTED COMPUTING (ICSOC 2021), 2021, 13121 : 578 - 594
  • [6] Dependent Task-Offloading Strategy Based on Deep Reinforcement Learning in Mobile Edge Computing
    Gong, Bencan
    Jiang, Xiaowei
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2023, 2023
  • [7] Multi-Satellite Cooperative Computing Task Offloading Strategy Based on Deep Reinforcement Learning
    Cao, Hufan
    Peng, Yizhuang
    Wang, Houpeng
    Jia, Haolin
    Kong, Linghai
    Cao, Suzhi
    2024 4TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND ARTIFICIAL INTELLIGENCE, CCAI 2024, 2024, : 464 - 471
  • [8] Optimization of lightweight task offloading strategy for mobile edge computing based on deep reinforcement learning
    Lu, Haifeng
    Gu, Chunhua
    Luo, Fei
    Ding, Weichao
    Liu, Xinping
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 102 : 847 - 861
  • [9] Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning
    Zhuang, Wei
    Xing, Fanan
    Lu, Yuhang
    SENSORS, 2024, 24 (07)
  • [10] Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT
    Tu, Youpeng
    Chen, Haiming
    Yan, Linjie
    Zhou, Xinyan
    FUTURE INTERNET, 2022, 14 (02):