Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning

被引:12
作者
Cao, Zequn [1 ]
Deng, Xiaoheng [1 ]
Yue, Sheng [2 ]
Jiang, Ping [1 ]
Ren, Ju [2 ]
Gui, Jinsong [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410075, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, BNRist, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Training; Heuristic algorithms; Cloud computing; Quality of experience; Scheduling; Program processors; Deep reinforcement learning (DRL); directed acyclic graph (DAG); edge computing (EC); graph attention network (GAT); task offloading; RESOURCE-ALLOCATION;
D O I
10.1109/JIOT.2024.3374969
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Task offloading is a widely used technology in edge computing (EC), which declines the makespan of user task with the aid of resourceful edge servers. How to solve the competition for computation and communication resources among tasks is a fundamental issue in task offloading. Besides, real-life user tasks often comprise multiple interdependent subtasks. Dependencies among subtasks significantly raises the complexity of task offloading, and makes it difficult to propose generalized approaches for scenarios of different sizes. In this article, we study the dependent task offloading (DTO) problem within both single-user single-edge and multiuser multiedge scenario. First, we use directed acyclic graph (DAG) to model dependent task, where nodes and directed edges represent the subtasks and their interdependencies, respectively. Then, we propose a task scheduling method based on graph attention network (GAT) and deep reinforcement learning (DRL) to minimize the makespan of user tasks. More specifically, our method introduces a multidiscrete action DRL scheduler that simultaneously determines which subtask to consider and whether it should be offloaded at each step, and employs GAT to encode the graph-based state representation. To stabilize and speed up DRL scheduler training, we pretrain GAT encoder with unsupervised learning. Extensive experiments demonstrate that our proposed approach can be applied to various environments and outperforms prior methods.
引用
收藏
页码:21632 / 21646
页数:15
相关论文
共 49 条
[41]   Reinforcement Learning-Based Mobile Offloading for Edge Computing Against Jamming and Interference [J].
Xiao, Liang ;
Lu, Xiaozhen ;
Xu, Tangwei ;
Wan, Xiaoyue ;
Ji, Wen ;
Zhang, Yanyong .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (10) :6114-6126
[42]   Service Offloading With Deep Q-Network for Digital Twinning-Empowered Internet of Vehicles in Edge Computing [J].
Xu, Xiaolong ;
Shen, Bowen ;
Ding, Sheng ;
Srivastava, Gautam ;
Bilal, Muhammad ;
Khosravi, Mohammad R. ;
Menon, Varun G. ;
Jan, Mian Ahmad ;
Wang, Maoli .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (02) :1414-1423
[43]   Offloading and Resource Allocation With General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach [J].
Yan, Jia ;
Bi, Suzhi ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (08) :5404-5419
[44]   Offloading Time Optimization via Markov Decision Process in Mobile-Edge Computing [J].
Yang, Guisong ;
Hou, Ling ;
He, Xingyu ;
He, Daojing ;
Chan, Sammy ;
Guizani, Mohsen .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (04) :2483-2493
[45]   A Deep Reinforcement Learning Based Offloading Game in Edge Computing [J].
Zhan, Yufeng ;
Guo, Song ;
Li, Peng ;
Zhang, Jiang .
IEEE TRANSACTIONS ON COMPUTERS, 2020, 69 (06) :883-893
[46]  
Zhang Xu, 2022, P MACHINE LEARNING R
[47]   Offloading Tasks With Dependency and Service Caching in Mobile Edge Computing [J].
Zhao, Gongming ;
Xu, Hongli ;
Zhao, Yangming ;
Qiao, Chunming ;
Huang, Liusheng .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (11) :2777-2792
[48]   Computation Offloading and Resource Allocation For Cloud Assisted Mobile Edge Computing in Vehicular Networks [J].
Zhao, Junhui ;
Li, Qiuping ;
Gong, Yi ;
Zhang, Ke .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (08) :7944-7956
[49]   Masked Contrastive Representation Learning for Reinforcement Learning [J].
Zhu, Jinhua ;
Xia, Yingce ;
Wu, Lijun ;
Deng, Jiajun ;
Zhou, Wengang ;
Qin, Tao ;
Liu, Tie-Yan ;
Li, Houqiang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) :3421-3433