Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning

被引:12
作者
Cao, Zequn [1 ]
Deng, Xiaoheng [1 ]
Yue, Sheng [2 ]
Jiang, Ping [1 ]
Ren, Ju [2 ]
Gui, Jinsong [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410075, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, BNRist, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Training; Heuristic algorithms; Cloud computing; Quality of experience; Scheduling; Program processors; Deep reinforcement learning (DRL); directed acyclic graph (DAG); edge computing (EC); graph attention network (GAT); task offloading; RESOURCE-ALLOCATION;
D O I
10.1109/JIOT.2024.3374969
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Task offloading is a widely used technology in edge computing (EC), which declines the makespan of user task with the aid of resourceful edge servers. How to solve the competition for computation and communication resources among tasks is a fundamental issue in task offloading. Besides, real-life user tasks often comprise multiple interdependent subtasks. Dependencies among subtasks significantly raises the complexity of task offloading, and makes it difficult to propose generalized approaches for scenarios of different sizes. In this article, we study the dependent task offloading (DTO) problem within both single-user single-edge and multiuser multiedge scenario. First, we use directed acyclic graph (DAG) to model dependent task, where nodes and directed edges represent the subtasks and their interdependencies, respectively. Then, we propose a task scheduling method based on graph attention network (GAT) and deep reinforcement learning (DRL) to minimize the makespan of user tasks. More specifically, our method introduces a multidiscrete action DRL scheduler that simultaneously determines which subtask to consider and whether it should be offloaded at each step, and employs GAT to encode the graph-based state representation. To stabilize and speed up DRL scheduler training, we pretrain GAT encoder with unsupervised learning. Extensive experiments demonstrate that our proposed approach can be applied to various environments and outperforms prior methods.
引用
收藏
页码:21632 / 21646
页数:15
相关论文
共 49 条
[1]   List Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table [J].
Arabnejad, Hamid ;
Barbosa, Jorge G. .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2014, 25 (03) :682-694
[2]   Multitask Offloading Strategy Optimization Based on Directed Acyclic Graphs for Edge Computing [J].
Chen, Jiawen ;
Yang, Yajun ;
Wang, Chenyang ;
Zhang, Heng ;
Qiu, Chao ;
Wang, Xiaofei .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (12) :9367-9378
[3]   Integrating State Representation Learning into Deep Reinforcement Learning [J].
De Bruin, Tim ;
Kober, Jens ;
Tuyls, Karl ;
Babuska, Robert .
IEEE Robotics and Automation Letters, 2018, 3 (03) :1394-1401
[4]   Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing [J].
Deng, Xiaoheng ;
Zhang, Jingjing ;
Zhang, Honggang ;
Jiang, Ping .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (06) :5364-5377
[5]  
Fujimoto S, 2018, Arxiv, DOI arXiv:1802.09477
[6]  
Grandl R, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P81
[7]  
Haarnoja T, 2018, PR MACH LEARN RES, V80
[8]  
Hamilton WL, 2017, ADV NEUR IN, V30
[9]   Efficient Task Offloading with Dependency Guarantees in Ultra-Dense Edge Networks [J].
Han, Yunpeng ;
Zhao, Zhiwei ;
Mo, Jiwei ;
Shu, Chang ;
Min, Geyong .
2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
[10]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735