A DDPG Hybrid of Graph Attention Network and Action Branching for Multi-Scale End-Edge-Cloud Vehicular Orchestrated Task Offloading

被引:5
作者
He, Yejun [1 ]
Zhong, Xiaoxu [1 ]
Gan, Youhui [1 ,3 ]
Cui, Haixia [2 ]
Guizani, Mohsen
机构
[1] Shenzhen Univ, Shenzhen, Peoples R China
[2] South China Normal Univ, Guangzhou, Peoples R China
[3] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Task analysis; Collaboration; Servers; Delays; Processor scheduling; 6G mobile communication; Optimization;
D O I
10.1109/MWC.019.2100718
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of 5G technologies and the wide application of artificial intelligence (AI), the mobile intelligent equipment and the providing services have both seen a significant rise in numbers and types. Some services, such as vehicular tasks, may go beyond the capability of the mobile equipment so that task offloading is required to help deliver such services. However, the graph structure of task offloading data, which can be a key to further improve algorithm's performance, is seldomly considered in future 6G-AI combined communication systems. In this article, we propose an efficient end-edge-cloud orchestration system that combines storage-partition and computation-shared in cloud cluster, cache mechanism, and cybertwin components. At the same time, we model this dynamic system as a graph structure composed of nodes and edges and propose a novel task offloading algorithm that incorporates a graph attention network (GAT) and action branching into deep deterministic policy gradient (DDPG) framework. Numerical results show that our offloading scheme achieves a good performance boost compared with other baseline schemes.
引用
收藏
页码:147 / 153
页数:7
相关论文
共 15 条
[1]   Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks [J].
Huang, Liang ;
Bi, Suzhi ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (11) :2581-2593
[2]   Computation Offloading for Edge-Assisted Federated Learning [J].
Ji, Zhongming ;
Chen, Li ;
Zhao, Nan ;
Chen, Yunfei ;
Wei, Guo ;
Yu, F. Richard .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (09) :9330-9344
[3]   Deep Reinforcement Learning-Based Adaptive Computation Offloading for MEC in Heterogeneous Vehicular Networks [J].
Ke, Hongchang ;
Wang, Jian ;
Deng, Lingyue ;
Ge, Yuming ;
Wang, Hui .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (07) :7916-7929
[4]   Joint Resource Allocation and Computation Offloading in Mobile Edge Computing for SDN based Wireless Networks [J].
Kiran, Nahida ;
Pan, Chunyu ;
Wang, Sihua ;
Yin, Changchuan .
JOURNAL OF COMMUNICATIONS AND NETWORKS, 2020, 22 (01) :1-11
[5]  
Lillicrap T.P., 2015, CONTINUOUS CONTROL D, DOI [10.48550/arXiv.1509.02971, DOI 10.48550/ARXIV.1509.02971]
[6]   Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System [J].
Ning, Zhaolong ;
Zhang, Kaiyuan ;
Wang, Xiaojie ;
Obaidat, Mohammad S. ;
Guo, Lei ;
Hu, Xiping ;
Hu, Bin ;
Guo, Yi ;
Sadoun, Balqies ;
Kwok, Ricky Y. K. .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (08) :5201-5212
[7]   Priority-Aware Task Offloading in Vehicular Fog Computing Based on Deep Reinforcement Learning [J].
Shi, Jinming ;
Du, Jun ;
Wang, Jingjing ;
Wang, Jian ;
Yuan, Jian .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (12) :16067-16081
[8]  
Tavakoli A., 2018, P ASS ADV ART INT FE, P1
[9]  
U. of OULU, 2015, 6G white paper
[10]  
Velickovic P., 2018, P INT C LEARNING REP