Deep Reinforcement Learning for Shared Offloading Strategy in Vehicle Edge Computing

被引:29
作者
Peng, Xin [1 ]
Han, Zhengke [1 ]
Xie, Wenwu [1 ]
Yu, Chao [1 ]
Zhu, Peng [1 ]
Xiao, Jian [1 ]
Yang, Jinxia [1 ]
机构
[1] Hunan Inst Sci & Technol, Sch Informat Sci & Engn, Yueyang 414015, Peoples R China
来源
IEEE SYSTEMS JOURNAL | 2023年 / 17卷 / 02期
关键词
Task analysis; Servers; Optimization; Edge computing; Computational modeling; Reinforcement learning; Delays; Deep reinforcement learning (DRL); Internet of Vehicles (IoVs); task shared offloading; vehicular edge computing (VEC); RESOURCE-ALLOCATION; VEHICULAR NETWORKS; SCHEME;
D O I
10.1109/JSYST.2022.3190926
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular edge computing (VEC) effectively reduces the computing load of vehicles by offloading computing tasks from vehicle terminals to edge servers. However, offloading of tasks increase in quantity the transmission time and energy of the network. In order to reduce the computing load of edge servers and improve the system response, a shared offloading strategy based on deep reinforcement learning is proposed for the complex computing environment of Internet of Vehicles (IoVs). The shared offloading strategy exploits the commonality of vehicles task requests, similar computing tasks coming from different vehicles can share the computing results of former task submitted. The shared offloading strategy can be adapted to the complex scenarios of the IoVs. Each vehicle can share the offloading conditions of the VEC servers, and then adaptively select three computing modes: local execution, task offloading, and shared offloading. In this article, the network state and offloading strategy space are the input of the deep reinforcement learning (DRL). Through the DRL, each task unit selects the offloading strategy with the optimal energy consumption at each time period in the dynamic IoVs transmission and computing environment. Compared with the existing proposals and DRL-based algorithms, it can effectively reduce the delay and energy consumption required for tasks offloading.
引用
收藏
页码:2089 / 2100
页数:12
相关论文
共 35 条
[11]   Deep Reinforcement Learning for Offloading and Resource Allocation in Vehicle Edge Computing and Networks [J].
Liu, Yi ;
Yu, Huimin ;
Xie, Shengli ;
Zhang, Yan .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (11) :11158-11168
[12]   Cooperative Vehicular Content Distribution in Edge Computing Assisted 5G-VANET [J].
Luo, Guiyang ;
Yuan, Quan ;
Zhou, Haibo ;
Cheng, Nan ;
Liu, Zhihan ;
Yang, Fangchun ;
Shen, Xuemin .
CHINA COMMUNICATIONS, 2018, 15 (07) :1-17
[13]   A Survey on Mobile Edge Computing: The Communication Perspective [J].
Mao, Yuyi ;
You, Changsheng ;
Zhang, Jun ;
Huang, Kaibin ;
Letaief, Khaled B. .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2017, 19 (04) :2322-2358
[14]  
Mao YY, 2017, IEEE WCNC
[15]   Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting Devices [J].
Mao, Yuyi ;
Zhang, Jun ;
Letaief, Khaled B. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2016, 34 (12) :3590-3605
[16]   Online Computation Offloading in NOMA-Based Multi-Access Edge Computing: A Deep Reinforcement Learning Approach [J].
Nduwayezu, Maurice ;
Quoc-Viet Pham ;
Hwang, Won-Joo .
IEEE ACCESS, 2020, 8 :99098-99109
[17]   Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System [J].
Ning, Zhaolong ;
Zhang, Kaiyuan ;
Wang, Xiaojie ;
Obaidat, Mohammad S. ;
Guo, Lei ;
Hu, Xiping ;
Hu, Bin ;
Guo, Yi ;
Sadoun, Balqies ;
Kwok, Ricky Y. K. .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (08) :5201-5212
[18]   Mobile Edge Computing-Enabled Internet of Vehicles: Toward Energy-Efficient Scheduling [J].
Ning, Zhaolong ;
Huang, Jun ;
Wang, Xiaojie ;
Rodrigues, Joel J. P. C. ;
Guo, Lei .
IEEE NETWORK, 2019, 33 (05) :198-205
[19]   Energy-Efficient NOMA-Based Mobile Edge Computing Offloading [J].
Pan, Yijin ;
Chen, Ming ;
Yang, Zhaohui ;
Huang, Nuo ;
Shikh-Bahaei, Mohammad .
IEEE COMMUNICATIONS LETTERS, 2019, 23 (02) :310-313
[20]   Spectrum Management for Multi-Access Edge Computing in Autonomous Vehicular Networks [J].
Peng, Haixia ;
Ye, Qiang ;
Shen, Xuemin .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (07) :3001-3012