Adaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems

被引:280
|
作者
Sun, Yuxuan [1 ]
Guo, Xueying [2 ]
Song, Jinhui [1 ]
Zhou, Sheng [1 ]
Jiang, Zhiyuan [3 ]
Liu, Xin [2 ]
Niu, Zhisheng [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Univ Calif Davis, Dept Comp Sci, Davis, CA 95616 USA
[3] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
基金
国家重点研发计划;
关键词
Vehicular edge computing; task offloading; online learning; multi-armed bandit; CLOUD; VEHICLE;
D O I
10.1109/TVT.2019.2895593
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The vehicular edge computing system integrates the computing resources of vehicles, and provides computing services for other vehicles and pedestrians with task offloading. However, the vehicular task offloading environment is dynamic and uncertain, with fast varying network topologies, wireless channel states, and computing workloads. These uncertainties bring extra challenges to task offloading. In this paper, we consider the task offloading among vehicles, and propose a solution that enables vehicles to learn the offloading delay performance of their neighboring vehicles while offloading computation tasks. We design an adaptive learning based task offloading (ALTO) algorithm based on the multi-armed bandit theory, in order to minimize the average offloading delay. ALTO works in a distributed manner without requiring frequent state exchange, and is augmented with input-awareness and occurrence-awareness to adapt to the dynamic environment. The proposed algorithm is proved to have a sublinear learning regret. Extensive simulations are carried out under both synthetic scenario and realistic highway scenario, and results illustrate that the proposed algorithm achieves low delay performance, and decreases the average delay up to 30% compared with the existing upper confidence bound based learning algorithm.
引用
收藏
页码:3061 / 3074
页数:14
相关论文
共 50 条
  • [41] Comprehensive survey on reinforcement learning-based task offloading techniques in aerial edge computing
    Nabi, Ahmadun
    Baidya, Tanmay
    Moh, Sangman
    INTERNET OF THINGS, 2024, 28
  • [42] Cooperative Task Offloading in Cybertwin-Assisted Vehicular Edge Computing
    Zhang, Enchao
    Zhao, Liang
    Lin, Na
    Zhang, Weijun
    Hawbani, Ammar
    Min, Geyong
    2022 IEEE 20TH INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING, EUC, 2022, : 66 - 73
  • [43] Slicing-Based Offloading in Vehicular Edge Computing
    Berri, Sara
    Hejja, Khaled
    Labiod, Houda
    2021 IEEE 22ND INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE SWITCHING AND ROUTING (IEEE HPSR), 2021,
  • [44] Reinforcement-Learning-Based Deadline Constrained Task Offloading Schema for Energy Saving in Vehicular Edge Computing System
    Do Bao Son
    Hiep Khac Vo
    Ta Huu Binh
    Tran Hoang Hai
    Binh Minh Nguyen
    Huynh Thi Thanh Binh
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [45] A Bee Colony-Based Algorithm for Task Offloading in Vehicular Edge Computing
    de Souza, Alisson Barbosa
    Leal Rego, Paulo Antonio
    Chamola, Vinay
    Carneiro, Tiago
    Goncalves Rocha, Paulo Henrique
    de Souza, Jose Neuman
    IEEE SYSTEMS JOURNAL, 2023, 17 (03): : 4165 - 4176
  • [46] Value-based reinforcement learning approaches for task offloading in Delay Constrained Vehicular Edge Computing
    Do Bao Son
    Ta Huu Binh
    Vo, Hiep Khac
    Binh Minh Nguyen
    Huynh Thi Thanh Binh
    Yu, Shui
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 113
  • [47] LTransformer: A Transformer-Based Framework for Task Offloading in Vehicular Edge Computing
    Yang, Yichi
    Yan, Ruibin
    Gu, Yijun
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [48] NOMA-Based Task Offloading and Allocation in Vehicular Edge Computing Networks
    Zhao, Shuangliang
    Shi, Lei
    Shi, Yi
    Zhao, Fei
    Fan, Yuqi
    COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING, COLLABORATECOM 2022, PT I, 2022, 460 : 343 - 359
  • [49] Deep Reinforcement Learning-Guided Task Reverse Offloading in Vehicular Edge Computing
    Gu, Anqi
    Wu, Huaming
    Tang, Huijun
    Tang, Chaogang
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2200 - 2205
  • [50] Task offloading under deterministic demand for vehicular edge computing
    Li, Haotian
    Li, Xujie
    Shen, Fei
    ETRI JOURNAL, 2023, 45 (04) : 627 - 635