Adaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems

被引:280
|
作者
Sun, Yuxuan [1 ]
Guo, Xueying [2 ]
Song, Jinhui [1 ]
Zhou, Sheng [1 ]
Jiang, Zhiyuan [3 ]
Liu, Xin [2 ]
Niu, Zhisheng [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Univ Calif Davis, Dept Comp Sci, Davis, CA 95616 USA
[3] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
基金
国家重点研发计划;
关键词
Vehicular edge computing; task offloading; online learning; multi-armed bandit; CLOUD; VEHICLE;
D O I
10.1109/TVT.2019.2895593
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The vehicular edge computing system integrates the computing resources of vehicles, and provides computing services for other vehicles and pedestrians with task offloading. However, the vehicular task offloading environment is dynamic and uncertain, with fast varying network topologies, wireless channel states, and computing workloads. These uncertainties bring extra challenges to task offloading. In this paper, we consider the task offloading among vehicles, and propose a solution that enables vehicles to learn the offloading delay performance of their neighboring vehicles while offloading computation tasks. We design an adaptive learning based task offloading (ALTO) algorithm based on the multi-armed bandit theory, in order to minimize the average offloading delay. ALTO works in a distributed manner without requiring frequent state exchange, and is augmented with input-awareness and occurrence-awareness to adapt to the dynamic environment. The proposed algorithm is proved to have a sublinear learning regret. Extensive simulations are carried out under both synthetic scenario and realistic highway scenario, and results illustrate that the proposed algorithm achieves low delay performance, and decreases the average delay up to 30% compared with the existing upper confidence bound based learning algorithm.
引用
收藏
页码:3061 / 3074
页数:14
相关论文
共 50 条
  • [31] Efficient and Trusted Task Offloading in Vehicular Edge Computing Networks
    Chen, Xiangshen
    Guo, Hongzhi
    Liu, Jiajia
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 5201 - 5206
  • [32] Fast Adaptive Task Offloading in Edge Computing Based on Meta Reinforcement Learning
    Wang, Jin
    Hu, Jia
    Min, Geyong
    Zomaya, Albert Y.
    Georgalas, Nektarios
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (01) : 242 - 253
  • [33] Dynamic Vehicle Aware Task Offloading Based on Reinforcement Learning in a Vehicular Edge Computing Network
    Wang, Lingling
    Zhu, Xiumin
    Li, Nianxin
    Li, Yumei
    Ma, Shuyue
    Zhai, Linbo
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 263 - 270
  • [34] Meta Reinforcement Learning for Multi-Task Offloading in Vehicular Edge Computing
    Dai, Penglin
    Huang, Yaorong
    Hu, Kaiwen
    Wu, Xiao
    Xing, Huanlai
    Yu, Zhaofei
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (03) : 2123 - 2138
  • [35] An RSU-crossed dependent task offloading scheme for vehicular edge computing based on deep reinforcement learning
    Bi, Xiang
    Shi, Jianing
    Zhang, Benhong
    Lyu, Zengwei
    Huang, Lingjie
    INTERNATIONAL JOURNAL OF SENSOR NETWORKS, 2023, 41 (04) : 244 - 256
  • [36] Machine Learning-Based Workload Orchestrator for Vehicular Edge Computing
    Sonmez, Cagatay
    Tunca, Can
    Ozgovde, Atay
    Ersoy, Cem
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (04) : 2239 - 2251
  • [37] Task offloading in vehicular edge computing networks via deep reinforcement learning
    Karimi, Elham
    Chen, Yuanzhu
    Akbari, Behzad
    COMPUTER COMMUNICATIONS, 2022, 189 : 193 - 204
  • [38] Optimization Scheme of Vehicular Edge Computing Task Offloading Based on Digital Twin Assistance
    Au, Lin
    Tan, Long
    Li, Bingxian
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 544 - 549
  • [39] Blockchain-based Distributed Storage System for Task Offloading in Vehicular Edge Computing
    Zhang, Yutian
    Tang, Bing
    Yang, Qing
    Zhang, Xiaoyuan
    Luo, Jincheng
    2022 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING, ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM, 2022, : 589 - 596
  • [40] Deep reinforcement learning approach for multi-hop task offloading in vehicular edge computing
    Ahmed, Manzoor
    Raza, Salman
    Ahmad, Haseeb
    Khan, Wali Ullah
    Xu, Fang
    Rabie, Khaled
    ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2024, 59