Imitation Learning Enabled Task Scheduling for Online Vehicular Edge Computing

被引:166
|
作者
Wang, Xiaojie [1 ]
Ning, Zhaolong [2 ,3 ]
Guo, Song [1 ]
Wang, Lei [2 ,4 ]
机构
[1] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[2] Dalian Univ Technol, Sch Software, Dalian 116024, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Mobile Commun Technol, Chongqing 400065, Peoples R China
[4] Peng Cheng Lab, Shenzhen 518055, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Processor scheduling; Servers; Heuristic algorithms; Delays; Vehicle dynamics; Mobile computing; Vehicular edge computing; task scheduling; imitation learning; online training; RESOURCE-ALLOCATION; ALGORITHM; NETWORKS;
D O I
10.1109/TMC.2020.3012509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular edge computing (VEC) is a promising paradigm based on the Internet of vehicles to provide computing resources for end users and relieve heavy traffic burden for cellular networks. In this paper, we consider a VEC network with dynamic topologies, unstable connections and unpredictable movements. Vehicles inside can offload computation tasks to available neighboring VEC clusters formed by onboard resources, with the purpose of both minimizing system energy consumption and satisfying task latency constraints. For online task scheduling, existing researches either design heuristic algorithms or leverage machine learning, e.g., deep reinforcement learning (DRL). However, these algorithms are not efficient enough because of their low searching efficiency and slow convergence speeds for large-scale networks. Instead, we propose an imitation learning enabled online task scheduling algorithm with near-optimal performance from the initial stage. Specially, an expert can obtain the optimal scheduling policy by solving the formulated optimization problem with a few samples offline. For online learning, we train agent policies by following the expert's demonstration with an acceptable performance gap in theory. Performance results show that our solution has a significant advantage with more than 50 percent improvement compared with the benchmark.
引用
收藏
页码:598 / 611
页数:14
相关论文
共 50 条
  • [1] Imitation-Learning-Enabled Vehicular Edge Computing: Toward Online Task Scheduling
    Nie, Laisen
    Wang, Xiaojie
    Sun, Wentao
    Li, Yongkang
    Li, Shengtao
    Zhang, Peng
    IEEE NETWORK, 2021, 35 (03): : 102 - 108
  • [2] Online Learning Enabled Task Offloading for Vehicular Edge Computing
    Zhang, Rui
    Cheng, Peng
    Chen, Zhuo
    Liu, Sige
    Li, Yonghui
    Vucetic, Branka
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (07) : 928 - 932
  • [3] Dependency-Aware Task Scheduling in Vehicular Edge Computing
    Liu, Yujiong
    Wang, Shangguang
    Zhao, Qinglin
    Du, Shiyu
    Zhou, Ao
    Ma, Xiao
    Yang, Fangchun
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (06) : 4961 - 4971
  • [4] Imitation learning enabled fast and adaptive task scheduling in cloud
    Kang, KaiXuan
    Ding, Ding
    Xie, HuaMao
    Zhao, LiHong
    Li, YiNong
    Xie, YiXuan
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 154 : 160 - 172
  • [5] Heterogeneous Task Oriented Data Scheduling in Vehicular Edge Computing via Deep Reinforcement Learning
    Luo, Quyuan
    Luan, Tom H.
    Shi, Weisong
    Fan, Pingzhi
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (12) : 19582 - 19596
  • [6] Learning IoV in Edge: Deep Reinforcement Learning for Edge Computing Enabled Vehicular Networks
    Xu, Shilin
    Guo, Caili
    Hu, Rose Qingyang
    Qian, Yi
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [7] Efficient task scheduling for servers with dynamic states in vehicular edge computing
    Wu, Yalan
    Wu, Jigang
    Chen, Long
    Yan, Jiaquan
    Luo, Yuchong
    COMPUTER COMMUNICATIONS, 2020, 150 : 245 - 253
  • [8] NOMA-Based Energy-Efficient Task Scheduling in Vehicular Edge Computing Networks: A Self-Imitation Learning-Based Approach
    Dong, Peiran
    Ning, Zhaolong
    Ma, Rong
    Wang, Xiaojie
    Hu, Xiping
    Hu, Bin
    CHINA COMMUNICATIONS, 2020, 17 (11) : 1 - 11
  • [9] NOMA-Based Energy-Efficient Task Scheduling in Vehicular Edge Computing Networks: A Self-Imitation Learning-Based Approach
    Peiran Dong
    Zhaolong Ning
    Rong Ma
    Xiaojie Wang
    Xiping Hu
    Bin Hu
    中国通信, 2020, 17 (11) : 1 - 11
  • [10] Task Migration Based on Reinforcement Learning in Vehicular Edge Computing
    Moon, Sungwon
    Park, Jaesung
    Lim, Yujin
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021