Imitation learning enabled fast and adaptive task scheduling in cloud

被引:4
|
作者
Kang, KaiXuan [2 ]
Ding, Ding [1 ,2 ]
Xie, HuaMao [2 ]
Zhao, LiHong [2 ]
Li, YiNong [2 ]
Xie, YiXuan [2 ]
机构
[1] Minist Educ, Key Lab Big Data & Artificial Intelligence Transpo, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2024年 / 154卷
关键词
Cloud computing; Task scheduling; Energy efficient; Deadline constrained; Deep reinforcement learning; Imitation learning;
D O I
10.1016/j.future.2024.01.002
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Studies of resource provision in cloud computing have drawn extensive attention, since effective task scheduling solutions promise an energy -efficient way of utilizing resources while meeting diverse requirements of users. Deep reinforcement learning (DRL) has demonstrated its outstanding capability in tackling this issue with the ability of online self -learning, however, it is still prevented by the low sampling efficiency, poor sample validity, and slow convergence speed especially for deadline constrained applications. To address these challenges, an Imitation Learning Enabled Fast and Adaptive Task Scheduling (ILETS) framework based on DRL is proposed in this paper. First, we introduce behavior cloning to provide a well-behaved and robust model through Offline Initial Network Parameters Training (OINPT) so as to guarantee the initial decision -making quality of DRL. Next, we design a novel Online Asynchronous Imitation Learning (OAIL)-based method to assist the DRL agent to re -optimize its policy and to against the oscillations caused by the high dynamic of the cloud, which promises DRL agent moving towards the optimal policy with a fast and stable process. Extensive experiments on the real -world dataset have demonstrated that the proposed ILETS can consistently produce shorter response time, lower energy consumption and higher success rate than the baselines and other state-of-the-art methods at the accelerated convergence speed.
引用
收藏
页码:160 / 172
页数:13
相关论文
共 50 条
  • [41] An intelligent task scheduling approach for the enhancement of collaborative learning in cloud computing
    Sathishkumar, P.
    Kumar, Narendra
    Raju, S. Hrushikesava
    Victoria, D. Rosy Salomi
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2024, 43
  • [42] Task scheduling based on deep reinforcement learning in a cloud manufacturing environment
    Dong, Tingting
    Xue, Fei
    Xiao, Chuangbai
    Li, Juntao
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (11):
  • [43] Random task scheduling scheme based on reinforcement learning in cloud computing
    Peng, Zhiping
    Cui, Delong
    Zuo, Jinglong
    Li, Qirui
    Xu, Bo
    Lin, Weiwei
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2015, 18 (04): : 1595 - 1607
  • [44] Random task scheduling scheme based on reinforcement learning in cloud computing
    Zhiping Peng
    Delong Cui
    Jinglong Zuo
    Qirui Li
    Bo Xu
    Weiwei Lin
    Cluster Computing, 2015, 18 : 1595 - 1607
  • [45] Adaptive Task Scheduling in Cloud-Edge System for Edge Intelligence Application
    Zeng, Zeng
    Miao, Weiwei
    Li, Shihao
    Liao, Xiaoyun
    Zhang, Mingxuan
    Zhang, Rui
    Teng, Changzhi
    19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 1682 - 1689
  • [46] A Learning Automata-Based Scheduling for Deadline Sensitive Task in The Cloud
    Sahoo, Sampa
    Sahoo, Bibhudatta
    Turuk, Ashok Kumar
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2021, 14 (06) : 1662 - 1674
  • [47] A novel deep reinforcement learning scheme for task scheduling in cloud computing
    K. Siddesha
    G. V. Jayaramaiah
    Chandrapal Singh
    Cluster Computing, 2022, 25 : 4171 - 4188
  • [48] A novel deep reinforcement learning scheme for task scheduling in cloud computing
    Siddesha, K.
    Jayaramaiah, G. V.
    Singh, Chandrapal
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (06): : 4171 - 4188
  • [49] Deep Learning Based Security Model for Cloud based Task Scheduling
    Devi, K.
    Paulraj, D.
    Muthusenthil, B.
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2020, 14 (09): : 3663 - 3679
  • [50] Research on cloud computing adaptive task scheduling based on ant colony algorithm
    Liu, Hongji
    OPTIK, 2022, 258