Imitation learning enabled fast and adaptive task scheduling in cloud

被引:4
|
作者
Kang, KaiXuan [2 ]
Ding, Ding [1 ,2 ]
Xie, HuaMao [2 ]
Zhao, LiHong [2 ]
Li, YiNong [2 ]
Xie, YiXuan [2 ]
机构
[1] Minist Educ, Key Lab Big Data & Artificial Intelligence Transpo, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2024年 / 154卷
关键词
Cloud computing; Task scheduling; Energy efficient; Deadline constrained; Deep reinforcement learning; Imitation learning;
D O I
10.1016/j.future.2024.01.002
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Studies of resource provision in cloud computing have drawn extensive attention, since effective task scheduling solutions promise an energy -efficient way of utilizing resources while meeting diverse requirements of users. Deep reinforcement learning (DRL) has demonstrated its outstanding capability in tackling this issue with the ability of online self -learning, however, it is still prevented by the low sampling efficiency, poor sample validity, and slow convergence speed especially for deadline constrained applications. To address these challenges, an Imitation Learning Enabled Fast and Adaptive Task Scheduling (ILETS) framework based on DRL is proposed in this paper. First, we introduce behavior cloning to provide a well-behaved and robust model through Offline Initial Network Parameters Training (OINPT) so as to guarantee the initial decision -making quality of DRL. Next, we design a novel Online Asynchronous Imitation Learning (OAIL)-based method to assist the DRL agent to re -optimize its policy and to against the oscillations caused by the high dynamic of the cloud, which promises DRL agent moving towards the optimal policy with a fast and stable process. Extensive experiments on the real -world dataset have demonstrated that the proposed ILETS can consistently produce shorter response time, lower energy consumption and higher success rate than the baselines and other state-of-the-art methods at the accelerated convergence speed.
引用
收藏
页码:160 / 172
页数:13
相关论文
共 50 条
  • [21] Task Scheduling Mechanism Based on Reinforcement Learning in Cloud Computing
    Wang, Yugui
    Dong, Shizhong
    Fan, Weibei
    MATHEMATICS, 2023, 11 (15)
  • [22] Machine learning approach to optimal task scheduling in cloud communication
    Alsubaei, Faisal S.
    Hamed, Ahmed Y.
    Hassan, Moatamad R.
    Mohery, M.
    Elnahary, M. Kh.
    ALEXANDRIA ENGINEERING JOURNAL, 2024, 89 : 1 - 30
  • [23] Cloud Task Scheduling based on Swarm Intelligence and Machine Learning
    Rjoub, Gaith
    Bentahar, Jamal
    2017 IEEE 5TH INTERNATIONAL CONFERENCE ON FUTURE INTERNET OF THINGS AND CLOUD (FICLOUD 2017), 2017, : 272 - 279
  • [24] An adaptive symbiotic organisms search for constrained task scheduling in cloud computing
    Mohammed Abdullahi
    Md Asri Ngadi
    Salihu Idi Dishing
    Shafi’i Muhammad Abdulhamid
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 8839 - 8850
  • [25] Adaptive Scheduling Algorithm Based Task Loading in Cloud Data Centers
    Mukherjee, Dibyendu
    Ghosh, Shivnath
    Pal, Souvik
    Aly, Ayman A.
    Le, Dac-Nhuong
    IEEE ACCESS, 2022, 10 : 49412 - 49421
  • [26] Adaptive task scheduling method in multi-tenant cloud computing
    Ramegowda A.
    Agarkhed J.
    Patil S.R.
    International Journal of Information Technology, 2020, 12 (4) : 1093 - 1102
  • [27] Energy efficient task scheduling using adaptive PSO for cloud computing
    Rani R.
    Garg R.
    International Journal of Reasoning-based Intelligent Systems, 2021, 13 (02) : 50 - 58
  • [28] Alts: An Adaptive Load Balanced Task Scheduling Approach for Cloud Computing
    Mubeen, Aroosa
    Ibrahim, Muhammad
    Bibi, Nargis
    Baz, Mohammad
    Hamam, Habib
    Cheikhrouhou, Omar
    PROCESSES, 2021, 9 (09)
  • [29] An adaptive symbiotic organisms search for constrained task scheduling in cloud computing
    Abdullahi, Mohammed
    Ngadi, Md Asri
    Dishing, Salihu Idi
    Abdulhamid, Shafi'i Muhammad
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 14 (7) : 8839 - 8850
  • [30] Task Scheduling Based on Adaptive Priority Experience Replay on Cloud Platforms
    Li, Cuixia
    Gao, Wenlong
    Shi, Li
    Shang, Zhiquan
    Zhang, Shuyan
    ELECTRONICS, 2023, 12 (06)