Imitation learning enabled fast and adaptive task scheduling in cloud

被引:4
|
作者
Kang, KaiXuan [2 ]
Ding, Ding [1 ,2 ]
Xie, HuaMao [2 ]
Zhao, LiHong [2 ]
Li, YiNong [2 ]
Xie, YiXuan [2 ]
机构
[1] Minist Educ, Key Lab Big Data & Artificial Intelligence Transpo, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2024年 / 154卷
关键词
Cloud computing; Task scheduling; Energy efficient; Deadline constrained; Deep reinforcement learning; Imitation learning;
D O I
10.1016/j.future.2024.01.002
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Studies of resource provision in cloud computing have drawn extensive attention, since effective task scheduling solutions promise an energy -efficient way of utilizing resources while meeting diverse requirements of users. Deep reinforcement learning (DRL) has demonstrated its outstanding capability in tackling this issue with the ability of online self -learning, however, it is still prevented by the low sampling efficiency, poor sample validity, and slow convergence speed especially for deadline constrained applications. To address these challenges, an Imitation Learning Enabled Fast and Adaptive Task Scheduling (ILETS) framework based on DRL is proposed in this paper. First, we introduce behavior cloning to provide a well-behaved and robust model through Offline Initial Network Parameters Training (OINPT) so as to guarantee the initial decision -making quality of DRL. Next, we design a novel Online Asynchronous Imitation Learning (OAIL)-based method to assist the DRL agent to re -optimize its policy and to against the oscillations caused by the high dynamic of the cloud, which promises DRL agent moving towards the optimal policy with a fast and stable process. Extensive experiments on the real -world dataset have demonstrated that the proposed ILETS can consistently produce shorter response time, lower energy consumption and higher success rate than the baselines and other state-of-the-art methods at the accelerated convergence speed.
引用
收藏
页码:160 / 172
页数:13
相关论文
共 50 条
  • [31] Modular Adaptive Policy Selection for Multi-Task Imitation Learning through Task Division
    Antotsiou, Dafni
    Ciliberto, Carlo
    Kim, Tae-Kyun
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 2459 - 2465
  • [32] Imitation Learning for Task Allocation
    Duvallet, Felix
    Stentz, Anthony
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 3568 - 3573
  • [33] Knowledge Transfer Enabled Diverse Task Scheduling for Individualized Requirements in Industrial Cloud Platform
    Zhou, Jiajun
    Gao, Liang
    Lu, Chao
    Li, Yun
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024,
  • [34] An Energy-Efficient Task Scheduling Algorithm in DVFS-enabled Cloud Environment
    Tang, Zhuo
    Qi, Ling
    Cheng, Zhenzhen
    Li, Kenli
    Khan, Samee U.
    Li, Keqin
    JOURNAL OF GRID COMPUTING, 2016, 14 (01) : 55 - 74
  • [35] Self-Adaptive Learning PSO-Based Deadline Constrained Task Scheduling for Hybrid IaaS Cloud
    Zuo, Xingquan
    Zhang, Guoxiang
    Tan, Wei
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2014, 11 (02) : 564 - 573
  • [36] Fitness rate-based rider optimization enabled for optimal task scheduling in cloud
    Alameen, Abdalla
    Gupta, Ashu
    INFORMATION SECURITY JOURNAL, 2020, 29 (06): : 310 - 326
  • [37] Deep Adversarial Imitation Reinforcement Learning for QoS-Aware Cloud Job Scheduling
    Huang, Yifeng
    Cheng, Long
    Xue, Lianting
    Liu, Cong
    Li, Yuancheng
    Li, Jianbin
    Ward, Tomas
    IEEE SYSTEMS JOURNAL, 2022, 16 (03): : 4232 - 4242
  • [38] Runtime Task Scheduling Using Imitation Learning for Heterogeneous Many-Core Systems
    Krishnakumar, Anish
    Arda, Samet E.
    Goksoy, A. Alper
    Mandal, Sumit K.
    Ogras, Umit Y.
    Sartor, Anderson L.
    Marculescu, Radu
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2020, 39 (11) : 4064 - 4077
  • [39] Task Scheduling in Cloud Computing
    Razaque, Abdul
    Vennapusa, Nikhileshwara Reddy
    Soni, Nisargkumar
    Janapati, Guna Sree
    Vangala, Khilesh Reddy
    2016 IEEE LONG ISLAND SYSTEMS, APPLICATIONS AND TECHNOLOGY CONFERENCE (LISAT), 2016,
  • [40] Fast and Energy-Aware Resource Provisioning and Task Scheduling for Cloud Systems
    Li, Hongjia
    Li, Ji
    Yao, Wang
    Nazarian, Shahin
    Lin, Xue
    Wang, Yanzhi
    PROCEEDINGS OF THE EIGHTEENTH INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED), 2017, : 174 - 179