Deep Reinforcement Learning Task Scheduling Method for Real-Time Performance Awareness

被引:0
|
作者
Wang, Jinming [1 ]
Li, Shaobo [1 ]
Zhang, Xingxing [1 ,2 ]
Zhu, Keyu [1 ]
Xie, Cankun [1 ]
Wu, Fengbin [1 ]
机构
[1] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
[2] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 119077, Singapore
来源
IEEE ACCESS | 2025年 / 13卷
基金
中国国家自然科学基金;
关键词
Dynamic scheduling; Cloud computing; Heuristic algorithms; Scheduling; Load management; Real-time systems; Time factors; Stochastic processes; Servers; Load modeling; Task scheduling; load performance fluctuation; deep reinforcement learning; load balancing;
D O I
10.1109/ACCESS.2025.3534980
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Load balancing is essential for the efficient delivery of cloud computing services, ensuring stable operation and robust performance under high load conditions. However, existing load-balancing task scheduling algorithms struggle to adapt to load performance fluctuations in real-time, leading to inaccuracies in evaluating task execution efficiency and consequently impacting the quality of service in actual cloud task scheduling. To address this issue, we propose a real-time performance-aware task scheduling method based on the Soft Actor-Critic (RTPA-SAC) algorithm. This method dynamically detects server load performance changes in real-time, enhancing environmental consistency and adaptability in stochastic, dynamic task scheduling, thereby improving load balancing. First, we construct a bounded load performance loss function to evaluate task execution efficiency, considering the impact of parallel task interference. Next, a reward mechanism is introduced, which takes into account both load fluctuations and response times, optimizing task load variance within quality of service constraints to minimize response time. Finally, By leveraging the Soft Actor-Critic algorithm, the proposed scheduling strategy enhances exploratory and stable decision-making in task scheduling. Experimental results show that RTPA-SAC outperforms baseline methods in load balancing, evidenced by improvements in task response time, average task load variance, and task success rate.
引用
收藏
页码:31385 / 31400
页数:16
相关论文
共 50 条
  • [31] Real-time scheduling of power grid digital twin tasks in cloud via deep reinforcement learning
    Qi, Daokun
    Xi, Xiaojuan
    Tang, Yake
    Zheng, Yuesong
    Guo, Zhengwei
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2024, 13 (01):
  • [32] Cost-aware real-time job scheduling for hybrid cloud using deep reinforcement learning
    Cheng, Long
    Kalapgar, Archana
    Jain, Amogh
    Wang, Yue
    Qin, Yongtai
    Li, Yuancheng
    Liu, Cong
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (21): : 18579 - 18593
  • [33] A Cooperative Multi-Agent Deep Reinforcement Learning Framework for Real-Time Residential Load Scheduling
    Zhang, Chi
    Kuppannagari, Sanmukh R.
    Xiong, Chuanxiu
    Kannan, Rajgopal
    Prasanna, Viktor K.
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTERNET OF THINGS DESIGN AND IMPLEMENTATION (IOTDI '19), 2019, : 59 - 69
  • [34] Cost-aware real-time job scheduling for hybrid cloud using deep reinforcement learning
    Long Cheng
    Archana Kalapgar
    Amogh Jain
    Yue Wang
    Yongtai Qin
    Yuancheng Li
    Cong Liu
    Neural Computing and Applications, 2022, 34 : 18579 - 18593
  • [35] Petri-net-based deep reinforcement learning for real-time scheduling of automated manufacturing systems
    Luo, Jiliang
    Yi, Sijia
    Lin, Zexuan
    Zhang, Hongbin
    Zhou, Jiazhong
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 74 : 995 - 1008
  • [36] Real-Time Reinforcement Learning
    Ramstedt, Simon
    Pal, Christopher
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [37] Real-time Scheduling using Reinforcement Learning Technique for the Connected Vehicles
    Park, Seongjin
    Yoo, Younghwan
    2018 IEEE 87TH VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2018,
  • [38] Hybrid DVFS Scheduling for Real-Time Systems Based on Reinforcement Learning
    Muhammad, Fakhruddin
    ul Islam, Mahbub
    Lin, Man
    IEEE SYSTEMS JOURNAL, 2017, 11 (02): : 931 - 940
  • [39] Hierarchical Reinforcement-Learning for Real-Time Scheduling of Agile Satellites
    Ren, Lili
    Ning, Xin
    Li, Jiayin
    IEEE ACCESS, 2020, 8 (08): : 220523 - 220532
  • [40] Real-time power scheduling through reinforcement learning from demonstrations
    Liu, Shaohuai
    Liu, Jinbo
    Yang, Nan
    Huang, Yupeng
    Jiang, Qirong
    Gao, Yang
    ELECTRIC POWER SYSTEMS RESEARCH, 2024, 235