Deep Reinforcement Learning Task Scheduling Method for Real-Time Performance Awareness

被引:0
|
作者
Wang, Jinming [1 ]
Li, Shaobo [1 ]
Zhang, Xingxing [1 ,2 ]
Zhu, Keyu [1 ]
Xie, Cankun [1 ]
Wu, Fengbin [1 ]
机构
[1] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
[2] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 119077, Singapore
来源
IEEE ACCESS | 2025年 / 13卷
基金
中国国家自然科学基金;
关键词
Dynamic scheduling; Cloud computing; Heuristic algorithms; Scheduling; Load management; Real-time systems; Time factors; Stochastic processes; Servers; Load modeling; Task scheduling; load performance fluctuation; deep reinforcement learning; load balancing;
D O I
10.1109/ACCESS.2025.3534980
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Load balancing is essential for the efficient delivery of cloud computing services, ensuring stable operation and robust performance under high load conditions. However, existing load-balancing task scheduling algorithms struggle to adapt to load performance fluctuations in real-time, leading to inaccuracies in evaluating task execution efficiency and consequently impacting the quality of service in actual cloud task scheduling. To address this issue, we propose a real-time performance-aware task scheduling method based on the Soft Actor-Critic (RTPA-SAC) algorithm. This method dynamically detects server load performance changes in real-time, enhancing environmental consistency and adaptability in stochastic, dynamic task scheduling, thereby improving load balancing. First, we construct a bounded load performance loss function to evaluate task execution efficiency, considering the impact of parallel task interference. Next, a reward mechanism is introduced, which takes into account both load fluctuations and response times, optimizing task load variance within quality of service constraints to minimize response time. Finally, By leveraging the Soft Actor-Critic algorithm, the proposed scheduling strategy enhances exploratory and stable decision-making in task scheduling. Experimental results show that RTPA-SAC outperforms baseline methods in load balancing, evidenced by improvements in task response time, average task load variance, and task success rate.
引用
收藏
页码:31385 / 31400
页数:16
相关论文
共 50 条
  • [21] Learning to Calibrate Battery Models in Real-Time with Deep Reinforcement Learning
    Unagar, Ajaykumar
    Tian, Yuan
    Chao, Manuel Arias
    Fink, Olga
    ENERGIES, 2021, 14 (05)
  • [22] Real-time planning and collision avoidance control method based on deep reinforcement learning
    Xu, Xinli
    Cai, Peng
    Cao, Yunlong
    Chu, Zhenzhong
    Zhu, Wenbo
    Zhang, Weidong
    OCEAN ENGINEERING, 2023, 281
  • [23] Evolving population method for real-time reinforcement learning
    Kim, Man-Je
    Kim, Jun Suk
    Ahn, Chang Wook
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 229
  • [24] Real-time adaptive task scheduling
    Tanaka, K
    ESA '05: PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON EMBEDDED SYSTEMS AND APPLICATIONS, 2005, : 24 - 30
  • [25] Deep Reinforcement Learning for Sponsored Search Real-time Bidding
    Zhao, Jun
    Qiu, Guang
    Guan, Ziyu
    Zhao, Wei
    He, Xiaofei
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1021 - 1030
  • [26] Real-time deep reinforcement learning based vehicle navigation
    Koh, Songsang
    Zhou, Bo
    Fang, Hui
    Yang, Po
    Yang, Zaili
    Yang, Qiang
    Guan, Lin
    Ji, Zhigang
    APPLIED SOFT COMPUTING, 2020, 96
  • [27] Real-time scheduling for dynamic workshops with random new job insertions by using deep reinforcement learning
    Sun, Z. Y.
    Han, W. M.
    Gao, L. L.
    ADVANCES IN PRODUCTION ENGINEERING & MANAGEMENT, 2023, 18 (02): : 137 - 151
  • [28] Constrained large-scale real-time EV scheduling based on recurrent deep reinforcement learning
    Li, Hang
    Li, Guojie
    Lie, Tek Tjing
    Li, Xingzhi
    Wang, Keyou
    Han, Bei
    Xu, Jin
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 144
  • [29] Real-time scheduling for distributed permutation flowshops with dynamic job arrivals using deep reinforcement learning
    Yang, Shengluo
    Wang, Junyi
    Xu, Zhigang
    ADVANCED ENGINEERING INFORMATICS, 2022, 54
  • [30] Real-Time Scheduling of Electric Bus Flash Charging at Intermediate Stops: A Deep Reinforcement Learning Approach
    Bi, Xiaowen
    Wang, Ruoheng
    Ye, Hongbo
    Hu, Qian
    Bu, Siqi
    Chung, Edward
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (03): : 6309 - 6324