Deep Reinforcement Learning Task Scheduling Method for Real-Time Performance Awareness

被引:0
|
作者
Wang, Jinming [1 ]
Li, Shaobo [1 ]
Zhang, Xingxing [1 ,2 ]
Zhu, Keyu [1 ]
Xie, Cankun [1 ]
Wu, Fengbin [1 ]
机构
[1] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
[2] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 119077, Singapore
来源
IEEE ACCESS | 2025年 / 13卷
基金
中国国家自然科学基金;
关键词
Dynamic scheduling; Cloud computing; Heuristic algorithms; Scheduling; Load management; Real-time systems; Time factors; Stochastic processes; Servers; Load modeling; Task scheduling; load performance fluctuation; deep reinforcement learning; load balancing;
D O I
10.1109/ACCESS.2025.3534980
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Load balancing is essential for the efficient delivery of cloud computing services, ensuring stable operation and robust performance under high load conditions. However, existing load-balancing task scheduling algorithms struggle to adapt to load performance fluctuations in real-time, leading to inaccuracies in evaluating task execution efficiency and consequently impacting the quality of service in actual cloud task scheduling. To address this issue, we propose a real-time performance-aware task scheduling method based on the Soft Actor-Critic (RTPA-SAC) algorithm. This method dynamically detects server load performance changes in real-time, enhancing environmental consistency and adaptability in stochastic, dynamic task scheduling, thereby improving load balancing. First, we construct a bounded load performance loss function to evaluate task execution efficiency, considering the impact of parallel task interference. Next, a reward mechanism is introduced, which takes into account both load fluctuations and response times, optimizing task load variance within quality of service constraints to minimize response time. Finally, By leveraging the Soft Actor-Critic algorithm, the proposed scheduling strategy enhances exploratory and stable decision-making in task scheduling. Experimental results show that RTPA-SAC outperforms baseline methods in load balancing, evidenced by improvements in task response time, average task load variance, and task success rate.
引用
收藏
页码:31385 / 31400
页数:16
相关论文
共 50 条
  • [31] Real-time planning and collision avoidance control method based on deep reinforcement learning
    Xu, Xinli
    Cai, Peng
    Cao, Yunlong
    Chu, Zhenzhong
    Zhu, Wenbo
    Zhang, Weidong
    OCEAN ENGINEERING, 2023, 281
  • [32] Real-time adaptive task scheduling
    Tanaka, K
    ESA '05: PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON EMBEDDED SYSTEMS AND APPLICATIONS, 2005, : 24 - 30
  • [33] Real-time deep reinforcement learning based vehicle navigation
    Koh, Songsang
    Zhou, Bo
    Fang, Hui
    Yang, Po
    Yang, Zaili
    Yang, Qiang
    Guan, Lin
    Ji, Zhigang
    APPLIED SOFT COMPUTING, 2020, 96
  • [34] Real-Time Scheduling of Electric Bus Flash Charging at Intermediate Stops: A Deep Reinforcement Learning Approach
    Bi, Xiaowen
    Wang, Ruoheng
    Ye, Hongbo
    Hu, Qian
    Bu, Siqi
    Chung, Edward
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (03): : 6309 - 6324
  • [35] Real-time scheduling for distributed permutation flowshops with dynamic job arrivals using deep reinforcement learning
    Yang, Shengluo
    Wang, Junyi
    Xu, Zhigang
    ADVANCED ENGINEERING INFORMATICS, 2022, 54
  • [36] A Cooperative Multi-Agent Deep Reinforcement Learning Framework for Real-Time Residential Load Scheduling
    Zhang, Chi
    Kuppannagari, Sanmukh R.
    Xiong, Chuanxiu
    Kannan, Rajgopal
    Prasanna, Viktor K.
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTERNET OF THINGS DESIGN AND IMPLEMENTATION (IOTDI '19), 2019, : 59 - 69
  • [37] Petri-net-based deep reinforcement learning for real-time scheduling of automated manufacturing systems
    Luo, Jiliang
    Yi, Sijia
    Lin, Zexuan
    Zhang, Hongbin
    Zhou, Jiazhong
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 74 : 995 - 1008
  • [38] Hybrid DVFS Scheduling for Real-Time Systems Based on Reinforcement Learning
    Muhammad, Fakhruddin
    ul Islam, Mahbub
    Lin, Man
    IEEE SYSTEMS JOURNAL, 2017, 11 (02): : 931 - 940
  • [39] Real-time workflow scheduling in hybrid clouds with privacy and security constraints: A deep reinforcement learning approach
    He, Haoyang
    Gu, Yan
    Hu, Yang
    Fang, Fang
    Ning, Xin
    Chen, Xiaomin
    Cheng, Long
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 278
  • [40] A deep reinforcement learning approach for dynamic task scheduling of flight tests
    Tian, Bei
    Xiao, Gang
    Shen, Yu
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (13) : 18761 - 18796