Deep Reinforcement Learning Task Scheduling Method for Real-Time Performance Awareness

被引:0
|
作者
Wang, Jinming [1 ]
Li, Shaobo [1 ]
Zhang, Xingxing [1 ,2 ]
Zhu, Keyu [1 ]
Xie, Cankun [1 ]
Wu, Fengbin [1 ]
机构
[1] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
[2] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 119077, Singapore
来源
IEEE ACCESS | 2025年 / 13卷
基金
中国国家自然科学基金;
关键词
Dynamic scheduling; Cloud computing; Heuristic algorithms; Scheduling; Load management; Real-time systems; Time factors; Stochastic processes; Servers; Load modeling; Task scheduling; load performance fluctuation; deep reinforcement learning; load balancing;
D O I
10.1109/ACCESS.2025.3534980
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Load balancing is essential for the efficient delivery of cloud computing services, ensuring stable operation and robust performance under high load conditions. However, existing load-balancing task scheduling algorithms struggle to adapt to load performance fluctuations in real-time, leading to inaccuracies in evaluating task execution efficiency and consequently impacting the quality of service in actual cloud task scheduling. To address this issue, we propose a real-time performance-aware task scheduling method based on the Soft Actor-Critic (RTPA-SAC) algorithm. This method dynamically detects server load performance changes in real-time, enhancing environmental consistency and adaptability in stochastic, dynamic task scheduling, thereby improving load balancing. First, we construct a bounded load performance loss function to evaluate task execution efficiency, considering the impact of parallel task interference. Next, a reward mechanism is introduced, which takes into account both load fluctuations and response times, optimizing task load variance within quality of service constraints to minimize response time. Finally, By leveraging the Soft Actor-Critic algorithm, the proposed scheduling strategy enhances exploratory and stable decision-making in task scheduling. Experimental results show that RTPA-SAC outperforms baseline methods in load balancing, evidenced by improvements in task response time, average task load variance, and task success rate.
引用
收藏
页码:31385 / 31400
页数:16
相关论文
共 50 条
  • [41] Real-time scheduling for a smart factory using a reinforcement learning approach
    Shiue, Yeou-Ren
    Lee, Ken-Chuan
    Su, Chao-Ton
    COMPUTERS & INDUSTRIAL ENGINEERING, 2018, 125 : 604 - 614
  • [42] Optimal real-time scheduling of battery operation using reinforcement learning
    Juarez, Carolina Quiroz
    Musilek, Petr
    2021 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (CCECE), 2021,
  • [43] Task Scheduling in Cloud Using Deep Reinforcement Learning
    Swarup, Shashank
    Shakshuki, Elhadi M.
    Yasar, Ansar
    12TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 4TH INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2021, 184 : 42 - 51
  • [44] Scheduling conditional task graphs with deep reinforcement learning
    Debner, Anton
    Krahn, Maximilian
    Hirvisalo, Vesa
    NORTHERN LIGHTS DEEP LEARNING CONFERENCE, VOL 233, 2024, 233 : 46 - 52
  • [45] Combining EDF and LST to Enhance the Performance of Real-Time Task Scheduling
    Ayele, Amare Anagaw
    Kumar, Dileep G.
    Rao, Vuda Sreenivasa
    Bokka, Radha Krishna
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ICT IN BUSINESS INDUSTRY & GOVERNMENT (ICTBIG), 2016,
  • [46] A deep reinforcement learning based method for real-time path planning and dynamic obstacle avoidance
    Chen, Pengzhan
    Pei, Jiean
    Lu, Weiqing
    Li, Mingzhen
    NEUROCOMPUTING, 2022, 497 : 64 - 75
  • [47] Real-time Multi-person Pose Tracking Method Using Deep Reinforcement Learning
    Jia, Baojian
    Ren, Jie
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2023, 23 (06)
  • [48] Real-Time Scheduling of Operational Time for Smart Home Appliances Based on Reinforcement Learning
    Khan, Murad
    Seo, Junho
    Kim, Dongkyun
    IEEE ACCESS, 2020, 8 : 116520 - 116534
  • [49] Reinforcement learning and digital twin-based real-time scheduling method in intelligent manufacturing systems
    Zhang, Lixiang
    Yan, Yan
    Hu, Yaoguang
    Ren, Weibo
    IFAC PAPERSONLINE, 2022, 55 (10): : 359 - 364
  • [50] Safe reinforcement learning method integrating process knowledge for real-time scheduling of gas supply network
    Zhou, Pengwei
    Xu, Zuhua
    Zhu, Xiaoping
    Zhao, Jun
    Song, Chunyue
    Shao, Zhijiang
    INFORMATION SCIENCES, 2023, 633 : 280 - 304