Developing Real-Time Scheduling Policy by Deep Reinforcement Learning

被引:8
|
作者
Bo, Zitong [1 ,2 ]
Qiao, Ying [1 ]
Leng, Chang [1 ]
Wang, Hongan [1 ]
Guo, Chaoping [1 ]
Zhang, Shaohui [3 ]
机构
[1] Chinese Acad Sci, Inst Software, Beijing Key Lab Human Comp Interact, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Beijing Natl Speed Skating Oval Operat Co Ltd, Beijing, Peoples R China
来源
2021 IEEE 27TH REAL-TIME AND EMBEDDED TECHNOLOGY AND APPLICATIONS SYMPOSIUM (RTAS 2021) | 2021年
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
real-time scheduling; reinforcement learning; multiprocessor system; deep neural network;
D O I
10.1109/RTAS52030.2021.00019
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Designing scheduling policies for multiprocessor real-time systems is challenging since the multiprocessor scheduling problem is NP-complete. The existing heuristics are customized policies that may achieve poor performance under some specific task loads. Thus, a new design pattern is needed to make the multiprocessor scheduling policies perform well under various task loads. In this paper, we investigate a new real-time scheduling policy based on reinforcement learning. For any given real-time task set, our policy can automatically derive a high performance by online learning. Specifically, we model the real-time scheduling process as a multi-agent cooperative game and propose multi-agent self-cooperative learning that overcomes the curse of dimensionality and credit assignment problems. Simulation results show that our approach can learn high-performance policies for various task/system models.
引用
收藏
页码:131 / 142
页数:12
相关论文
共 50 条
  • [31] Real-Time Object Navigation With Deep Neural Networks and Hierarchical Reinforcement Learning
    Staroverov, Aleksey
    Yudin, Dmitry A.
    Belkin, Ilya
    Adeshkin, Vasily
    Solomentsev, Yaroslav K.
    Panov, Aleksandr I.
    IEEE ACCESS, 2020, 8 : 195608 - 195621
  • [32] An FRTDS Real-Time Simulation Optimized Task Scheduling Algorithm Based on Reinforcement Learning
    Guan, Y.
    Zhang, B. D.
    Jin, Z.
    IEEE ACCESS, 2020, 8 (08): : 155797 - 155810
  • [33] On real-time scheduling in Fog computing: A Reinforcement Learning algorithm with application to smart cities
    Mattia, Gabriele Proietti
    Beraldi, Roberto
    2022 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS AND OTHER AFFILIATED EVENTS (PERCOM WORKSHOPS), 2022,
  • [34] Real-Time Virtual Machine Scheduling in Industry IoT Network: A Reinforcement Learning Method
    Ma, Xiaojin
    Xu, Huahu
    Gao, Honghao
    Bian, Minjie
    Hussain, Walayat
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) : 2129 - 2139
  • [35] Reinforcement learning in real-time geometry assurance
    Jorge, Emilio
    Brynte, Lucas
    Cronrath, Constantin
    Wigstrom, Oskar
    Bengtsson, Kristofer
    Gustaysson, Emil
    Lennartson, Bengt
    Jirstrand, Mats
    51ST CIRP CONFERENCE ON MANUFACTURING SYSTEMS, 2018, 72 : 1073 - 1078
  • [36] Deep reinforcement learning for optimal hydraulic fracturing design in real-time production optimization
    Yan, Bingyang
    Zhong, Zhi
    GEOENERGY SCIENCE AND ENGINEERING, 2025, 250
  • [37] Real-Time Obstacle Avoidance and Pathfinding for Robot Manipulators Based on Deep Reinforcement Learning
    Hu, Jun
    Mao, Jianliang
    Zhou, Xin
    Zhang, Chuanlin
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2024, PT III, 2025, 15203 : 154 - 166
  • [38] Reinforcement Learning-based Real-time Scheduling Under Random Machine Breakdowns and Other Disturbances: A Case Study
    Ghaleb, Mageed
    Namoura, Hamed A.
    Taghipour, Sharareh
    67TH ANNUAL RELIABILITY & MAINTAINABILITY SYMPOSIUM (RAMS 2021), 2021,
  • [39] Real-Time Bidding by Reinforcement Learning in Display Advertising
    Cai, Han
    Ren, Kan
    Zhang, Weinan
    Malialis, Kleanthis
    Wang, Jun
    Yu, Yong
    Guo, Defeng
    WSDM'17: PROCEEDINGS OF THE TENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2017, : 661 - 670
  • [40] Reinforcement Learning Based on Real-Time Iteration NMPC
    Zanon, Mario
    Kungurtsev, Vyacheslav
    Gros, Sebastien
    IFAC PAPERSONLINE, 2020, 53 (02): : 5213 - 5218