Adaptive Multi-Core Real-Time Scheduling Based on Reinforcement Learning

被引:2
作者
Liang, Yonghui [1 ,2 ,3 ]
Li, Hui [1 ,2 ,3 ]
Shen, Fei [4 ]
Xu, Qimin [1 ,2 ,3 ]
Hua, Shuna [5 ]
Zhu, Shanying [1 ,2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[2] Minist Educ China, Key Lab Syst Control & Informat Proc, Shanghai 200240, Peoples R China
[3] Shanghai Engn Res Ctr Intelligent Control & Manag, Shanghai 200240, Peoples R China
[4] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Key Lab Wireless Sensor Network & Commun, Shanghai 200050, Peoples R China
[5] North Informat Control Res Acad Grp Co Ltd, Nanjing 211153, Peoples R China
来源
2024 IEEE 18TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION, ICCA 2024 | 2024年
基金
国家重点研发计划;
关键词
D O I
10.1109/ICCA62789.2024.10591927
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the transformation towards industrial intelligence, multi-core processors are increasingly being applied in real-time networked control systems to ensure secure execution of sensing, computing and actuating tasks under time constraints. However, existing scheduling methods result in either low CPU utilization or many missed task deadlines in dynamic systems. In this paper, we propose a two-layer scheduling architecture to address this issue by fully exploring the complex dependency between real-time tasks. To be specific, the local layer determines task execution priorities considering both dependency between tasks and deadline constraints by utilizing a reinforcement learning approach. Moreover, to better utilize the parallel capabilities of multi-core processors and reduce temporal collisions, this paper minimizes the requested core count for the task set based on a greedy strategy. The global layer designs a scheduling algorithm based on the preempt method and provides schedulability analysis of multiple task sets. Experimental results validate the correctness of the proposed scheduling approach, and efficiency is demonstrated through comparisons with baseline method.
引用
收藏
页码:148 / 153
页数:6
相关论文
共 16 条
[1]   Real-Time scheduling and analysis of parallel tasks on heterogeneous multi-cores [J].
Chang, Shuangshuang ;
Zhao, Xufeng ;
Liu, Zhenyu ;
Deng, Qingxu .
JOURNAL OF SYSTEMS ARCHITECTURE, 2020, 105
[2]  
Guo Baoshen, 2021, 2021 IEEE Real-Time Systems Symposium (RTSS)., P176, DOI 10.1109/RTSS52674.2021.00026
[3]   On-line self-adaptive framework for tailoring a neural-agent learning model addressing dynamic real-time scheduling problems [J].
Hammami, Zeineb ;
Mouelhi, Wiem ;
Ben Said, Lamjed .
JOURNAL OF MANUFACTURING SYSTEMS, 2017, 45 :97-108
[4]   Reinforcement learning applications to machine scheduling problems: a comprehensive literature review [J].
Kayhan, Behice Meltem ;
Yildiz, Gokalp .
JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 34 (03) :905-929
[5]   Reinforcement learning in robotics: A survey [J].
Kober, Jens ;
Bagnell, J. Andrew ;
Peters, Jan .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) :1238-1274
[6]  
Lei K., 2023, IEEE Transactions on Industrial Informatics
[7]   Compliance Control Using Hydraulic Heavy-Duty Manipulator [J].
Li, Lianpeng ;
Xie, Lun ;
Luo, Xiong ;
Wang, Zhiliang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (02) :1193-1201
[8]  
Marouf M, 2011, IEEE INT C EMERG
[9]   Survey on Periodic Scheduling for Time-triggered Hard Real-time Systems [J].
Minaeva, Anna ;
Hanzalek, Zdenek .
ACM COMPUTING SURVEYS, 2021, 54 (01)
[10]   On arrival scheduling of real-time precedence constrained tasks on multi-processor systems using genetic algorithm [J].
Muhuri, Pranab K. ;
Rauniyar, Amit ;
Nath, Rahul .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 93 :702-726