Dynamic job-shop scheduling using reinforcement learning agents

被引:185
作者
Aydin, ME
Öztemel, E
机构
[1] Sakarya Univ, Dept Ind Engn, TR-54040 Adapazari, Turkey
[2] Tubitak Marmara Res Ctr, BTAE, Artificial Intelligence Grp, Gebze, Kocaeli, Turkey
关键词
intelligent agents; reinforcement learning; Q-III learning; dynamic job-shop scheduling;
D O I
10.1016/S0921-8890(00)00087-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Static and dynamic scheduling methods have attracted a lot of attention in recent years. Among these, dynamic scheduling techniques handle scheduling problems where the scheduler does not possess detailed information about the jobs, which may arrive at the shop at any time. In this paper, an intelligent agent based dynamic scheduling system is proposed. It consists of two independent components: the agent and the simulated environment. The agent selects the most appropriate priority rule according to the shop conditions in real time, while simulated environment performs scheduling activities using the rule selected by the agent. The agent is trained by an improved reinforcement learning algorithm through the learning stage and then it successively makes decisions to schedule the operations. (C) 2000 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:169 / 178
页数:10
相关论文
共 50 条
[31]   A PSO-Assisted Reinforcement Learning Algorithm for Job Shop Scheduling [J].
Yue, Peng ;
Jin, Yaochu ;
Shi, Qi ;
Dai, Xuewu ;
Cui, Dongliang .
2024 6TH INTERNATIONAL CONFERENCE ON DATA-DRIVEN OPTIMIZATION OF COMPLEX SYSTEMS, DOCS 2024, 2024, :338-343
[32]   Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems [J].
Zhang, Yi ;
Zhu, Haihua ;
Tang, Dunbing ;
Zhou, Tong ;
Gui, Yong .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 78
[33]   Combining Reinforcement Learning Algorithms with Graph Neural Networks to Solve Dynamic Job Shop Scheduling Problems [J].
Yang, Zhong ;
Bi, Li ;
Jiao, Xiaogang .
PROCESSES, 2023, 11 (05)
[34]   A novel priority dispatch rule generation method based on graph neural network and reinforcement learning for distributed job-shop scheduling [J].
Huang, Jiang-Ping ;
Gao, Liang ;
Li, Xin-Yu ;
Zhang, Chun-Jiang .
JOURNAL OF MANUFACTURING SYSTEMS, 2023, 69 :119-134
[35]   An end-to-end deep reinforcement learning method based on graph neural network for distributed job-shop scheduling problem [J].
Huang, Jiang-Ping ;
Gao, Liang ;
Li, Xin-Yu .
EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
[36]   Evolutionary algorithm incorporating reinforcement learning for energy-conscious flexible job-shop scheduling problem with transportation and setup times [J].
Zhang, Guohui ;
Yan, Shaofeng ;
Song, Xiaohui ;
Zhang, Deyu ;
Guo, Shenghui .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
[37]   On The Effectiveness Of Bottleneck Information For Solving Job Shop Scheduling Problems Using Deep Reinforcement Learning [J].
de Puiseau, Constantin Waubert ;
Zey, Lennart ;
Demir, Merve ;
Tercan, Hasan ;
Meisen, Tobias .
PROCEEDINGS OF THE CONFERENCE ON PRODUCTION SYSTEMS AND LOGISTICS, CPSL 2023-2, 2023, :738-749
[38]   Robust and adaptable job shop scheduling using multiple agents [J].
Liu, N ;
Abdelrahman, MA ;
Ramaswamy, S .
PROCEEDINGS OF THE THIRTY-SEVENTH SOUTHEASTERN SYMPOSIUM ON SYSTEM THEORY, 2005, :45-49
[39]   Dynamic job-shop scheduling with sequence-dependent setup times: simulation modeling and analysis [J].
Vinod, V. ;
Sridharan, R. .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2008, 36 (3-4) :355-372
[40]   Multi-Agent Reinforcement Learning Tool for Job Shop Scheduling Problems [J].
Martinez Jimenez, Yailen ;
Coto Palacio, Jessica ;
Nowe, Ann .
OPTIMIZATION AND LEARNING, 2020, 1173 :3-12