A Deep Reinforcement Learning approach for the throughput control of a Flow-Shop production system

被引:5
作者
Marchesano, Maria Grazia [1 ]
Guizzi, Guido [1 ]
Santillo, Liberatina Carmela [1 ]
Vespoli, Silvestro [1 ]
机构
[1] Univ Napoli Federico II, Dipartimento Ingn Chim Mat & Prod Ind, Ple Tecchio 80, I-80125 Naples, Italy
来源
IFAC PAPERSONLINE | 2021年 / 54卷 / 01期
关键词
Neural networks in process control; DQN; Reinforcement learning; Flow Shop; Industry; 4.0; JOB-SHOP;
D O I
10.1016/j.ifacol.2021.08.006
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a new method for controlling a flow shop in terms of throughput and Work In Process (WIP). In order to achieve a throughput target, a Deep Q -Network (DQN) is used to define the constant WIP quantity in the system. The main contribution of this paper is the novel approach used to formulate the state, action space, and reward function. An extensive pre experimental campaign is conducted to determine the best network structure and appropriate hyperparameter values. Finally, the system's performance is compared to the known results of an analytical model from the literature (Practical Worst Case, PWC). Copyright (C) 2021 The Authors.
引用
收藏
页码:61 / 66
页数:6
相关论文
共 19 条
[1]   Collaborative reinforcement learning for a two-robot job transfer flow-shop scheduling problem [J].
Arviv, Kfir ;
Stern, Helman ;
Edan, Yael .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2016, 54 (04) :1196-1209
[2]   A reinforcement learning based approach for multi-projects scheduling in cloud manufacturing [J].
Chen, Shengkai ;
Fang, Shuiliang ;
Tang, Renzhong .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2019, 57 (10) :3080-3098
[3]   Assessing the performances of a novel decentralised scheduling approach in Industry 4.0 and cloud manufacturing contexts [J].
Grassi, Andrea ;
Guizzi, Guido ;
Santillo, Liberatina Carmela ;
Vespoli, Silvestro .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2021, 59 (20) :6034-6053
[4]   Flowshop scheduling with artificial neural networks [J].
Gupta, Jatinder N. D. ;
Majumder, Arindam ;
Laha, Dipak .
JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2020, 71 (10) :1619-1637
[5]  
Hofmann Constantin, 2020, Procedia CIRP, V88, P25, DOI 10.1016/j.procir.2020.05.005
[6]   A deep reinforcement learning approach for chemical production scheduling [J].
Hubbs, Christian D. ;
Li, Can ;
Sahinidis, Nikolaos, V ;
Grossmann, Ignacio E. ;
Wassick, John M. .
COMPUTERS & CHEMICAL ENGINEERING, 2020, 141
[7]   Design, Implementation and Evaluation of Reinforcement Learning for an Adaptive Order Dispatching in Job Shop Manufacturing Systems [J].
Kuhnle, Andreas ;
Schaefer, Louis ;
Stricker, Nicole ;
Lanza, Gisela .
52ND CIRP CONFERENCE ON MANUFACTURING SYSTEMS (CMS), 2019, 81 :234-239
[8]   Defining accurate delivery dates in make to order job-shops managed by workload control [J].
Mezzogori, Davide ;
Romagnoli, Giovanni ;
Zammori, Francesco .
FLEXIBLE SERVICES AND MANUFACTURING JOURNAL, 2021, 33 (04) :956-991
[9]   Deep learning and WLC: how to set realistic delivery dates in high variety manufacturing systems [J].
Mezzogori, Davide ;
Romagnoli, Giovanni ;
Zammori, Francesco .
IFAC PAPERSONLINE, 2019, 52 (13) :2092-2097
[10]   Production scheduling in the context of Industry 4.0: review and trends [J].
Parente, Manuel ;
Figueira, Goncalo ;
Amorim, Pedro ;
Marques, Alexandra .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2020, 58 (17) :5401-5431