Self-adapting WIP parameter setting using deep reinforcement learning

被引:4
作者
De Andrade e Silva, Manuel Tome [1 ]
Azevedo, Americo [1 ,2 ]
机构
[1] Univ Porto, Fac Engn, Porto, Portugal
[2] Inst Syst & Comp Engn, Technol & Sci, Porto, Portugal
关键词
WIP reduction; CONWIP; Deep reinforcement learning; WORKLOAD CONTROL; SYSTEMS; CONWIP; NUMBER; KANBANS; MULTIPRODUCT; THROUGHPUT; ALGORITHM; TIMES;
D O I
10.1016/j.cor.2022.105854
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study investigates the potential of dynamically adjusting WIP cap levels to maximize the throughput (TH) performance and minimize work in process (WIP), according to real-time system state arising from process variability associated with low volume and high-variety production systems. Using an innovative approach based on state-of-the-art deep reinforcement learning (proximal policy optimization algorithm), we attain WIP reductions of up to 50% and 30%, with practically no losses in throughput, against pure-push systems and the statistical throughput control method (STC), respectively. An exploratory study based on simulation experiments was performed to provide support to our research. The reinforcement learning agent's performance was shown to be robust to variability changes within the production systems.
引用
收藏
页数:14
相关论文
共 52 条
[1]   MONOTONICITY OF THE THROUGHPUT OF A CLOSED QUEUING NETWORK IN THE NUMBER OF JOBS [J].
ADAN, I ;
VANDERWAL, J .
OPERATIONS RESEARCH, 1989, 37 (06) :953-957
[2]   Artificial bee colony algorithm for CONWIP production control system in a multi-product multi-machine manufacturing environment [J].
Ajorlou, Saeede ;
Shams, Issac .
JOURNAL OF INTELLIGENT MANUFACTURING, 2013, 24 (06) :1145-1156
[3]   Systematic review and discussion of production control systems that emerged between 1999 and 2018 [J].
Bagni, Gustavo ;
Godinho Filho, Moacir ;
Thurer, Matthias ;
Stevenson, Mark .
PRODUCTION PLANNING & CONTROL, 2021, 32 (07) :511-525
[4]   DETERMINING THE NUMBER OF KANBANS IN A MULTIPRODUCT, MULTISTAGE PRODUCTION SYSTEM [J].
BARD, JF ;
GOLANY, B .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 1991, 29 (05) :881-895
[5]  
Bertrand J.W.M., 1981, Production control and information systems for component-manufacturing shops
[6]   The workload control concept: theory and practical extensions of Load Oriented Order Release [J].
Breithaupt, JW ;
Land, M ;
Nyhuis, P .
PRODUCTION PLANNING & CONTROL, 2002, 13 (07) :625-638
[7]   KANBAN CONTROLLED PULL SYSTEMS - AN ANALYTIC APPROACH [J].
DELEERSNYDER, JL ;
HODGSON, TJ ;
MULLER, H ;
OGRADY, PJ .
MANAGEMENT SCIENCE, 1989, 35 (09) :1079-1091
[8]  
Espeholt L., IMPALA SCALABLE DIST
[9]   Generic POLCA - A production and materials flow control mechanism for quick response manufacturing [J].
Fernandes, Nuno Octavio ;
do Carmo-Silva, Silvio .
INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 2006, 104 (01) :74-84
[10]  
Fujimoto S, 2018, PR MACH LEARN RES, V80