Self-adapting WIP parameter setting using deep reinforcement learning

被引:4
|
作者
De Andrade e Silva, Manuel Tome [1 ]
Azevedo, Americo [1 ,2 ]
机构
[1] Univ Porto, Fac Engn, Porto, Portugal
[2] Inst Syst & Comp Engn, Technol & Sci, Porto, Portugal
关键词
WIP reduction; CONWIP; Deep reinforcement learning; WORKLOAD CONTROL; SYSTEMS; CONWIP; NUMBER; KANBANS; MULTIPRODUCT; THROUGHPUT; ALGORITHM; TIMES;
D O I
10.1016/j.cor.2022.105854
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study investigates the potential of dynamically adjusting WIP cap levels to maximize the throughput (TH) performance and minimize work in process (WIP), according to real-time system state arising from process variability associated with low volume and high-variety production systems. Using an innovative approach based on state-of-the-art deep reinforcement learning (proximal policy optimization algorithm), we attain WIP reductions of up to 50% and 30%, with practically no losses in throughput, against pure-push systems and the statistical throughput control method (STC), respectively. An exploratory study based on simulation experiments was performed to provide support to our research. The reinforcement learning agent's performance was shown to be robust to variability changes within the production systems.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] A multi-layer and multi-ensemble stock trader using deep learning and deep reinforcement learning
    Carta, Salvatore
    Corriga, Andrea
    Ferreira, Anselmo
    Podda, Alessandro Sebastian
    Recupero, Diego Reforgiato
    APPLIED INTELLIGENCE, 2021, 51 (02) : 889 - 905
  • [22] Comparison of algorithms using deep reinforcement learning for optimization of hyperbolic metamaterials
    Hamada, Kenta
    Hsiao, Hui-Hsin
    Kubo, Wakana
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [23] Maintaining Links in the Highly Dynamic FANET Using Deep Reinforcement Learning
    Qiu, Xiulin
    Yang, Yuwang
    Xu, Lei
    Yin, Jun
    Liao, Zhenqiang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (03) : 2804 - 2818
  • [24] Airflow Direction Control of Air Conditioners Using Deep Reinforcement Learning
    Sakuma, Yuiko
    Nishi, Hiroaki
    2020 SICE INTERNATIONAL SYMPOSIUM ON CONTROL SYSTEMS (SICE ISCS 2020), 2020, : 61 - 68
  • [25] Acceleration for Deep Reinforcement Learning using Parallel and Distributed Computing: A Survey
    Liu, Zhihong
    Xu, Xin
    Qiao, Peng
    Li, Dongsheng
    ACM COMPUTING SURVEYS, 2025, 57 (04)
  • [26] Influence Maximization in Complex Networks by Using Evolutionary Deep Reinforcement Learning
    Ma, Lijia
    Shao, Zengyang
    Li, Xiaocong
    Lin, Qiuzhen
    Li, Jianqiang
    Leung, Victor C. M.
    Nandi, Asoke K.
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (04): : 995 - 1009
  • [27] Equipment Health Indicator Learning Using Deep Reinforcement Learning
    Zhang, Chi
    Gupta, Chetan
    Farahat, Ahmed
    Ristovski, Kosta
    Ghosh, Dipanjan
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT III, 2019, 11053 : 488 - 504
  • [28] Developments in Image Processing Using Deep Learning and Reinforcement Learning
    Valente, Jorge
    Antonio, Joao
    Mora, Carlos
    Jardim, Sandra
    JOURNAL OF IMAGING, 2023, 9 (10)
  • [29] Improving Spatiotemporal Self-supervision by Deep Reinforcement Learning
    Buechler, Uta
    Brattoli, Biagio
    Ommer, Bjoern
    COMPUTER VISION - ECCV 2018, PT 15, 2018, 11219 : 797 - 814
  • [30] Self-Learning Robot Autonomous Navigation with Deep Reinforcement Learning Techniques
    Pintos Gomez de las Heras, Borja
    Martinez-Tomas, Rafael
    Cuadra Troncoso, Jose Manuel
    APPLIED SCIENCES-BASEL, 2024, 14 (01):