Self-adapting WIP parameter setting using deep reinforcement learning

被引:4
|
作者
De Andrade e Silva, Manuel Tome [1 ]
Azevedo, Americo [1 ,2 ]
机构
[1] Univ Porto, Fac Engn, Porto, Portugal
[2] Inst Syst & Comp Engn, Technol & Sci, Porto, Portugal
关键词
WIP reduction; CONWIP; Deep reinforcement learning; WORKLOAD CONTROL; SYSTEMS; CONWIP; NUMBER; KANBANS; MULTIPRODUCT; THROUGHPUT; ALGORITHM; TIMES;
D O I
10.1016/j.cor.2022.105854
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study investigates the potential of dynamically adjusting WIP cap levels to maximize the throughput (TH) performance and minimize work in process (WIP), according to real-time system state arising from process variability associated with low volume and high-variety production systems. Using an innovative approach based on state-of-the-art deep reinforcement learning (proximal policy optimization algorithm), we attain WIP reductions of up to 50% and 30%, with practically no losses in throughput, against pure-push systems and the statistical throughput control method (STC), respectively. An exploratory study based on simulation experiments was performed to provide support to our research. The reinforcement learning agent's performance was shown to be robust to variability changes within the production systems.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Deep Reinforcement Learning-Based Optimal Parameter Design of Power Converters
    Bui, Van-Hai
    Chang, Fangyuan
    Su, Wencong
    Wang, Mengqi
    Murphey, Yi Lu
    Da Silva, Felipe Leno
    Huang, Can
    Xue, Lingxiao
    Glatt, Ruben
    2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 25 - 29
  • [32] Parameter Control Framework for Multiobjective Evolutionary Computation Based on Deep Reinforcement Learning
    Zhou, Tianwei
    Zhang, Wenwen
    Niu, Ben
    He, Pengcheng
    Yue, Guanghui
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [33] An Online Deep Reinforcement Learning Based Parameter Identification Method for HVDC System
    Hu, Jianxiong
    Wang, Qi
    Tang, Yi
    2021 IEEE POWER & ENERGY SOCIETY GENERAL MEETING (PESGM), 2021,
  • [34] An explainable deep reinforcement learning algorithm for the parameter configuration and adjustment in the consortium blockchain
    Zhai, Zhonghao
    Shen, Subin
    Mao, Yanqin
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [35] MonkeyKing: Adaptive Parameter Tuning on Big Data Platforms with Deep Reinforcement Learning
    Du, Haizhou
    Han, Ping
    Xiang, Qiao
    Huang, Sheng
    BIG DATA, 2020, 8 (04) : 270 - 290
  • [36] Neural-network-based parameter tuning for multi-agent simulation using deep reinforcement learning
    Hirano, Masanori
    Izumi, Kiyoshi
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (05): : 3535 - 3559
  • [37] Neural-network-based parameter tuning for multi-agent simulation using deep reinforcement learning
    Masanori Hirano
    Kiyoshi Izumi
    World Wide Web, 2023, 26 : 3535 - 3559
  • [38] Distance-Controllable Long Jump of Quadruped Robot Based on Parameter Optimization Using Deep Reinforcement Learning
    Liu, Qingyu
    Xu, Duo
    Yuan, Bing
    Mou, Zian
    Wang, Min
    IEEE ACCESS, 2023, 11 : 98566 - 98577
  • [39] Fully Autonomous Distributed Transmission Parameter Selection Method for Mobile IoT Applications Using Deep Reinforcement Learning
    Sugiyama, Seiya
    Makizoe, Keigo
    Arai, Maki
    Hasegawa, Mikio
    Otsuki, Tomoaki
    Li, Aohan
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [40] Character Behavior Automation Using Deep Reinforcement Learning
    Lee, Hyunki
    Dahouda, Mwamba Kasongo
    Joe, Inwhee
    IEEE ACCESS, 2023, 11 : 101435 - 101442