Deep reinforcement learning for layout planning - An MDP-based approach for the facility layout problem

被引:4
作者
Heinbach, Benjamin [1 ]
Burggraef, Peter [1 ]
Wagner, Johannes [1 ]
机构
[1] Univ Siegen, Siegener Str 152, D-57223 Kreuztal, Germany
关键词
Reinforcement learning; Markov decision process; Facility layout problem; Machine learning; Optimization;
D O I
10.1016/j.mfglet.2023.09.007
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Deep Reinforcement Learning (DRL) has demonstrated operational excellence in several productionrelated problems. This paper applies DRL to facility layout problems (FLP) using Proximal Policy Optimisation, Advantage Actor-Critic and Deep Q-Networks. We show that the proposed approach produces an improved arrangement of facilities. The contribution of this work is the proof of concept that DRL can optimise layouts with respect to material handling costs using only an image representation of the layout and a reward signal. The approach shows potential to generalise to new layouts without the need to model or train, thus significantly speeding up layout design procedures. CO 2023 The Authors. Published by Elsevier Ltd on behalf of Society of Manufacturing Engineers (SME). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-ncnd/4.0/).
引用
收藏
页码:40 / 43
页数:4
相关论文
共 20 条
  • [1] Bibliometric Study on the Use of Machine Learning as Resolution Technique for Facility Layout Problems
    Burggraef, Peter
    Wagner, Johannes
    Heinbach, Benjamin
    [J]. IEEE ACCESS, 2021, 9 : 22569 - 22586
  • [2] Di XH, 2021, Arxiv, DOI arXiv:2101.07462
  • [3] Facility layout problems: A survey
    Drira, Amine
    Pierreval, Henri
    Hajri-Gabouj, Sonia
    [J]. ANNUAL REVIEWS IN CONTROL, 2007, 31 (02) : 255 - 267
  • [4] Heinbach B, 2023, SN Oper Res Forum, DOI [10.21203/rs.3.rs-371586/v1, DOI 10.21203/RS.3.RS-371586/V1]
  • [5] Classification of facility layout problems: a review study
    Hosseini-Nasab, Hasan
    Fereidouni, Sepideh
    Ghomi, Seyyed Mohammad Taghi Fatemi
    Fakhrzad, Mohammad Bagher
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2018, 94 (1-4) : 957 - 977
  • [6] Ikeda H., 2022, COMMUNICATION PAPERS, P11
  • [7] Klar Matthias, 2022, Procedia CIRP, P161, DOI 10.1016/j.procir.2022.04.027
  • [8] An implementation of a reinforcement learning based algorithm for factory layout planning
    Klar, Matthias
    Glatt, Moritz
    Aurich, Jan C.
    [J]. MANUFACTURING LETTERS, 2021, 30 : 1 - 4
  • [9] Deep reinforcement learning based scheduling within production plan in semiconductor fabrication
    Lee, Young Hoon
    Lee, Seunghoon
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 191
  • [10] Deep reinforcement learning in smart manufacturing: A review and prospects
    Li, Chengxi
    Zheng, Pai
    Yin, Yue
    Wang, Baicun
    Wang, Lihui
    [J]. CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY, 2023, 40 : 75 - 101