Learning to Dispatch for Flexible Job Shop Scheduling Based on Deep Reinforcement Learning via Graph Gated Channel Transformation

被引:3
作者
Huang, Dainlin [1 ]
Zhao, Hong [1 ]
Zhang, Lijun [1 ]
Chen, Kangping [1 ]
机构
[1] Lanzhou Univ Technol, Sch Comp & Commun, Lanzhou 730050, Peoples R China
基金
美国国家科学基金会;
关键词
Flexible job-shop scheduling; deep reinforcement learning; graph gated channel transformation; global features; lightweight attention mechanism;
D O I
10.1109/ACCESS.2024.3384923
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In addressing the Flexible Job Shop Scheduling Problem (FJSP), deep reinforcement learning eliminates the need for mathematical modeling of the problem, requiring only interaction with the real environment to learn effective strategies. Using disjunctive graphs as the state representation has proven to be a particularly effective method. Additionally, attention mechanisms enable rapid focus on relevant features. However, due to the unique structure of attention mechanisms, current methods fail to provide effective strategies after changes in scale. To resolve this issue, we propose an end-to-end deep reinforcement learning framework for the FJSP. Initially, we introduce a lightweight attention model, the Graph Gated Channel Transformation (GGCT), to identify the characteristics of the workpieces being scheduled at the current decision-making moment, while suppressing redundant features. Subsequently, to address the inability to provide effective strategies after changes in scale, we modify the expression of disjunctive graph features, channeling global features into different channels to capture relevant information at the current moment effectively. Comparative analysis on generated and classical datasets shows our model reduces the average makespan significantly, from 8.243% to 7.037% and from 10.08% to 8.69%, respectively.
引用
收藏
页码:50935 / 50948
页数:14
相关论文
共 34 条
  • [1] Brandimarte P., 1993, Annals of Operations Research, V41, P157, DOI 10.1007/BF02023073
  • [2] A research survey: review of AI solution strategies of job shop scheduling problem
    Calis, Banu
    Bulkan, Serol
    [J]. JOURNAL OF INTELLIGENT MANUFACTURING, 2015, 26 (05) : 961 - 973
  • [3] Du Y, 2023, IEEE T EM TOP COMP I, V7, P1036, DOI [10.1109/TETCI.2022.3145706, 10.1109/IECON49645.2022.9968766]
  • [4] An improved genetic algorithm for flexible job shop scheduling problem considering reconfigurable machine tools with limited auxiliary modules
    Fan, Jiaxin
    Zhang, Chunjiang
    Liu, Qihao
    Shen, Weiming
    Gao, Liang
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2022, 62 : 650 - 667
  • [5] A Review on Swarm Intelligence and Evolutionary Algorithms for Solving Flexible Job Shop Scheduling Problems
    Gao, Kaizhou
    Cao, Zhiguang
    Zhang, Le
    Chen, Zhenghua
    Han, Yuyan
    Pan, Quanke
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2019, 6 (04) : 904 - 916
  • [6] HAUPT R, 1989, OR SPEKTRUM, V11, P3
  • [7] Hausknecht M. J., 2015, 2015 AAAI FALL S SER, P29
  • [8] Efficient dispatching rules for scheduling in a job shop
    Holthaus, O
    Rajendran, C
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 1997, 48 (01) : 87 - 105
  • [9] An end-to-end deep reinforcement learning method based on graph neural network for distributed job-shop scheduling problem
    Huang, Jiang-Ping
    Gao, Liang
    Li, Xin-Yu
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [10] HURINK J, 1994, OR SPEKTRUM, V15, P205, DOI 10.1007/BF01719451