Flexible Job Shop Scheduling Problem using graph neural networks and reinforcement learning

被引:0
作者
Liu, Xi [1 ]
Chen, Xin [1 ]
Chau, Vincent [2 ]
Musial, Jedrzej [3 ]
Blazewicz, Jacek [3 ,4 ,5 ]
机构
[1] Liaoning Univ Technol, Sch Elect & Informat Engn, Shiying 169, Jinzhou 121001, Peoples R China
[2] Southeast Univ, Sch Comp Sci & Engn, 2 Southeast Univ Rd, Nanjing 211189, Peoples R China
[3] Poznan Univ Tech, Inst Comp Sci, Piotrowo 2, PL-60965 Poznan, Poland
[4] Polish Acad Sci, Inst Bioorgan Chem, Noskowskiego 12-14, PL-61704 Poznan, Poland
[5] European Ctr Bioinformat & Genom, Piotrowo 2, PL-60965 Poznan, Poland
基金
中国国家自然科学基金;
关键词
Flexible Job Shop Scheduling Problem; Deep reinforcement learning; Graph attention network; Residual connection; GENETIC ALGORITHM; DEEP; SOLVE;
D O I
10.1016/j.cor.2025.107139
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The Flexible Job Shop Scheduling Problem (FJSP) is an important research topic in the field of manufacturing. Many studies have used Deep Reinforcement Learning (DRL) to learn Priority Dispatching Rules (PDR) to address the FJSP. However, compared to exact methods, there is still significant room for improvement in the quality of solutions. This paper proposes a new end-to-end DRL framework that utilizes Graph Attention Networks (GAN) to extract relevant information from the disjunctive graph. In this framework, we introduce adaptive weights when calculating attention scores, allowing the model to dynamically adjust the attention scores based on the characteristics of the input data. This helps the model more effectively capture key information within the data. To alleviate the network degradation issue and enhance model performance, the features extracted by the aforementioned model are input into a Residual Connection (RC) module for further deep feature extraction. Finally, our model is validated on generated datasets and public benchmarks, with experimental results indicating that the proposed method outperforms traditional PDR methods and the latest DRL approaches.
引用
收藏
页数:12
相关论文
共 46 条
[1]   A hybrid algorithm using a genetic algorithm and multiagent reinforcement learning heuristic to solve the traveling salesman problem [J].
Alipour, Mir Mohammad ;
Razavi, Seyed Naser ;
Derakhshi, Mohammad Reza Feizi ;
Balafar, Mohammad Ali .
NEURAL COMPUTING & APPLICATIONS, 2018, 30 (09) :2935-2951
[2]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[3]   NEURONLIKE ADAPTIVE ELEMENTS THAT CAN SOLVE DIFFICULT LEARNING CONTROL-PROBLEMS [J].
BARTO, AG ;
SUTTON, RS ;
ANDERSON, CW .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :834-846
[4]  
Brandimarte P., 1993, Annals of Operations Research, V41, P157, DOI 10.1007/BF02023073
[5]   A self-learning genetic algorithm based on reinforcement learning for flexible job-shop scheduling problem [J].
Chen, Ronghua ;
Yang, Bo ;
Li, Shi ;
Wang, Shilong .
COMPUTERS & INDUSTRIAL ENGINEERING, 2020, 149
[6]   The flexible job shop scheduling problem: A review [J].
Dauzere-Peres, Stephane ;
Ding, Junwen ;
Shen, Liji ;
Tamssaouet, Karim .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2024, 314 (02) :409-432
[7]   An efficient two-stage genetic algorithm for a flexible job-shop scheduling problem with sequence dependent attached/detached setup, machine release date and lag-time [J].
Defersha, Fantahun M. ;
Rooyani, Danial .
COMPUTERS & INDUSTRIAL ENGINEERING, 2020, 147 (147)
[8]   Improved particle swarm optimization algorithm based novel encoding and decoding schemes for flexible job shop scheduling problem [J].
Ding, Haojie ;
Gu, Xingsheng .
COMPUTERS & OPERATIONS RESEARCH, 2020, 121
[9]   A deep reinforcement learning based algorithm for a distributed precast concrete production scheduling [J].
Du, Yu ;
Li, Jun-qing .
INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 2024, 268
[10]   A Review on Swarm Intelligence and Evolutionary Algorithms for Solving Flexible Job Shop Scheduling Problems [J].
Gao, Kaizhou ;
Cao, Zhiguang ;
Zhang, Le ;
Chen, Zhenghua ;
Han, Yuyan ;
Pan, Quanke .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2019, 6 (04) :904-916