Flexible Job Shop Scheduling Problem using graph neural networks and reinforcement learning

被引:0
作者
Liu, Xi [1 ]
Chen, Xin [1 ]
Chau, Vincent [2 ]
Musial, Jedrzej [3 ]
Blazewicz, Jacek [3 ,4 ,5 ]
机构
[1] Liaoning Univ Technol, Sch Elect & Informat Engn, Shiying 169, Jinzhou 121001, Peoples R China
[2] Southeast Univ, Sch Comp Sci & Engn, 2 Southeast Univ Rd, Nanjing 211189, Peoples R China
[3] Poznan Univ Tech, Inst Comp Sci, Piotrowo 2, PL-60965 Poznan, Poland
[4] Polish Acad Sci, Inst Bioorgan Chem, Noskowskiego 12-14, PL-61704 Poznan, Poland
[5] European Ctr Bioinformat & Genom, Piotrowo 2, PL-60965 Poznan, Poland
基金
中国国家自然科学基金;
关键词
Flexible Job Shop Scheduling Problem; Deep reinforcement learning; Graph attention network; Residual connection; GENETIC ALGORITHM; DEEP; SOLVE;
D O I
10.1016/j.cor.2025.107139
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The Flexible Job Shop Scheduling Problem (FJSP) is an important research topic in the field of manufacturing. Many studies have used Deep Reinforcement Learning (DRL) to learn Priority Dispatching Rules (PDR) to address the FJSP. However, compared to exact methods, there is still significant room for improvement in the quality of solutions. This paper proposes a new end-to-end DRL framework that utilizes Graph Attention Networks (GAN) to extract relevant information from the disjunctive graph. In this framework, we introduce adaptive weights when calculating attention scores, allowing the model to dynamically adjust the attention scores based on the characteristics of the input data. This helps the model more effectively capture key information within the data. To alleviate the network degradation issue and enhance model performance, the features extracted by the aforementioned model are input into a Residual Connection (RC) module for further deep feature extraction. Finally, our model is validated on generated datasets and public benchmarks, with experimental results indicating that the proposed method outperforms traditional PDR methods and the latest DRL approaches.
引用
收藏
页数:12
相关论文
共 46 条
[21]   A hybrid differential evolution algorithm for flexible job shop scheduling with outsourcing operations and job priority constraints [J].
Li, Hui ;
Wang, Xi ;
Peng, Jianbiao .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 201
[22]   A Hybrid Graph-Based Imitation Learning Method for a Realistic Distributed Hybrid Flow Shop With Family Setup Time [J].
Li, Junqing ;
Li, Jiake ;
Gao, Kaizhou ;
Duan, Peiyong .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (12) :7291-7304
[23]   Bi-Population Balancing Multi-Objective Algorithm for Fuzzy Flexible Job Shop With Energy and Transportation [J].
Li, Junqing ;
Han, Yuyan ;
Gao, Kaizhou ;
Xiao, Xiumei ;
Duan, Peiyong .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (03) :4686-4702
[24]   Smart Manufacturing Scheduling With Edge Computing Using Multiclass Deep Q Network [J].
Lin, Chun-Cheng ;
Deng, Der-Jiunn ;
Chih, Yen-Ling ;
Chiu, Hsin-Ting .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (07) :4276-4284
[25]   Energy-Efficient Scheduling of Distributed Flow Shop With Heterogeneous Factories: A Real-World Case From Automobile Industry in China [J].
Lu, Chao ;
Gao, Liang ;
Yi, Jin ;
Li, Xinyu .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (10) :6687-6696
[26]   Dynamic multi-objective scheduling for flexible job shop by deep reinforcement learning [J].
Luo, Shu ;
Zhang, Linxuan ;
Fan, Yushun .
COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 159
[27]   Reinforcement learning for combinatorial optimization: A survey [J].
Mazyavkina, Nina ;
Sviridov, Sergey ;
Ivanov, Sergei ;
Burnaev, Evgeny .
COMPUTERS & OPERATIONS RESEARCH, 2021, 134
[28]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[29]   A Reinforcement Learning Approach to Robust Scheduling of Semiconductor Manufacturing Facilities [J].
Park, In-Beom ;
Huh, Jaeseok ;
Kim, Joongkyun ;
Park, Jonghun .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (03) :1420-1431
[30]   Learning to schedule job-shop problems: representation and policy learning using graph neural network and reinforcement learning [J].
Park, Junyoung ;
Chun, Jaehyeong ;
Kim, Sang Hun ;
Kim, Youngkook ;
Park, Jinkyoo .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2021, 59 (11) :3360-3377