Deep reinforcement learning for flexible assembly job shop scheduling problem

被引:0
作者
Hu Y. [1 ,2 ]
Zhang L. [1 ,2 ]
Bai X. [3 ]
Tang Q. [1 ,2 ]
机构
[1] Key Laboratory of Metallurgical Equipment and Control Technology, Ministry of Education, Wuhan University of Science and Technology, Wuhan
[2] Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan
[3] Evergrande School of Management, Wuhan University of Science and Technology, Wuhan
来源
Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition) | 2023年 / 51卷 / 02期
关键词
deep reinforcement learning; flexible assembly; job dynamic arrival; job shop scheduling; multi-agent;
D O I
10.13245/j.hust.230217
中图分类号
学科分类号
摘要
The flexible assembly job shop scheduling problem with dynamic products arrival was addressed,to minimize total tardiness. A mathematical programming model was proposed based on event points,which contains four decision-making sequences:processing machine assignment,processing operation sequence,assembly station assignment,and assembly operation sequence. This model was solved by deep reinforcement learning algorithm based multi-agent. Firstly,the proposed algorithm consisted of four agents corresponding to four decision sequences,and multi-agent adopted a value decomposition networks (VDN) based cooperative strategy. Secondly,the reward function with tardiness was designed,the digital features of production system were extracted as global features,and the scheduling actions of each agent were defined. Finally,an elite experience pool was designed to fully exploit the value of high return samples. The experimental results show that the proposed method is superior to both classical heuristic rules and meta-heuristic rules in different scenarios. © 2023 Huazhong University of Science and Technology. All rights reserved.
引用
收藏
页码:153 / 160
页数:7
相关论文
共 19 条
[1]  
57, 5, pp. 157-165
[2]  
ZHANG S, ZHANG B, Multi-objective optimisation in flexible assembly job shop scheduling using a distributed ant colony system[J], European Journal of Operational Research, 283, 2, pp. 441-460, (2020)
[3]  
REN W, WEN J, YAN Y, Multi-objective optimisation for energy-aware flexible job-shop scheduling problem with assembly operations[J], International Journal of Production Research, 2020, 3, pp. 1-16
[4]  
KHODKE P M, BHONGADE A S., Real-time scheduling in manufacturing system with machining and assembly operations:a state of art[J], International Journal of Production Research, 51, 16, pp. 4966-4978, (2013)
[5]  
WANG X L., Game-based hybrid particle swarm optimization of job-shop production control[J], International Journal of Simulation Modelling, 20, 2, pp. 398-409, (2021)
[6]  
OUELHADJ D,, PETROVIC S., A survey of dynamic scheduling in manufacturing systems[J], Journal of Scheduling, 12, 4, pp. 417-431, (2009)
[7]  
SHI F,, ZHAO S,, MENG Y., Hybrid algorithm based on improved extended shifting bottleneck procedure and GA for assembly job shop scheduling problem[J], International Journal of Production Research, 58, 9, pp. 2604-2625, (2020)
[8]  
LUO S., Dynamic scheduling for flexible job shop with new job insertions by deep reinforcement learning[J], Applied Soft Computing, 91, (2020)
[9]  
33, 3, pp. 648-653, (2016)
[10]  
47, 11, pp. 2521-2537