An End-to-End Deep Learning Method for Dynamic Job Shop Scheduling Problem

被引:9
|
作者
Chen, Shifan [1 ]
Huang, Zuyi [1 ]
Guo, Hongfei [1 ,2 ]
机构
[1] Jinan Univ, Sch Intelligent Syst Sci & Engn, Zhuhai 519070, Peoples R China
[2] Jinan Univ, Inst Phys Internet, Zhuhai 519070, Peoples R China
关键词
smart manufacturing; dynamic job shop scheduling problem; deep learning; transformer; spatial pyramid pooling; generalization; ALGORITHM; MODEL;
D O I
10.3390/machines10070573
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Job shop scheduling problem (JSSP) is essential in the production, which can significantly improve production efficiency. Dynamic events such as machine breakdown and job rework frequently occur in smart manufacturing, making the dynamic job shop scheduling problem (DJSSP) methods urgently needed. Existing rule-based and meta-heuristic methods cannot cope with dynamic events in DJSSPs of different sizes in real time. This paper proposes an end-to-end transformer-based deep learning method named spatial pyramid pooling-based transformer (SPP-Transformer), which shows strong generalizability and can be applied to different-sized DJSSPs. The feature extraction module extracts the production environment features that are further compressed into fixed-length vectors by the feature compression module. Then, the action selection module selects the simple priority rule in real time. The experimental results show that the makespan of SPP-Transformer is 11.67% smaller than the average makespan of dispatching rules, meta-heuristic methods, and RL methods, proving that SPP-Transformer realizes effective dynamic scheduling without training different models for different DJSSPs. To the best of our knowledge, SPP-Transformer is the first application of an end-to-end transformer in DJSSP, which not only improves the productivity of industrial scheduling but also provides a paradigm for future research on deep learning in DJSSP.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] End-to-End Multitarget Flexible Job Shop Scheduling With Deep Reinforcement Learning
    Wang, Rongkai
    Jing, Yiyang
    Gu, Chaojie
    He, Shibo
    Chen, Jiming
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (04): : 4420 - 4434
  • [2] An end-to-end deep reinforcement learning method based on graph neural network for distributed job-shop scheduling problem
    Huang, Jiang-Ping
    Gao, Liang
    Li, Xin-Yu
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [3] An End-to-end Hierarchical Reinforcement Learning Framework for Large-scale Dynamic Flexible Job-shop Scheduling Problem
    Lei, Kun
    Guo, Peng
    Wang, Yi
    Xiong, Jianyu
    Zhao, Wenchao
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [4] Deep reinforcement learning for dynamic distributed job shop scheduling problem with transfers
    Lei, Yong
    Deng, Qianwang
    Liao, Mengqi
    Gao, Shuocheng
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 251
  • [5] An end-to-end decentralised scheduling framework based on deep reinforcement learning for dynamic distributed heterogeneous flowshop scheduling
    Li, Haoran
    Gao, Liang
    Fan, Qingsong
    Li, Xinyu
    Han, Baoan
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2025,
  • [6] An End-to-End Detection Method for WebShell with Deep Learning
    Qi, Longchen
    Kong, Rui
    Lu, Yang
    Zhuang, Honglin
    2018 EIGHTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC 2018), 2018, : 660 - 665
  • [7] Job Shop Scheduling Problem Based on Deep Reinforcement Learning
    Li, Baoshuai
    Ye, Chunming
    Computer Engineering and Applications, 2024, 57 (23) : 248 - 254
  • [8] Deep reinforcement learning for dynamic scheduling of a flexible job shop
    Liu, Renke
    Piplani, Rajesh
    Toro, Carlos
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2022, 60 (13) : 4049 - 4069
  • [9] Dynamic Job Shop Scheduling via Deep Reinforcement Learning
    Liang, Xinjie
    Song, Wen
    Wei, Pengfei
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 369 - 376
  • [10] DeepDive: An End-to-End Dehazing Method Using Deep Learning
    Goncalves, Lucas T.
    Gaya, Joel O.
    Drews, Paulo, Jr.
    Botelho, Silvia S. C.
    2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2017, : 436 - 441