Integrated Dynamic Flexible Job Shop and AIV Scheduling: Deep Reinforcement Learning Approach Considering AIV Charging and Capacity Constraints

被引:1
作者
Hosseini, Arman [1 ]
Feizabadi, Mohammad [2 ]
Yahouni, Zakaria [2 ]
机构
[1] Univ Virginia, Syst Engn, Charlottesville, VA 22903 USA
[2] Univ Grenoble Alpes, CNRS, Grenoble INP G SCOP, F-38000 Grenoble, France
来源
ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS-PRODUCTION MANAGEMENT SYSTEMS FOR VOLATILE, UNCERTAIN, COMPLEX, AND AMBIGUOUS ENVIRONMENTS, APMS 2024, PT VI | 2024年 / 733卷
关键词
AIV scheduling; Flexible Job shop; Manufacturing optimization; Reinforcement learning; Deep Q-network;
D O I
10.1007/978-3-031-71645-4_35
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Scheduling Automated Intelligent Vehicles (AIV) in Dynamic Flexible Job Shops is a challenging problem due to its high level of stochasticity and dynamic nature. Various heuristic and exact methods have proven effective when the complexity of the problem is relatively low. Moreover, in the past decade, machine learning algorithms, particularly reinforcement learning, have been applied to sophisticated scheduling tasks and demonstrated their efficiency in solving such problems. In this study, a deep reinforcement learning approach is proposed to address the integrated Dynamic Flexible Job Shop and AIV scheduling. Aimed at optimizing two objectives: total lateness of jobs and total energy consumption of AIVs. The study takes into account the limitations of AIV transporters, such as charging consumption and loading capacity. To validate the proposed method, a case study of a flexible job shop is designed, and our approach is compared with a combination of existing heuristics.
引用
收藏
页码:522 / 536
页数:15
相关论文
共 24 条
[1]   Energy-efficient multi-objective flexible manufacturing scheduling [J].
Barak, Sasan ;
Moghdani, Reza ;
Maghsoudlou, Hamidreza .
JOURNAL OF CLEANER PRODUCTION, 2021, 283
[2]  
Belmamoune M.A., 2022, INT WORKSH SERV OR H, P196
[3]   A STATE-OF-THE-ART SURVEY OF DISPATCHING RULES FOR MANUFACTURING JOB SHOP OPERATIONS [J].
BLACKSTONE, JH ;
PHILLIPS, DT ;
HOGG, GL .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 1982, 20 (01) :27-45
[4]   Flexible job-shop scheduling problem under resource constraints [J].
Chan, F. T. S. ;
Wong, T. C. ;
Chan, L. Y. .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2006, 44 (11) :2071-2089
[5]  
Cronin C, 2019, 2019 30TH IRISH SIGNALS AND SYSTEMS CONFERENCE (ISSC)
[6]   The evolution and future of manufacturing: A review [J].
Esmaeilian, Behzad ;
Behdad, Sara ;
Wang, Ben .
JOURNAL OF MANUFACTURING SYSTEMS, 2016, 39 :79-100
[7]  
[付建林 Fu Jianlin], 2020, [系统仿真学报, Journal of System Simulation], V32, P1664
[8]   Scheduling AIV transporter using simulation-based supervised learning: A case study on a dynamic job-shop with three workstations [J].
Hosseini, Arman ;
Yahouni, Zakaria ;
Feizabadi, Mohammad .
IFAC PAPERSONLINE, 2023, 56 (02) :8591-8597
[9]   Deep reinforcement learning based AGVs real-time scheduling with mixed rule for flexible shop floor in industry 4.0 [J].
Hu, Hao ;
Jia, Xiaoliang ;
He, Qixuan ;
Fu, Shifeng ;
Liu, Kuo .
COMPUTERS & INDUSTRIAL ENGINEERING, 2020, 149
[10]   Reinforcement learning applications to machine scheduling problems: a comprehensive literature review [J].
Kayhan, Behice Meltem ;
Yildiz, Gokalp .
JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 34 (03) :905-929