Scheduling Algorithm for Raw Material Transportation Via Deep Reinforcement Learning

被引:0
作者
Zhang, Yi [1 ]
Chen, Yang-Yang [1 ]
Zhang, Faxiang [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
来源
2022 41ST CHINESE CONTROL CONFERENCE (CCC) | 2022年
关键词
Scheduling; Deep Q-Network; Neural Network; State reuse; CRUDE-OIL OPERATIONS; REFINERY; MODEL; TIME;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Note that the traditional scheduling control algorithms (e.g., Scheduling control algorithm based on mixed integer programming.) depend on the specific scheduling system model, which leads to get the optimal solution difficultly. This paper proposes a novel scheduling algorithm based on deep reinforcement learning, where three parts of raw material transfer scheduling control are included in the algorithm, that is, raw materials are transferred from the cargo ship to the wharf, from the wharf to the factory, and fron: the factory to the processing location. The algorithm takes the system state as the input of Deep Q-Network, calculates the action value of each part of the scheduling action through the deep neural network, and finally selects the optin:al scheduling action based on the action value, which effectively reduces the storage cost and the number of pipeline changes III the process ofraw material transportation. In addition, this paper also proposes to optimize the input ofneural network through state reuse, which further reduces the switching times oftransmission pipeline. Simulation results show that the proposed method does not depend on the specific scheduling model, reduces the solution time, and effectively reduces the storage cost and pipeline switching cost in the scheduling process.
引用
收藏
页码:2218 / 2223
页数:6
相关论文
共 14 条
[1]   Integrated scheduling of vessel dispatching and port operations in the closed-loop shipping system for transporting petrochemicals [J].
An, Heungjo ;
Choi, Sangdo ;
Lee, Jay H. .
COMPUTERS & CHEMICAL ENGINEERING, 2019, 126 :485-498
[2]  
Hamisu A A, 2014, P 20 INT C AUT COMP
[3]   Mixed-integer linear programming model for refinery short-term scheduling of crude oil unloading with inventory management [J].
Lee, HM ;
Pinto, JM ;
Grossmann, IE ;
Park, S .
INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 1996, 35 (05) :1630-1641
[4]  
Mnih V., 2013, CoRR abs/1312.5602
[5]   Time representations and mathematical models for process scheduling problems [J].
Mouret, Sylvain ;
Grossmann, Ignacio E. ;
Pestiaux, Pierre .
COMPUTERS & CHEMICAL ENGINEERING, 2011, 35 (06) :1038-1063
[6]   A dispatching method for automated lifting vehicles in automated port container terminals [J].
Nguyen, Vu Duc ;
Kim, Kap Hwan .
COMPUTERS & INDUSTRIAL ENGINEERING, 2009, 56 (03) :1002-1020
[7]   New approach for scheduling crude oil operations [J].
Pan, Ming ;
Li, Xiuxi ;
Qian, Yu .
CHEMICAL ENGINEERING SCIENCE, 2009, 64 (05) :965-983
[8]   Reactive scheduling of crude oil using structure adapted genetic algorithm under multiple uncertainties [J].
Panda, Debashish ;
Ramteke, Manojkumar .
COMPUTERS & CHEMICAL ENGINEERING, 2018, 116 :333-351
[9]   Scheduling of loading and unloading of crude oil in a refinery using event-based discrete time formulation [J].
Saharidis, Georgios K. D. ;
Minoux, Michel ;
Dallery, Yves .
COMPUTERS & CHEMICAL ENGINEERING, 2009, 33 (08) :1413-1426
[10]  
Watkins C. J. C. H., 1989, THESIS