Reinforcement learning for combined production-maintenance and quality control of a manufacturing system with deterioration failures

被引:67
作者
Paraschos, Panagiotis D. [1 ]
Koulinas, Georgios K. [1 ]
Koulouriotis, Dimitrios E. [1 ]
机构
[1] Democritus Univ Thrace, Dept Prod & Management Engn, Xanthi, Greece
关键词
Deteriorating systems; Machine learning; Reinforcement learning; Control policies; Inventory control; Quality control; PREVENTIVE MAINTENANCE; INTEGRATED PRODUCTION; JOINT PRODUCTION; DECISION-MAKING; POLICY; OPTIMIZATION; SUBJECT; MANAGEMENT; DEMAND; MODEL;
D O I
10.1016/j.jmsy.2020.07.004
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This paper describes and examines thoroughly a stochastic production/inventory system that produces a single type of products. During the production process, the system is affected by several deterioration failures. It is restored to its initial and previous deterioration state by repair and maintenance activities. Both maintenance and repair duration are assumed as exponential random variables. Moreover, the quality of the manufactured products is assumed to be affected by the current deterioration level of the system. The aim of this paper is to find the optimal trade-off between conflicting performance metrics for the optimization of the total expected profit of the system. To tackle such optimization problems, researchers frequently employ Dynamic Programming. This method, though, is not appropriate for the addressed problem due to complexity reasons. To this end, a Reinforcement Learning-based approach is proposed in order to obtain the optimal joint production, maintenance and product quality control policies. To the authors' knowledge, the proposed approach is novel and there are few examples of such implementation in the academic literature.
引用
收藏
页码:470 / 483
页数:14
相关论文
共 51 条
[1]   A robust integrated production and preventive maintenance planning model for multi-state systems with uncertain demand and common cause failures [J].
Alimian, Mahyar ;
Saidi-Mehrabad, Mohammad ;
Jabbarzadeh, Armin .
JOURNAL OF MANUFACTURING SYSTEMS, 2019, 50 :263-277
[2]  
Axsater S., 2015, Inventory Control, VVolume 225, DOI [10.1007/978-3-319-15729-0, DOI 10.1007/978-3-319-15729-0]
[3]   Integrated production, statistical process control, and maintenance policy for unreliable manufacturing systems [J].
Bahria, Nadia ;
Chelbi, Anis ;
Bouchriha, Hanen ;
Dridi, Imen Harbaoui .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2019, 57 (08) :2548-2570
[4]   SINGLE-MACHINE MULTIPLE-RECIPE PREDICTIVE MAINTENANCE [J].
Cai, Yiwei ;
Hasenbein, John J. ;
Kutanoglu, Erhan ;
Liao, Melody .
PROBABILITY IN THE ENGINEERING AND INFORMATIONAL SCIENCES, 2013, 27 (02) :209-235
[5]   Integrated maintenance and operations decision making with imperfect degradation state observations [J].
Celen, Merve ;
Djurdjanovic, Dragan .
JOURNAL OF MANUFACTURING SYSTEMS, 2020, 55 :302-316
[6]  
Chen DY, 2002, RELIAB ENG SYST SAFE, V76, P43, DOI 10.1016/S0951-8320(01)00141-7
[7]   Optimal preventive maintenance in a production inventory system [J].
Das, TK ;
Sarkar, S .
IIE TRANSACTIONS, 1999, 31 (06) :537-551
[8]   Joint integrated production-maintenance policy with production plan smoothing through production rate control [J].
Dellagi, Sofiene ;
Chelbi, Anis ;
Trabelsi, Wajdi .
JOURNAL OF MANUFACTURING SYSTEMS, 2017, 42 :262-270
[10]   A Finite Horizon Dynamic Programming Model for Production and Repair Decisions [J].
Fallahnezhad, Mohammad Saber .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2014, 43 (15) :3302-3313