Using Markov Decision Process over Local Modular Supervisors for Planning Problems

被引：0

作者：

Sarsur, Daniel ^{[1
]}

Alves, Lucas V. R. ^{[2
]}

Pena, Patricia N. ^{[3
]}

机构：

[1] Univ Fed Minas Gerais, Grad Program Elect Engn, Ave Antonio Carlos 6627, BR-31270901 Belo Horizonte, MG, Brazil

[2] Univ Fed Minas Gerais, Tech Coll, Belo Horizonte, MG, Brazil

[3] Univ Fed Minas Gerais, Dept Elect Engn, Belo Horizonte, MG, Brazil

来源：

IFAC PAPERSONLINE | 2024年 / 58卷 / 01期

关键词：

Discrete Event Systems; Supervisory Control Theory; Local Modular Supervisor; Markov Decision Process; Planning;

D O I：

10.1016/j.ifacol.2024.07.022

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper presents a novel algorithm that employs the Markov Decision Process approach to efficiently determine sequences that minimize makespan for planning problems. The approach employs local modular supervisors, enhancing flexibility and computational capability. The algorithm achieves optimal makespan values for the evaluated case study, demonstrating its effectiveness. Moreover, the method empowers real-time decision-making, outperforming existing approaches by significantly reducing computation time.

引用

页码：126 / 131

页数：6

共 20 条

[1] Alves L.V., 2016, 2016 IEEE INT C AUT
[2] Planning on Discrete Event Systems using parallelism maximization
Alves, Lucas V. R.
Pena, Patricia N.
Takahashi, Ricardo H. C.
[J]. CONTROL ENGINEERING PRACTICE, 2021, 112
[3] UAV Formation Shape Control via Decentralized Markov Decision Processes
Azam, Md Ali
Mittelmann, Hans D.
Ragi, Shankarachary
[J]. ALGORITHMS, 2021, 14 (03)
[4] Cassandras C.G., 2008, Introductiontodiscreteeventsystems
[5] Multitasking supervisory control of discrete-event systems
De Queiroz, MH
Cury, JER
Wonham, WM
[J]. DISCRETE EVENT DYNAMIC SYSTEMS-THEORY AND APPLICATIONS, 2005, 15 (04): : 375 - 395
[6] deQueiroz M.H., 2000, Modularsupervisorycontroloflargescalediscreteeventsystems. InDiscreteEventSystems: AnalysisandControl
[7] dos Santos M.C., 2020, C BRAS AUT CBA
[8] Garey M.R., 1979, Computersandintractability: AGuidetotheTheoryofNP-Completness
[9] Critical links detection in stochastic networks: application to the transport networks
Guettiche, Mourad
Kheddouci, Hamamache
[J]. INTERNATIONAL JOURNAL OF INTELLIGENT COMPUTING AND CYBERNETICS, 2019, 12 (01) : 42 - 69
[10] A multi-objective cellular grey wolf optimizer for hybrid flowshop scheduling problem considering noise pollution
Lu, Chao
Gao, Liang
Pan, Quanke
Li, Xinyu
Zheng, Jun
[J]. APPLIED SOFT COMPUTING, 2019, 75 : 728 - 749

← 1 2 →