Self-triggered control of probabilistic Boolean control networks: A reinforcement learning approach

被引:23
作者
Bajaria, Pratik [1 ,2 ]
Yerudkar, Amol [3 ]
Glielmo, Luigi [3 ]
Del Vecchio, Carmen [3 ]
Wu, Yuhu [4 ]
机构
[1] HeliosIoT Syst Pvt Ltd, Customer Success Manager, Pune 411008, India
[2] HeliosIoT Syst Pvt Ltd, SME, Pune 411008, India
[3] Univ Sannio, Dept Engn, I-82100 Benevento, Italy
[4] Dalian Univ Technol, Sch Control Sci & Engn, Dalian 116024, Peoples R China
关键词
FEEDBACK STABILIZATION; SET STABILIZATION; POLICY; STABILITY;
D O I
10.1016/j.jfranklin.2022.06.004
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, strategies to devise an optimal feedback control of probabilistic Boolean control networks (PBCNs) are discussed. Reinforcement learning (RL) based control is explored in order to minimize model design efforts and regulate PBCNs with high complexities. A Q-learning random forest ( QLRF) algorithm is proposed; by making use of the algorithm, state feedback controllers are designed to stabilize the PBCNs at a given equilibrium point. Further, by adopting QLRF stabilized closed-loop PBCNs, a Lyapunov function is defined, and a method to construct the same is presented. By utilizing such Lyapunov functions, a novel self-triggered control (STC) strategy is proposed, whereby the controller is recomputed according to a triggering schedule, resulting in an optimal control strategy while retaining the closed-loop PBCN stability. Finally, the results are verified using computer simulations. (c) 2022 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:6173 / 6195
页数:23
相关论文
共 63 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Reinforcement Learning Approach to Feedback Stabilization Problem of Probabilitic Boolcan Control Networks [J].
Acernese, Antonio ;
Yerudkar, Amol ;
Glielmo, Luigi ;
Del Vecchio, Carmen Del .
IEEE CONTROL SYSTEMS LETTERS, 2021, 5 (01) :337-342
[3]   Chemotherapeutic Dose Regimen Design based on Self-triggered Strategy [J].
Aghaeeyan, A. ;
Yazdanpanah, M. J. ;
Estakhroueieh, M. Rezaei .
2020 EUROPEAN CONTROL CONFERENCE (ECC 2020), 2020, :252-257
[4]   Control of Boolean networks: Hardness results and algorithms for tree structured networks [J].
Akutsu, Tatsuya ;
Hayashida, Morihiro ;
Ching, Wai-Ki ;
Ng, Michael K. .
JOURNAL OF THEORETICAL BIOLOGY, 2007, 244 (04) :670-679
[5]  
[Anonymous], 2008, 7 PYTHON SCI C SCIPY
[6]  
Anosov D.V., 1997, ORDINARY DIFFERENTIA
[7]  
Bajaria P, 2021, 2021 EUROPEAN CONTROL CONFERENCE (ECC), P836, DOI 10.23919/ECC54610.0000/2021.9655234
[8]  
Bellman R. E., 2015, Applied dynamic programming
[9]  
Bertsekas D. P., 2017, Dynamic programming and optimal control, VI
[10]  
Biau G, 2012, J MACH LEARN RES, V13, P1063