Reinforcement Learning Approach to Feedback Stabilization Problem of Probabilitic Boolcan Control Networks

被引:58
作者
Acernese, Antonio [1 ]
Yerudkar, Amol [1 ]
Glielmo, Luigi [1 ]
Del Vecchio, Carmen Del [1 ]
机构
[1] Univ Sannio, Dept Engn, I-82100 Benevento, Italy
来源
IEEE CONTROL SYSTEMS LETTERS | 2021年 / 5卷 / 01期
关键词
Probabilistic Boolean control networks; Q-learning; feedback stabilization; systems biology; BOOLEAN NETWORKS;
D O I
10.1109/LCSYS.2020.3001993
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we study the control of probabilistic Boolean control networks (PBCNs) by leveraging a model-free reinforcement learning (RL) technique. In particular, we propose a Q-learning (QL) based approach to address the feedback stabilization problem of PBCNs, and we design optimal state feedback controllers such that the PBCN is stabilized at a given equilibrium point. The optimal controllers are designed for both finite-time stability and asymptotic stability of PBCNs. In order to verify the convergence of the proposed QL algorithm, the obtained optimal policy is compared with the optimal solutions of model-based techniques, namely value iteration (VI) and semi-tensor product (STP) methods. Finally, some PBCN models of gene regulatory networks (GRNs) are considered to verify the obtained results.
引用
收藏
页码:337 / 342
页数:6
相关论文
共 29 条
[1]   Control of Boolean networks: Hardness results and algorithms for tree structured networks [J].
Akutsu, Tatsuya ;
Hayashida, Morihiro ;
Ching, Wai-Ki ;
Ng, Michael K. .
JOURNAL OF THEORETICAL BIOLOGY, 2007, 244 (04) :670-679
[2]  
Busoniu L., 2017, Reinforcement Learning and Dynamic Programming Using Function Approximators
[3]  
Cheng DH, 2011, COMMUN CONTROL ENG, P1, DOI 10.1007/978-0-85729-097-7
[4]  
Even-Dar E, 2003, J MACH LEARN RES, V5, P1
[5]   On approximate stochastic control in genetic regulatory networks [J].
Faryabi, B. ;
Datta, A. ;
Dougherty, E. R. .
IET SYSTEMS BIOLOGY, 2007, 1 (06) :361-368
[6]   Observability and Reconstructibility of Probabilistic Boolean Networks [J].
Fornasini, Ettore ;
Valcher, Maria Elena .
IEEE CONTROL SYSTEMS LETTERS, 2020, 4 (02) :319-324
[7]   Optimal Control of Boolean Control Networks [J].
Fornasini, Ettore ;
Valcher, Maria Elena .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (05) :1258-1270
[8]   On the periodic trajectories of Boolean control networks [J].
Fornasini, Ettore ;
Valcher, Maria Elena .
AUTOMATICA, 2013, 49 (05) :1506-1509
[9]   Boolean Network Model for Cancer Pathways: Predicting Carcinogenesis and Targeted Therapy Outcomes [J].
Fumia, Herman F. ;
Martins, Marcelo L. .
PLOS ONE, 2013, 8 (07)
[10]   Stability and Set Stability in Distribution of Probabilistic Boolean Networks [J].
Guo, Yuqian ;
Zhou, Rongpei ;
Wu, Yuhu ;
Gui, Weihua ;
Yang, Chunhua .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (02) :736-742