Learning Probabilistic Logical Control Networks: From Data to Controllability and Observability

被引:2
作者
Lin, Lin [1 ]
Lam, James [1 ]
Shi, Peng [2 ,3 ]
Ng, Michael K. [4 ]
Lam, Hak-Keung [5 ]
机构
[1] Univ Hong Kong, Dept Mech Engn, Pokfulam, Hong Kong, Peoples R China
[2] Univ Adelaide, Sch Elect & Mech Engn, Adelaide, SA 5005, Australia
[3] Obuda Univ, Res & Innovat Ctr, H-1034 Budapest, Hungary
[4] Hong Kong Baptist Univ, Dept Math, Kowloon Tong, Hong Kong, Peoples R China
[5] Kings Coll London, Dept Engn, London WC2R 2LS, England
基金
中国国家自然科学基金; 澳大利亚研究理事会;
关键词
Observability; Controllability; Probabilistic logic; Mathematical models; Matrix converters; Dynamic programming; Biological system modeling; Q-learning; Proteins; Optimal control; observability; probabilistic logical networks (PLNs); reinforcement learning (RL); semitensor product (STP); BOOLEAN CONTROL NETWORKS; STABILIZATION; AUTOMATA; SYSTEMS; MODELS;
D O I
10.1109/TAC.2024.3524241
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article studies controllability and observability problems for a class of mixed-valued probabilistic logical control networks (PLCNs). First, PLCN is transformed into the algebraic state-space representation (ASSR)-form by resorting to the semitensor product method. Then, the formulas are presented to calculate the lower and upper bounds of the transition probability matrix, which further derive the controllability and observability criteria. Furthermore, the ASSR-form of a PLCN can be regarded as a Markov decision process. Using the latter framework, we prove the equivalence between the controllability probability and the optimal state-value function, which is an iteration equation. Besides, the parallel extension technique transforms the observability of PLCNs into the set stabilization of an augmented system. The correspondence between observability probability and optimal state-value function is also derived. Afterward, based on the state-value function, the algorithms via the Q-learning technique are exploited to estimate the controllability and observability probabilities along with obtaining the corresponding optimal control sequences. Finally, all the theoretical results are elaborated via a genetic regulatory p53-Mdm2 network.
引用
收藏
页码:3889 / 3904
页数:16
相关论文
共 45 条
[21]   Observability of Boolean networks: A graph-theoretic approach [J].
Laschov, Dmitriy ;
Margaliot, Michael ;
Even, Guy .
AUTOMATICA, 2013, 49 (08) :2351-2362
[22]   Observability conditions of Boolean control networks [J].
Li, Rui ;
Yang, Meng ;
Chu, Tianguang .
INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2014, 24 (17) :2711-2723
[23]   Controllability and observability of state-dependent switched Boolean control networks with input constraints [J].
Li, Yiliang ;
Li, Jinjin ;
Ma, Zhouming ;
Feng, Jun-e ;
Wang, Hongkun .
ASIAN JOURNAL OF CONTROL, 2019, 21 (06) :2662-2673
[24]   Asymptotical feedback controllability of probabilistic logic control networks [J].
Li, Zhitao ;
Guo, Yuqian ;
Gui, Weihua .
SYSTEMS & CONTROL LETTERS, 2021, 154
[25]  
Lin Lin, 2023, 2023 International Conference on Machine Learning and Cybernetics (ICMLC), P295, DOI 10.1109/ICMLC58545.2023.10327924
[26]   A Bisimulation-Based Foundation for Scale Reductions of Continuous-Time Markov Chains [J].
Lin, Lin ;
Cao, Jinde ;
Lam, James ;
Rutkowski, Leszek ;
Dimirovski, Georgi Marko ;
Zhu, Shiyong .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (09) :5743-5758
[27]   STABILIZATION OF CONTINUOUS-TIME PROBABILISTIC LOGICAL NETWORKS UNDER SAMPLING DWELL TIME CONSTRAINTS [J].
Lin, Lin ;
Lam, James ;
Meng, Min ;
Xie, Xiaochen ;
Li, Panshuo ;
Zhang, Daotong ;
Shi, Peng .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2024, 62 (02) :1006-1033
[28]   Set Stabilization of Large-Scale Stochastic Boolean Networks: A Distributed Control Strategy [J].
Lin, Lin ;
Cao, Jinde ;
Lu, Jianquan ;
Rutkowski, Leszek .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (03) :806-808
[29]   Observability Categorization for Boolean Control Networks [J].
Lin, Lin ;
Lam, James .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (01) :1374-1386
[30]   Controllability and Observability of Singular Boolean Control Networks [J].
Meng, Min ;
Li, Beiyou ;
Feng, Jun-e .
CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2015, 34 (04) :1233-1248