Modeling Cyber Physical Systems with Learning Enabled Components using Hybrid Predicate Transition Nets

被引:0
作者
He, Xudong [1 ]
机构
[1] Florida Int Univ, Miami, FL 33199 USA
来源
2021 21ST INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY COMPANION (QRS-C 2021) | 2021年
关键词
cyber physical systems; deep neural nets; reinforcement learning; formal methods; Petri nets; hybrid predicate transition nets;
D O I
10.1109/QRS-C55045.2021.00164
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Cyber-physical systems (CPSs) are ubiquitous ranging from smart household appliances to drones and self-driving cars, and are becoming increasingly important in the functioning of our society. In recent years, learning enabled components (LECs) built using machine learning approaches are increasingly used in CPSs to perform autonomous tasks to deal with uncertain and unfamiliar environments. In this paper, an approach for formally modeling CPSs with LECs is presented. Hybrid predicate transition nets are used to model LECs built using deep neural nets and reinforcement learning. Specifically, a method for modeling deep neural nets and their training using hybrid predicate transition nets is developed. Additionally, generic hybrid predicate transition net structures are designed to model reinforcement learning based on neural fitted Q-learning. The expressive power of hybrid predicate transition nets supports all commonly used activation and cost/reward functions in deep neural nets and reinforcement learning. The operational semantics of hybrid predicate transition nets enables the online and offline training of deep neural nets as well as online and offline policy update in reinforcement learning. Furthermore, hybrid predicate transition nets are used to model the overall CPS with LECs through the Simplex architecture. These results (1) provide an executable symbolic representation combining logic and algebraic definitions for two major machine learning approaches, and (2) contribute a systematic and unified framework to study CPSs with LECs. The modeling method is demonstrated using a vehicle benchmark problem.
引用
收藏
页码:1099 / 1108
页数:10
相关论文
共 38 条
  • [31] Reisig W., 2019, Carl Adam Petri: Ideas, Personality, Impact
  • [32] Riedmiller M, 2005, LECT NOTES ARTIF INT, V3720, P317, DOI 10.1007/11564096_32
  • [33] Rummery G. A., 1994, CITESEER, V37
  • [34] Seto D, 1998, P AMER CONTR CONF, P3504, DOI 10.1109/ACC.1998.703255
  • [35] Sutton RS, 2018, ADAPT COMPUT MACH LE, P1
  • [36] Trivedi K. S., 1993, Applications and Theory of Petri Nets 1993. 14th International Conference Proceedings, P24
  • [37] WATKINS CJCH, 1992, MACH LEARN, V8, P279, DOI 10.1007/BF00992698
  • [38] Wieting R., 1996, Simulation in Industry. 8th European Simulation Symposium. ESS'96, P158