Learning Self-Triggered Controllers With Gaussian Processes

被引:22
作者
Hashimoto, Kazumune [1 ]
Yoshimura, Yuichi [1 ]
Ushio, Toshimitsu [1 ]
机构
[1] Osaka Univ, Grad Sch Engn Sci, Osaka 5608531, Japan
基金
日本科学技术振兴机构;
关键词
Optimal control; Heuristic algorithms; Gaussian processes; Vehicle dynamics; Approximation algorithms; Kernel; Mathematical model; Event-triggered; self-triggered control; Gaussian process (GP) regression; optimal control; TRACKING CONTROL; SYSTEMS; COMMUNICATION; DESIGN; GAIN;
D O I
10.1109/TCYB.2020.2980048
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article investigates the design of self-triggered controllers for networked control systems (NCSs), where the dynamics of the plant are unknown a priori. To deal with the unknown transition dynamics, we employ the Gaussian process (GP) regression in order to learn the dynamics of the plant. To design the self-triggered controller, we formulate an optimal control problem, such that the optimal control and communication policies can be jointly designed based on the GP model of the plant. Moreover, we provide an overall implementation algorithm that jointly learns the dynamics of the plant and the self-triggered controller based on a reinforcement learning framework. Finally, a numerical simulation illustrates the effectiveness of the proposed approach.
引用
收藏
页码:6294 / 6304
页数:11
相关论文
共 44 条
[1]  
[Anonymous], 1996, Dynamic programming: An overview
[2]  
Arzen K.-E., 1999, Proceedings of the 14th World Congress. International Federation of Automatic Control, P423
[3]   Event-triggered Pulse Control with Model Learning (if Necessary) [J].
Baumann, Dominik ;
Solowjow, Friedrich ;
Johansson, Karl Henrik ;
Trimpe, Sebastian .
2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, :792-797
[4]  
Baumann D, 2018, IEEE DECIS CONTR P, P943, DOI 10.1109/CDC.2018.8619335
[5]   Stable Gaussian process based tracking control of Euler-Lagrange systems [J].
Beckers, Thomas ;
Kulic, Dana ;
Hirche, Sandra .
AUTOMATICA, 2019, 103 :390-397
[6]   Hierarchical Event-Triggered Learning for Cyclically Excited Systems With Application to Wireless Sensor Networks [J].
Beuchert, Jonas ;
Solowjow, Friedrich ;
Raisch, Joerg ;
Trimpe, Sebastian ;
Seel, Thomas .
IEEE CONTROL SYSTEMS LETTERS, 2020, 4 (01) :103-108
[7]  
Bradford E., STOCHASTIC DATA DRIV
[8]   Gaussian Processes for Data-Efficient Learning in Robotics and Control [J].
Deisenroth, Marc Peter ;
Fox, Dieter ;
Rasmussen, Carl Edward .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (02) :408-423
[9]   Gaussian process dynamic programming [J].
Deisenroth, Marc Peter ;
Rasmussen, Carl Edward ;
Peters, Jan .
NEUROCOMPUTING, 2009, 72 (7-9) :1508-1524
[10]   Output-Based and Decentralized Dynamic Event-Triggered Control With Guaranteed Lp-Gain Performance and Zeno-Freeness [J].
Dolk, V. S. ;
Borgers, D. P. ;
Heemels, W. P. M. H. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (01) :34-49