Covariance Steering of Discrete-Time Stochastic Linear Systems Based on Wasserstein Distance Terminal Cost

被引:10
作者
Balci, Isin M. [1 ]
Bakolas, Efstathios [1 ]
机构
[1] Univ Texas Austin, Dept Aerosp Engn & Engn Mech, Austin, TX 78712 USA
来源
IEEE CONTROL SYSTEMS LETTERS | 2021年 / 5卷 / 06期
关键词
Convex functions; Performance analysis; Probability density function; Optimization; Optimal control; Linear systems; Gaussian distribution; Stochastic optimal control; optimization; uncertain systems;
D O I
10.1109/LCSYS.2020.3047132
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider a class of stochastic optimal control problems for discrete-time linear systems whose objective is the characterization of control policies that will steer the probability distribution of the terminal state of the system close to a desired Gaussian distribution. In our problem formulation, the closeness between the terminal state distribution and the desired (goal) distribution is measured in terms of the squared Wasserstein distance which is associated with a corresponding terminal cost term. We recast the stochastic optimal control problem as a finite-dimensional nonlinear program whose performance index can be expressed as the difference of two convex functions. This representation of the performance index allows us to find local minimizers of the original nonlinear program via the so-called convex-concave procedure [1]. Finally, we present non-trivial numerical simulations to demonstrate the efficacy of the proposed technique by comparing it with sequential quadratic programming methods in terms of computation time.
引用
收藏
页码:2000 / 2005
页数:6
相关论文
共 21 条
[1]   Finite-horizon covariance control for discrete-time stochastic linear systems subject to input constraints [J].
Bakolas, Efstathios .
AUTOMATICA, 2018, 91 :61-68
[2]  
Bakolas E, 2016, P AMER CONTR CONF, P7231, DOI 10.1109/ACC.2016.7526814
[3]   Optimal Steering of a Linear Stochastic System to a Final Probability Distribution-Part III [J].
Chen, Yongxin ;
Georgiou, Tryphon T. ;
Pavon, Michele .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (09) :3112-3118
[4]   On the Relation Between Optimal Transport and Schrodinger Bridges: A Stochastic Control Viewpoint [J].
Chen, Yongxin ;
Georgiou, Tryphon T. ;
Pavon, Michele .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 169 (02) :671-691
[5]  
Chen YX, 2016, IEEE T AUTOMAT CONTR, V61, P1158, DOI 10.1109/TAC.2015.2457784
[6]   Optimal Steering of a Linear Stochastic System to a Final Probability Distribution, Part II [J].
Chen, Yongxin ;
Georgiou, Tryphon T. ;
Pavon, Michele .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (05) :1170-1180
[7]  
Diamond S, 2016, J MACH LEARN RES, V17
[8]  
GIVENS CR, 1984, MICH MATH J, V31, P231
[9]  
Halder A, 2016, P AMER CONTR CONF, P7249, DOI 10.1109/ACC.2016.7526817
[10]  
Horn R. A., 2012, Matrix Analysis, DOI DOI 10.1017/CBO9781139020411