Covariance Steering of Discrete-Time Stochastic Linear Systems Based on Wasserstein Distance Terminal Cost

被引:10
作者
Balci, Isin M. [1 ]
Bakolas, Efstathios [1 ]
机构
[1] Univ Texas Austin, Dept Aerosp Engn & Engn Mech, Austin, TX 78712 USA
来源
IEEE CONTROL SYSTEMS LETTERS | 2021年 / 5卷 / 06期
关键词
Convex functions; Performance analysis; Probability density function; Optimization; Optimal control; Linear systems; Gaussian distribution; Stochastic optimal control; optimization; uncertain systems;
D O I
10.1109/LCSYS.2020.3047132
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider a class of stochastic optimal control problems for discrete-time linear systems whose objective is the characterization of control policies that will steer the probability distribution of the terminal state of the system close to a desired Gaussian distribution. In our problem formulation, the closeness between the terminal state distribution and the desired (goal) distribution is measured in terms of the squared Wasserstein distance which is associated with a corresponding terminal cost term. We recast the stochastic optimal control problem as a finite-dimensional nonlinear program whose performance index can be expressed as the difference of two convex functions. This representation of the performance index allows us to find local minimizers of the original nonlinear program via the so-called convex-concave procedure [1]. Finally, we present non-trivial numerical simulations to demonstrate the efficacy of the proposed technique by comparing it with sequential quadratic programming methods in terms of computation time.
引用
收藏
页码:2000 / 2005
页数:6
相关论文
共 21 条
[11]   DC programming: Overview [J].
Horst, R ;
Thoai, NV .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1999, 103 (01) :1-43
[12]   COVARIANCE CONTROL-THEORY [J].
HOTZ, A ;
SKELTON, RE .
INTERNATIONAL JOURNAL OF CONTROL, 1987, 46 (01) :13-32
[13]   ALL COVARIANCE CONTROLLERS FOR LINEAR DISCRETE-TIME-SYSTEMS [J].
HSIEH, C ;
SKELTON, RE .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1990, 35 (08) :908-915
[14]  
Mosek A.P.S, 2010, The MOSEK optimization software, P5
[15]   Optimal Covariance Control for Stochastic Systems Under Chance Constraints [J].
Okamoto, Kazuhide ;
Goldshtein, Maxim ;
Tsiotras, Panagiotis .
IEEE CONTROL SYSTEMS LETTERS, 2018, 2 (02) :266-271
[16]  
Shen XY, 2016, IEEE DECIS CONTR P, P1009, DOI 10.1109/CDC.2016.7798400
[17]   Design of Affine Controllers via Convex Optimization [J].
Skaf, Joelle ;
Boyd, Stephen P. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2010, 55 (11) :2476-2487
[18]   LIAPUNOV AND COVARIANCE CONTROLLERS [J].
SKELTON, RE ;
IWASAKI, T .
INTERNATIONAL JOURNAL OF CONTROL, 1993, 57 (03) :519-536
[19]   SciPy 1.0: fundamental algorithms for scientific computing in Python']Python [J].
Virtanen, Pauli ;
Gommers, Ralf ;
Oliphant, Travis E. ;
Haberland, Matt ;
Reddy, Tyler ;
Cournapeau, David ;
Burovski, Evgeni ;
Peterson, Pearu ;
Weckesser, Warren ;
Bright, Jonathan ;
van der Walt, Stefan J. ;
Brett, Matthew ;
Wilson, Joshua ;
Millman, K. Jarrod ;
Mayorov, Nikolay ;
Nelson, Andrew R. J. ;
Jones, Eric ;
Kern, Robert ;
Larson, Eric ;
Carey, C. J. ;
Polat, Ilhan ;
Feng, Yu ;
Moore, Eric W. ;
VanderPlas, Jake ;
Laxalde, Denis ;
Perktold, Josef ;
Cimrman, Robert ;
Henriksen, Ian ;
Quintero, E. A. ;
Harris, Charles R. ;
Archibald, Anne M. ;
Ribeiro, Antonio H. ;
Pedregosa, Fabian ;
van Mulbregt, Paul .
NATURE METHODS, 2020, 17 (03) :261-272
[20]   On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming [J].
Wachter, A ;
Biegler, LT .
MATHEMATICAL PROGRAMMING, 2006, 106 (01) :25-57