Continuity of the Value Function for Stochastic Sparse Optimal Control

被引:0
作者
Ito, Kaito [1 ]
Ikeda, Takuya [2 ]
Kashima, Kenji [1 ]
机构
[1] Kyoto Univ, Kyoto, Japan
[2] Univ Kitakyushu, Kitakyushu, Fukuoka, Japan
关键词
sparsity; optimal control; stochastic systems; value function; continuity; DIRECTIONAL SPARSITY;
D O I
10.1016/j.ifacol.2020.12.537
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we investigate the continuity of the value function for a stochastic sparse optimal control. The most common method to solve stochastic optimal control problems is the dynamic programming Specifically, if the value function is smooth, it satisfies the associated Hamilton-Jacobi-Bellman (HJB) equation. However, in general, the value function for our problem is not differentiable because of the nonsmoothness of the L-0 cost functional. Instead, we can expect that the value function is a viscosity solution to the HJB equation. This paper shows the continuity of our value function as a first step for showing that the value function is a viscosity solution. Copyright (C) 2020 The Authors.
引用
收藏
页码:7179 / 7184
页数:6
相关论文
共 16 条
[1]  
[Anonymous], 2008, OPTIMAL CONTROL VISC
[2]  
Boyd Stephen, 2014, Foundations and Trends in Optimization, V1, P1, DOI 10.1561/2400000001
[3]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[4]   Stochastic L1-optimal control via forward and backward sampling [J].
Exarchos, Loannis ;
Theodorou, Evangelos A. ;
Tsiotras, Panagiotis .
SYSTEMS & CONTROL LETTERS, 2018, 118 :101-108
[5]  
Fleming W.H., 2006, CONTROLLED MARKOV PR, V25
[6]   DIRECTIONAL SPARSITY IN OPTIMAL CONTROL OF PARTIAL DIFFERENTIAL EQUATIONS [J].
Herzog, Roland ;
Stadler, Georg ;
Wachsmuth, Gerd .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2012, 50 (02) :943-963
[7]  
Ikeda T, 2019, 2019 18TH EUROPEAN CONTROL CONFERENCE (ECC), P3728, DOI [10.23919/ecc.2019.8796190, 10.23919/ECC.2019.8796190]
[8]   On Sparse Optimal Control for General Linear Systems [J].
Ikeda, Takuya ;
Kashima, Kenji .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (05) :2077-2083
[9]   Sparsity-Constrained Controllability Maximization With Application to Time-Varying Control Node Selection [J].
Ikeda, Takuya ;
Kashima, Kenji .
IEEE CONTROL SYSTEMS LETTERS, 2018, 2 (03) :321-326
[10]   Value function in maximum hands-off control for linear systems [J].
Ikeda, Takuya ;
Nagahara, Masaaki .
AUTOMATICA, 2016, 64 :190-195