REDUCED APPROACH FOR STOCHASTIC OPTIMAL CONTROL PROBLEMS

被引:0
作者
Chen, Liuhong [1 ]
Xiong, Meixin [1 ]
Ming, Ju [1 ]
机构
[1] Huazhong Univ Sci & Technol, Dept Math & Stat, Wuhan 430073, Peoples R China
关键词
SPDEs-constrained optimization problems; Lagrange multiplier method; the reduced approach; Monte Carlo finite element method; DISTRIBUTED CONTROL; BURGERS-EQUATION; APPROXIMATION; OPTIMIZATION; PRECONDITIONERS; COLLOCATION; NEWTONS; DRIVEN; FLOW;
D O I
暂无
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we develop and analyze the reduced approach for solving optimal control problems constrained by stochastic partial differential equations (SPDEs). Compared to the classical approaches based on Monte Carlo method to the solution of stochastic optimal control and optimization problems, e.g. Lagrange multiplier method, optimization methods based on sensitivity equations or adjoint equations, our strategy can take best advantage of all sorts of gradient descent algorithms used to deal with the unconstrained optimization problems but with less computational cost. Specifically, we represent the sample solutions for the constrained SPDEs or the state equations by their associated inverse-operators and plug them into the objective functional to explicitly eliminate the constrains, the constrained optimal control problems are then converted into the equivalent unconstrained ones, which implies the computational cost for solving the adjoint equations of the derived Lagrange system is avoided and faster convergent rate is expected. The stochastic Burgers' equation with additive white noise is used to illustrate the performance of our reduced approach. It no doubt has great potential application in stochastic optimization problems.
引用
收藏
页码:237 / 254
页数:18
相关论文
共 53 条
[1]  
Agarwal R., 1996, OPTIMAL ROBUST CONTR, P1
[2]  
[Anonymous], 1998, Stochastics and stochastics reports, DOI [10.1080/17442509808834159, DOI 10.1080/17442509808834159]
[3]  
[Anonymous], 1971, Die Grundlehren der mathematischen Wissenschaften
[4]  
[Anonymous], 1978, Sobolev spaces
[5]  
Atwell J.A., 2001, APPL MATH COMPUT SCI, V11, P1311
[6]  
Bertsekas D.P., 2019, Reinforcement Learning and Optimal Control
[7]  
Bressan N., 1986, Calcolo, V23, P265, DOI 10.1007/BF02576532
[8]  
Burkardt J, 2007, INT J NUMER ANAL MOD, V4, P368
[9]  
Burns J., 1991, Nonlinear Dynamics, V2, P235
[10]   A STOCHASTIC QUASI-NEWTON METHOD FOR LARGE-SCALE OPTIMIZATION [J].
Byrd, R. H. ;
Hansen, S. L. ;
Nocedal, Jorge ;
Singer, Y. .
SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) :1008-1031