OPTIMAL CONTROL OF CONDITIONAL VALUE-AT-RISK IN CONTINUOUS TIME

被引:35
|
作者
Miller, Christopher W. [1 ]
Yang, Insoon [2 ]
机构
[1] Univ Calif Berkeley, Dept Math, San Francisco, CA 94108 USA
[2] Univ Southern Calif, Ming Hsieh Dept Elect Engn, Los Angeles, CA 90089 USA
基金
美国国家科学基金会;
关键词
conditional value-at-risk; risk measures; time inconsistency; stochastic optimal control; Hamilton-Jacobi-Bellman equations; viscosity solutions; dynamic programming; 2ND-ORDER ELLIPTIC-EQUATIONS; JACOBI-BELLMAN EQUATIONS; MEASURABLE COEFFICIENTS; DISCONTINUOUS COEFFICIENTS; PARABOLIC EQUATIONS; SENSITIVE CONTROL; SYSTEMS; MODELS; OPTIMIZATION; UNIQUENESS;
D O I
10.1137/16M1058492
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider continuous-time stochastic optimal control problems featuring conditional value-at-risk (CVaR) in the objective. The major difficulty in these problems arises from time inconsistency, which prevents us from directly using dynamic programming. To resolve this challenge, we convert to an equivalent bilevel optimization problem in which the inner optimization problem is standard stochastic control. Furthermore, we provide conditions under which the outer objective function is convex and differentiable. We compute the outer objective's value via a Hamilton-Jacobi-Bellman equation and its gradient via the viscosity solution of a linear parabolic equation, which allows us to perform gradient descent. The significance of this result is that we provide an efficient dynamic-programming-based algorithm for optimal control of CVaR without lifting the state space. To broaden the applicability of the proposed algorithm, we propose convergent approximation schemes in cases where our key assumptions do not hold and characterize relevant suboptimality bounds. In addition, we extend our method to a more general class of risk metrics, which includes mean variance and median deviation. We also demonstrate a concrete application to portfolio optimization under CVaR constraints. Our results contribute an efficient framework for solving time-inconsistent CVaR-based sequential optimization.
引用
收藏
页码:856 / 884
页数:29
相关论文
共 50 条
  • [1] Optimal Control of a Virtual Power Plant by Maximizing Conditional Value-at-Risk
    Lin, Whei-Min
    Yang, Chung-Yuen
    Wu, Zong-Yo
    Tsai, Ming-Tang
    APPLIED SCIENCES-BASEL, 2021, 11 (16):
  • [2] Optimal Control of Energy Storage in a Microgrid by Minimizing Conditional Value-at-Risk
    Khodabakhsh, Raheleh
    Sirouspour, Shahin
    IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2016, 7 (03) : 1264 - 1273
  • [3] Distributionally robust reinsurance with Value-at-Risk and Conditional Value-at-Risk
    Liu, Haiyan
    Mao, Tiantian
    INSURANCE MATHEMATICS & ECONOMICS, 2022, 107 : 393 - 417
  • [4] Conditional Value-at-Risk and Average Value-at-Risk: Estimation and Asymptotics
    Chun, So Yeon
    Shapiro, Alexander
    Uryasev, Stan
    OPERATIONS RESEARCH, 2012, 60 (04) : 739 - 756
  • [5] Safety-Aware Optimal Control of Stochastic Systems Using Conditional Value-at-Risk
    Samuelson, Samantha
    Yang, Insoon
    2018 ANNUAL AMERICAN CONTROL CONFERENCE (ACC), 2018, : 6285 - 6290
  • [6] Conditional value-at-risk forecasts of an optimal foreign currency portfolio
    Kim, Dongwhan
    Kang, Kyu Ho
    INTERNATIONAL JOURNAL OF FORECASTING, 2021, 37 (02) : 838 - 861
  • [7] Kendall Conditional Value-at-Risk
    Durante, Fabrizio
    Gatto, Aurora
    Perrone, Elisa
    MATHEMATICAL AND STATISTICAL METHODS FOR ACTUARIAL SCIENCES AND FINANCE, MAF 2022, 2022, : 222 - 227
  • [8] Monte Carlo Methods for Value-at-Risk and Conditional Value-at-Risk: A Review
    Hong, L. Jeff
    Hu, Zhaolin
    Liu, Guangwu
    ACM TRANSACTIONS ON MODELING AND COMPUTER SIMULATION, 2014, 24 (04):
  • [9] Analytical method for computing stressed value-at-risk with conditional value-at-risk
    Hong, KiHoon
    JOURNAL OF RISK, 2017, 19 (03): : 85 - 106
  • [10] A SEQUENTIAL ELIMINATION APPROACH TO VALUE-AT-RISK AND CONDITIONAL VALUE-AT-RISK SELECTION
    Hepworth, Adam J.
    Atkinson, Michael P.
    Szechtman, Roberto
    2017 WINTER SIMULATION CONFERENCE (WSC), 2017, : 2324 - 2335