Approximation of optimal ergodic dividend strategies using controlled Markov chains

被引:1
作者
Jin, Zhuo [1 ]
Yang, Hailiang [2 ]
Yin, George [3 ]
机构
[1] Univ Melbourne, Dept Econ, Ctr Actuarial Studies, Melbourne, Vic 3010, Australia
[2] Univ Hong Kong, Dept Stat & Actuarial Sci, Hong Kong, Hong Kong, Peoples R China
[3] Wayne State Univ, Dept Math, Detroit, MI 48202 USA
基金
美国国家科学基金会;
关键词
continuous time systems; approximation theory; Markov processes; dynamic programming; discrete time systems; optimal control; discrete-time controlled Markov chain; optimal ergodic dividend strategies; controlled Markov chains; numerical method; regime-switching model; surplus process; regime-switching process subject; finite-time continuous-time Markov chain; dynamic programming principle; long-term average dividend payment; Hamilton-Jacobi-Bellman equations; optimal value; invariant measure; regime switching; optimal ergodic dividend payment strategy; Markov chain approximation techniques; RISK-SENSITIVE CONTROL; JUMP-DIFFUSION-MODELS; INSURANCE COMPANY; NUMERICAL-METHODS; INVESTMENT; OPTIMIZATION; PAYMENT; REINSURANCE; POLICY; COSTS;
D O I
10.1049/iet-cta.2018.5394
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study develops a numerical method to find optimal ergodic (long-run average) dividend strategies in a regime-switching model. The surplus process is modelled by a regime-switching process subject to liability constraints. The regime-switching process is modelled by a finite-time continuous-time Markov chain. Using the dynamic programming principle, the optimal long-term average dividend payment is a solution to the coupled system of Hamilton-Jacobi-Bellman equations. Under suitable conditions, the optimal value of the long-term average dividend payment can be determined by using an invariant measure. However, due to the regime switching, getting the invariant measure is very difficult. The objective is to design a numerical algorithm to approximate the optimal ergodic dividend payment strategy. By using the Markov chain approximation techniques, the authors construct a discrete-time controlled Markov chain for the approximation, and prove the convergence of the approximating sequences. A numerical example is presented to demonstrate the applicability of the algorithm.
引用
收藏
页码:2194 / 2204
页数:11
相关论文
共 29 条
[1]   On the optimal stochastic impulse control of linear diffusions [J].
Alvarez, Luis H. R. ;
Lempa, Jukka .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2008, 47 (02) :703-732
[2]   On the optimal dividend problem for a spectrally negative Levy process [J].
Avram, Florin ;
Palmowski, Zbigniew ;
Pistorius, Martijn R. .
ANNALS OF APPLIED PROBABILITY, 2007, 17 (01) :156-180
[3]   OPTIMAL INVESTMENT POLICY AND DIVIDEND PAYMENT STRATEGY IN AN INSURANCE COMPANY [J].
Azcue, Pablo ;
Muler, Nora .
ANNALS OF APPLIED PROBABILITY, 2010, 20 (04) :1253-1302
[4]   On non-trivial barrier solutions of the dividend problem for a diffusion under constant and proportional transaction costs [J].
Bai, Lihua ;
Paulsen, Jostein .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2012, 122 (12) :4005-4027
[5]  
Bertsekas Dimitri P., 2018, Abstract Dynamic Programming, V2nd
[6]  
BIELECKI T. R., 2003, REV ACCOUNT FINANC, V2, P3, DOI DOI 10.1108/EB027004
[7]   Risk-sensitive dynamic asset management [J].
Bielecki, TR ;
Pliska, SR .
APPLIED MATHEMATICS AND OPTIMIZATION, 1999, 39 (03) :337-360
[8]  
De Finetti B., 1957, T 15 INT C ACT, V2, P433
[9]  
Fleming W.H., 2006, Stochastic modelling and applied probability, V2nd ed.
[10]   RISK-SENSITIVE CONTROL ON AN INFINITE TIME HORIZON [J].
FLEMING, WH ;
MCENEANEY, WM .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1995, 33 (06) :1881-1915