OPTIMAL COST AND POLICY FOR A MARKOVIAN REPLACEMENT-PROBLEM

被引:0
|
作者
SERNIK, EL
MARCUS, SI
机构
[1] Department of Electrical and Computer Engineering, University of Texas, Austin, Texas
关键词
MARKOV CHAIN; DYNAMIC PROGRAMMING; DISCOUNTED COST; OPTIMAL POLICY;
D O I
10.1007/BF00940042
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider the computation of the optimal cost and policy associated with a two-dimensional Markov replacement problem with partial observations, for two special cases of observation quality. Relying on structural results available for the optimal policy associated with these two particular models, we show that, in both cases, the infinite-horizon, optimal discounted cost function is piecewise linear, and provide formulas for computing the cost and the policy. Several examples illustrate the usefulness of the results.
引用
收藏
页码:105 / 126
页数:22
相关论文
共 50 条
  • [31] Stochastic Optimal Control with Markovian Lossy State Observations
    Huang, Minyi
    2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 678 - 683
  • [32] Optimal procedures for the discrete time cost trade-off problem in project networks
    Demeulemeester, EL
    Herroelen, WS
    Elmaghraby, SE
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1996, 88 (01) : 50 - 68
  • [33] Optimal inventory control policy and supply chain coordination problem with carbon footprint constraints
    Tao, Feng
    Fan, Tijun
    Lai, Kin Keung
    INTERNATIONAL TRANSACTIONS IN OPERATIONAL RESEARCH, 2018, 25 (06) : 1831 - 1853
  • [34] Optimal solutions for the economic lot-sizing problem with multiple suppliers and cost structures
    Bai Q.-G.
    Xu J.-T.
    Journal of Applied Mathematics and Computing, 2011, 37 (1-2) : 331 - 345
  • [35] An optimal planned replacement time based on availability and cost functions for a system subject to three types of failures
    Safaei, Fatemeh
    Ahmadi, Jafar
    Gildeh, Bahram Sadeghpour
    COMPUTERS & INDUSTRIAL ENGINEERING, 2018, 124 : 77 - 87
  • [36] Optimal insemination and replacement decisions to minimize the cost of pathogen-specific clinical mastitis in dairy cows
    Cha, E.
    Kristensen, A. R.
    Hertl, J. A.
    Schukken, Y. H.
    Tauer, L. W.
    Welcome, F. L.
    Groehn, Y. T.
    JOURNAL OF DAIRY SCIENCE, 2014, 97 (04) : 2101 - 2117
  • [37] Inventory Models with Markovian Demands and Cost Functions of Polynomial Growth
    D. Beyer
    S. P. Sethi
    M. Taksar
    Journal of Optimization Theory and Applications, 1998, 98 : 281 - 323
  • [38] Optimal Inspection and Maintenance Policy: Integrating a Continuous-Time Markov Chain into a Homing Problem
    Lefebvre, Mario
    Yaghoubi, Roozbeh
    MACHINES, 2024, 12 (11)
  • [39] Inventory models with Markovian demands and cost functions of polynomial growth
    Beyer, D
    Sethi, SP
    Taksar, M
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1998, 98 (02) : 281 - 323
  • [40] Optimal unemployment policy
    Lawson, Nicholas
    ECONOMIC INQUIRY, 2023, 61 (03) : 675 - 692