An Aggregation Procedure for Large-Scale Markov Decision Processes

被引:0
|
作者
Bartl, Ondrej [1 ]
机构
[1] Univ Zilina, Fac Management Sci & Informat, Dept Software Technol, Zilina 01026, Slovakia
关键词
Markov/semi-Markov decision processes; state and action aggregation;
D O I
暂无
中图分类号
F [经济];
学科分类号
02 ;
摘要
Markov decision models with a high state space cardinality may resist being computationally tractable. Then reduction in the number of possible state variable values can help. The fixed-weight aggregation procedure for large-scale Markov/semi-Markov decision processes is described in the paper. A possibility to approximate an original decision model by action aggregation accompanying state aggregation is mentioned as well.
引用
收藏
页码:9 / 15
页数:7
相关论文
共 50 条
  • [41] Large-scale processes in ecology and hydrology
    Caldow, RWG
    Racey, PA
    JOURNAL OF APPLIED ECOLOGY, 2000, 37 : 6 - 12
  • [42] LARGE-SCALE PROCEDURE FOR PURIFICATION OF DESMOSINE AND ISODESMOSINE
    STARCHER, BC
    GALIONE, MJ
    PREPARATIVE BIOCHEMISTRY, 1975, 5 (5-6): : 455 - 460
  • [43] LARGE-SCALE PROCEDURE FOR THE PURIFICATION OF FIBRONECTIN DOMAINS
    BORSI, L
    CASTELLANI, P
    BALZA, E
    SIRI, A
    PELLECCHIA, C
    DESCALZI, F
    ZARDI, L
    ANALYTICAL BIOCHEMISTRY, 1986, 155 (02) : 335 - 345
  • [44] Small-scale dynamics of large-scale processes
    Scott, RJ
    AMERICAN HISTORICAL REVIEW, 2000, 105 (02): : 472 - 479
  • [45] Adaptive aggregation for reinforcement learning in average reward Markov decision processes
    Ortner, Ronald
    ANNALS OF OPERATIONS RESEARCH, 2013, 208 (01) : 321 - 336
  • [46] Adaptive aggregation for reinforcement learning in average reward Markov decision processes
    Ronald Ortner
    Annals of Operations Research, 2013, 208 : 321 - 336
  • [47] Large-Scale Empirical Tests of the Markov Tree Model
    Bhat, Harish S.
    Kumar, Nitesh
    INTERNATIONAL JOURNAL OF FINANCIAL STUDIES, 2015, 3 (03): : 280 - 318
  • [48] A large-scale distributed decision-making procedure for a single-machine scheduling problem
    Hong, Soondo
    Banerjee, Amarnath
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2012, 50 (20) : 5795 - 5808
  • [49] LARGE-SCALE INTERACTIVE MAPPING FOR DECISION SUPPORT
    NICHOLSON, RL
    COMPUTER GRAPHICS WORLD, 1984, 7 (01) : 60 - &
  • [50] Decision process in large-scale crisis management
    Kamissoko D.
    Zaraté P.
    Pérès F.
    Environment Systems and Decisions, 2014, 34 (2) : 277 - 287