An Aggregation Procedure for Large-Scale Markov Decision Processes

被引：0

作者：

Bartl, Ondrej ^{[1
]}

机构：

[1] Univ Zilina, Fac Management Sci & Informat, Dept Software Technol, Zilina 01026, Slovakia

来源：

PROCEEDINGS OF THE 22ND INTERNATIONAL CONFERENCE ON MATHEMATICAL METHODS IN ECONOMICS 2004 | 2004年

关键词：

Markov/semi-Markov decision processes; state and action aggregation;

D O I：

暂无

中图分类号：

F [经济];

学科分类号：

02 ;

摘要：

Markov decision models with a high state space cardinality may resist being computationally tractable. Then reduction in the number of possible state variable values can help. The fixed-weight aggregation procedure for large-scale Markov/semi-Markov decision processes is described in the paper. A possibility to approximate an original decision model by action aggregation accompanying state aggregation is mentioned as well.

引用

页码：9 / 15

页数：7

共 50 条

[31] Pseudometrics for state aggregation in average reward Markov decision processes
Ortner, Ronald
ALGORITHMIC LEARNING THEORY, PROCEEDINGS, 2007, 4754 : 373 - 387
[32] Managing experts behavior in large-scale consensus reaching processes with uninorm aggregation operators
Quesada, Francisco J.
Palomares, Ivan
Martinez, Luis
APPLIED SOFT COMPUTING, 2015, 35 : 873 - 887
[33] DECISION MAKERS AND LARGE-SCALE SYSTEM
GARGIULO, GR
JOURNAL OF SYSTEMS MANAGEMENT, 1969, 20 (08): : 15 - 18
[34] Markov decision processes with slow scale periodic decisions
Jacobson, M
Shimkin, N
Shwartz, A
MATHEMATICS OF OPERATIONS RESEARCH, 2003, 28 (04) : 777 - 800
[35] Aggregation methods for large-scale sensor networks
Chitnis, Laukik
Dobra, Alin
Ranka, Sanjay
ACM TRANSACTIONS ON SENSOR NETWORKS, 2008, 4 (02)
[36] TRANSITIONS IN THE LARGE-SCALE STRUCTURE OF AGGREGATION MODELS
MON, KK
PHYSICAL REVIEW A, 1986, 34 (05): : 4469 - 4471
[37] Efficient algorithms for large-scale temporal aggregation
Moon, B
Fernando, I
Lopez, V
Immanuel, V
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2003, 15 (03) : 744 - 759
[38] CONTROL OF LARGE-SCALE DYNAMIC SYSTEMS BY AGGREGATION
AOKI, M
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1968, AC13 (03) : 246 - &
[39] Approximate planning and verification for large Markov decision processes
Lassaigne, Richard
Peyronnet, Sylvain
INTERNATIONAL JOURNAL ON SOFTWARE TOOLS FOR TECHNOLOGY TRANSFER, 2015, 17 (04) : 457 - 467
[40] Approximate planning and verification for large Markov decision processes
Richard Lassaigne
Sylvain Peyronnet
International Journal on Software Tools for Technology Transfer, 2015, 17 : 457 - 467

← 1 2 3 4 5 →