A Hemimetric Extension of Simulation for Semi-Markov Decision Processes

被引：2

作者：

Pedersen, Mathias Ruggaard ^{[1
]}

Bacci, Giorgio ^{[1
]}

Larsen, Kim Guldstrand ^{[1
]}

Mardare, Radu ^{[1
]}

机构：

[1] Aalborg Univ, Dept Comp Sci, Aalborg, Denmark

来源：

QUANTITATIVE EVALUATION OF SYSTEMS, QEST 2018 | 2018年 / 11024卷

关键词：

BISIMULATION; METRICS;

D O I：

10.1007/978-3-319-99154-2_21

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

Semi-Markov decision processes (SMDPs) are continuoustime Markov decision processes where the residence-time on states is governed by generic distributions on the positive real line. In this paper we consider the problem of comparing two SMDPs with respect to their time-dependent behaviour. We propose a hemimetric between processes, which we call simulation distance, measuring the least acceleration factor by which a process needs to speed up its actions in order to behave at least as fast as another process. We show that this distance can be computed in time O(n(2)(f(l) + k) + mn(7)), where n is the number of states, m the number of actions, k the number of atomic propositions, and f(l) the complexity of comparing the residence-time between states. The theoretical relevance and applicability of this distance is further argued by showing that (i) it is suitable for compositional reasoning with respect to CSP-like parallel composition and (ii) has a logical characterisation in terms of a simple Markovian logic.

引用

页码：339 / 355

页数：17