ON THE CONTROL OF A QUEUEING SYSTEM WITH AGING STATE INFORMATION

被引：0

作者：

Onderwater, Martijn ^{[1
,2
]}

Bhulai, Sandjai ^{[2
]}

van der Mei, Rob ^{[1
,2
]}

机构：

[1] Ctr Math & Comp Sci CWI, NL-1098 XG Amsterdam, Netherlands

[2] Vrije Univ Amsterdam, Fac Sci, Amsterdam, Netherlands

来源：

STOCHASTIC MODELS | 2015年 / 31卷 / 04期

关键词：

Aging state information; Controlled queueing system; Difference equations; Markov decision processes; One-step policy improvement; Optimization; Ordered performance curve; Value iteration; DECOMPOSITION; POLICIES;

D O I：

10.1080/15326349.2015.1058716

中图分类号：

O21 [概率论与数理统计]; C8 [统计学];

学科分类号：

020208 ; 070103 ; 0714 ;

摘要：

We investigate control of a queueing system in which a component of the state space is subject to aging. The controller can choose to forward incoming queries to the system (where it needs time for processing), or respond with a previously generated response (incurring a penalty for not providing a fresh value). Hence, the controller faces a tradeoff between data freshness and response times. We model the system as a complex Markov decision process, simplify it, and construct a control policy. This policy shows near-optimal performance and achieves lower costs than both a myopic policy and a threshold policy.

引用

页码：588 / 617

页数：30

共 18 条

[1]

Altman E, 1998, IEEE DECIS CONTR P, P2119, DOI 10.1109/CDC.1998.758648

[2] On the structure of value functions for threshold policies in queueing models [J].

Bhulai, S ;

Koole, G .

JOURNAL OF APPLIED PROBABILITY, 2003, 40 (03) :613-622

[3]

Bhulai S., 2002, THESIS

[4] DYNAMIC ROUTING POLICIES FOR MULTISKILL CALL CENTERS [J].

Bhulai, Sandjai .

PROBABILITY IN THE ENGINEERING AND INFORMATIONAL SCIENCES, 2009, 23 (01) :101-119

[5] Interpreting stale load information [J].

Dahlin, M .

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2000, 11 (10) :1033-1047

[6] AN MDP DECOMPOSITION APPROACH FOR TRAFFIC CONTROL AT ISOLATED SIGNALIZED INTERSECTIONS [J].

Haijema, Rene ;

van der Wal, Jan .

PROBABILITY IN THE ENGINEERING AND INFORMATIONAL SCIENCES, 2008, 22 (04) :587-602

[7]

Hernandez-Lerma O, 1996, Discrete-time Markov control processes: basic optimality criteria

[8]

Ho Y.-C., 2007, Ordinal optimization: Soft optimization for hard problems

[9] APPLYING A NEW DEVICE IN OPTIMIZATION OF EXPONENTIAL QUEUING SYSTEMS [J].

LIPPMAN, SA .

OPERATIONS RESEARCH, 1975, 23 (04) :687-710

[10]

Mitici Mihaela, 2015, INT J ELECT COMM AEU, V69, P1102

← 1 2 →