Optimization of queuing system via stochastic control

被引:29
作者
Miller, Boris M. [1 ,2 ]
机构
[1] Monash Univ, Sch Math Sci, Clayton, Vic 3800, Australia
[2] RAS, Inst Informat Transmiss Problems, Moscow 117901, Russia
关键词
Queuing systems; Markov chains; Optimization; Stochastic control; JUMP PROCESSES; INTERNET;
D O I
10.1016/j.automatica.2009.01.011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The problem of access and service rate control in queuing systems as a general optimization problem for controlled Markov process with finite state space is considered. By using the dynamic programming approach we obtain the explicit form of the optimal control in the case of minimizing cost given as a mixture of an average queue length, number of lost jobs, and service resources. The problem is considered on a finite time interval in the case of nonstationary input flow. In this case we suggest the general procedure of the numerical solution which can be applied to a problems with constraints. (C) 2009 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1423 / 1430
页数:8
相关论文
共 13 条
[1]   OPTIMAL-CONTROL OF JUMP PROCESSES [J].
BOEL, R ;
VARAIYA, P .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1977, 15 (01) :92-119
[2]   OPTIMAL THINNING OF A POINT PROCESS [J].
BREMAUD, P .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1979, 17 (02) :222-230
[3]   OPTIMAL-CONTROL OF A JUMP PROCESS [J].
DAVIS, M ;
ELLIOTT, R .
ZEITSCHRIFT FUR WAHRSCHEINLICHKEITSTHEORIE UND VERWANDTE GEBIETE, 1977, 40 (03) :183-202
[4]   A PARTIALLY OBSERVED CONTROL PROBLEM FOR MARKOV-CHAINS [J].
ELLIOTT, RJ .
APPLIED MATHEMATICS AND OPTIMIZATION, 1992, 25 (02) :151-169
[5]   CONSTRAINED ADMISSION CONTROL TO A QUEUING SYSTEM [J].
HORDIJK, A ;
SPIEKSMA, F .
ADVANCES IN APPLIED PROBABILITY, 1989, 21 (02) :409-431
[6]   Rate control for communication networks: shadow prices, proportional fairness and stability [J].
Kelly, FP ;
Maulloo, AK ;
Tan, DKH .
JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 1998, 49 (03) :237-252
[7]   Internet congestion control [J].
Low, SH ;
Paganini, F ;
Doyle, JC .
IEEE CONTROL SYSTEMS MAGAZINE, 2002, 22 (01) :28-43
[8]   Flow control as a stochastic optimal control problem with incomplete information [J].
Miller B.M. ;
Avrachenkov K.E. ;
Stepanyan K.V. ;
Miller G.B. .
Problems of Information Transmission, 2005, 41 (2) :150-170
[9]   FINITE STATE CONTINUOUS TIME MARKOV DECISION PROCESSES WITH A FINITE PLANNING HORIZON [J].
MILLER, BL .
SIAM JOURNAL ON CONTROL, 1968, 6 (02) :266-&
[10]   Bicriteria optimization of a queue with a controlled input stream [J].
Piunovskiy, AB .
QUEUEING SYSTEMS, 2004, 48 (1-2) :159-184