Reinforcement learning for call admission control and routing under quality of service constraints in multimedia networks

被引:15
|
作者
Tong, H [1 ]
Brown, TX [1 ]
机构
[1] Univ Colorado, Boulder, CO 80309 USA
基金
美国国家科学基金会;
关键词
reinforcement learning; call admission control; routing; quality of service; multimedia networks;
D O I
10.1023/A:1017924227920
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we solve the call admission control and routing problem in multimedia networks via reinforcement learning (RL). The problem requires that network revenue be maximized while simultaneously meeting quality of service constraints that forbid entry into certain states and use of certain actions. The problem can be formulated as a constrained semi-Markov decision process. We show that RL provides a solution to this problem and is able to earn significantly higher revenues than alternative heuristics.
引用
收藏
页码:111 / 139
页数:29
相关论文
共 50 条
  • [21] A Call Admission Control Mechanism Using Mobility Graph in Mobile Multimedia Networks
    Chang Ho Choi
    Sung Jo Kim
    Wireless Personal Communications, 2003, 25 : 321 - 341
  • [22] QoS-aware call admission control for multimedia over CDMA networks
    Seo, SY
    Shin, JT
    Kim, JW
    INTERNET MULTIMEDIA MANAGEMENT SYSTEMS IV, 2003, 5242 : 228 - 236
  • [23] A call admission control mechanism using mobility graph in mobile multimedia networks
    Choi, CH
    Kim, SJ
    WIRELESS PERSONAL COMMUNICATIONS, 2003, 25 (04) : 321 - 341
  • [24] Adaptive admission control in wireless multimedia networks under nonuniform traffic conditions
    Misic, J
    Bun, TY
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2000, 18 (11) : 2429 - 2442
  • [25] Novel stochastic model for call admission control in broadband wireless multimedia networks
    Liu, G
    Zhu, GX
    Ruan, YL
    Hu, ZP
    Wu, WM
    Wang, DS
    CHINESE JOURNAL OF ELECTRONICS, 2005, 14 (01): : 154 - 158
  • [26] The use of learning algorithms in ATM networks call admission control problem: a methodology
    Atlasis, AF
    Loukas, NH
    Vasilakos, AV
    COMPUTER NETWORKS-THE INTERNATIONAL JOURNAL OF COMPUTER AND TELECOMMUNICATIONS NETWORKING, 2000, 34 (03): : 341 - 353
  • [27] ROUTING AND ADMISSION CONTROL ALGORITHMS FOR MULTIMEDIA TRAFFIC
    RAMPAL, S
    REEVES, DS
    COMPUTER COMMUNICATIONS, 1995, 18 (10) : 755 - 768
  • [28] Call admission control in satellite networks under rain fading
    Petraki, Dionysia K.
    Anastasopgulos, Markos P.
    Cottis, Panayotis. G.
    IEEE COMMUNICATIONS LETTERS, 2008, 12 (05) : 377 - 379
  • [29] Dynamic admission control for quality of service in IP networks
    Kasigwa, J.
    Baryamureeba, V.
    Williams, D.
    ADVANCES IN COMPUTER, INFORMATION, AND SYSTEMS SCIENCES AND ENGINEERING, 2006, : 253 - +
  • [30] Dynamic Admission Control for Quality of Service in IP Networks
    Kasigwa, J.
    Baryamureeba, V.
    Williams, D.
    PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 8, 2005, 8 : 56 - 60