Reinforcement learning for call admission control and routing under quality of service constraints in multimedia networks

被引:15
|
作者
Tong, H [1 ]
Brown, TX [1 ]
机构
[1] Univ Colorado, Boulder, CO 80309 USA
基金
美国国家科学基金会;
关键词
reinforcement learning; call admission control; routing; quality of service; multimedia networks;
D O I
10.1023/A:1017924227920
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we solve the call admission control and routing problem in multimedia networks via reinforcement learning (RL). The problem requires that network revenue be maximized while simultaneously meeting quality of service constraints that forbid entry into certain states and use of certain actions. The problem can be formulated as a constrained semi-Markov decision process. We show that RL provides a solution to this problem and is able to earn significantly higher revenues than alternative heuristics.
引用
收藏
页码:111 / 139
页数:29
相关论文
共 50 条
  • [1] Reinforcement Learning for Call Admission Control and Routing under Quality of Service Constraints in Multimedia Networks
    Hui Tong
    Timothy X Brown
    Machine Learning, 2002, 49 : 111 - 139
  • [2] Adaptive call admission control under quality of service constraints: A reinforcement learning solution
    Tong, H
    Brown, TX
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2000, 18 (02) : 209 - 221
  • [3] An Improved Call Admission Control Scheme Based on Reinforcement Learning for Multimedia Wireless Networks
    Chen, Yueyun
    Jia, Cuixia
    PROCEEDINGS OF THE 2009 INTERNATIONAL CONFERENCE ON WIRELESS NETWORKS AND INFORMATION SYSTEMS, 2009, : 322 - 325
  • [4] Quality of service and call admission control for adaptive multimedia services in wireless/mobile networks
    Xiao, Y
    Chen, CLP
    Wang, Y
    PROCEEDINGS OF THE IEEE 2000 NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE: ENGINEERING TOMORROW, 2000, : 214 - 220
  • [5] Admission control for wireless multimedia networks with hard call level quality of service bounds
    Misic, J
    Chanson, ST
    Lai, FS
    COMPUTER NETWORKS-THE INTERNATIONAL JOURNAL OF COMPUTER AND TELECOMMUNICATIONS NETWORKING, 1999, 31 (1-2): : 125 - 140
  • [6] Using the Reinforcement Learning Scheme to the Priority-Based Routing and Call Admission Control in WDM Networks
    Chang, Ching-Lung
    Kang, Siao-Ji
    JOURNAL OF INTERNET TECHNOLOGY, 2012, 13 (05): : 793 - 801
  • [7] A learning approach for call admission control under QoS constraints in cellular networks
    Yang, Xu
    Bigham, John
    2006 10TH IEEE SINGAPORE INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS, VOLS 1 AND 2, 2006, : 187 - +
  • [8] Call admission control in wireless multimedia networks
    Bartolini, N
    Chlamtac, I
    13TH IEEE INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, VOL 1-5, PROCEEDINGS: SAILING THE WAVES OF THE WIRELESS OCEANS, 2002, : 285 - 289
  • [9] A fuzzy call admission control scheme in cellular multimedia networks
    Ma, YF
    Hu, XL
    Zhang, YY
    Zhao, ED
    2005 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING PROCEEDINGS, VOLS 1 AND 2, 2005, : 844 - 847
  • [10] Analysis of Call Admission Control with IM Service in Multimedia OFDMA System
    Chen, Yi
    Ni, Zhifeng
    Wang, Yong
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON INFORMATION, ELECTRONICS AND COMPUTER, 2014, 59 : 33 - 37