Reinforcement learning for call admission control and routing under quality of service constraints in multimedia networks

被引:15
|
作者
Tong, H [1 ]
Brown, TX [1 ]
机构
[1] Univ Colorado, Boulder, CO 80309 USA
基金
美国国家科学基金会;
关键词
reinforcement learning; call admission control; routing; quality of service; multimedia networks;
D O I
10.1023/A:1017924227920
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we solve the call admission control and routing problem in multimedia networks via reinforcement learning (RL). The problem requires that network revenue be maximized while simultaneously meeting quality of service constraints that forbid entry into certain states and use of certain actions. The problem can be formulated as a constrained semi-Markov decision process. We show that RL provides a solution to this problem and is able to earn significantly higher revenues than alternative heuristics.
引用
收藏
页码:111 / 139
页数:29
相关论文
共 50 条
  • [11] Adaptive call admission control for QoS provisioning in multimedia wireless networks
    Prihandoko, F
    Habaebi, MH
    Ali, BM
    COMPUTER COMMUNICATIONS, 2003, 26 (14) : 1560 - 1569
  • [12] Joint Revenue-based Call Admission Control and Routing in Wireless Mesh Networks
    Naghavi, Nika
    Friderikos, Vasilis
    Aghvami, Hamid
    2011 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2011,
  • [13] Handoff Prioritization to Manage Call Admission Control in Mobile Multimedia Networks for Healthcare
    Kumar, Sanjeev
    Gaur, Madhu Sharma
    2019 10TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2019,
  • [14] Call Admission Control for Multimedia Connections in Interactive Satellite Networks
    Imole, Olugbenga
    Walingo, Tom
    Takawira, Fambirai
    PROCEEDINGS OF THE 2015 12TH IEEE AFRICON INTERNATIONAL CONFERENCE - GREEN INNOVATION FOR AFRICAN RENAISSANCE (AFRICON), 2015,
  • [15] End-to-end call admission control in service guaranteed networks
    Wang, YC
    Lu, CC
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2000, E83B (04) : 791 - 802
  • [16] Call admission control scheme with normalized quality of service metric in IEEE 802.16 networks
    Yan, Zhiwei
    Liu, Guizhong
    Su, Rui
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2015, 15 (02) : 309 - 321
  • [17] A near optimal call admission control with genetic algorithm for multimedia services in wireless/mobile networks
    Xiao, V
    Chen, CLP
    Wang, Y
    PROCEEDINGS OF THE IEEE 2000 NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE: ENGINEERING TOMORROW, 2000, : 787 - 792
  • [18] A Reinforcement Learning Framework for Vehicular Network Routing Under Peak and Average Constraints
    Geng, Nan
    Bai, Qinbo
    Liu, Chenyi
    Lan, Tian
    Aggarwal, Vaneet
    Yang, Yuan
    Xu, Mingwei
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (05) : 6753 - 6764
  • [19] A call admission and control scheme for quality‐of‐service (QoS) provisioning in next generation wireless networks
    S.K. Das
    R. Jayaram
    N.K. Kakani
    Sanjoy K. Sen
    Wireless Networks, 2000, 6 : 17 - 30
  • [20] An optimal distributed call admission control for adaptive multimedia in wireless/mobile networks
    Xiao, Y
    Chen, CLP
    Wang, Y
    8TH INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS AND SIMULATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS, PROCEEDINGS, 2000, : 477 - 482