A learning approach for prioritized handoff channel allocation in mobile multimedia networks

被引:6
作者
El-Alfy, El-Sayed [1 ]
Yao, Yu-Dong [1 ]
Heffes, Harry [1 ]
机构
[1] Stevens Inst Technol, Dept Elect & Comp Engn, WISELAB, Hoboken, NJ 07030 USA
关键词
channel allocation; cellular multimedia networks; handoffs; Markov decision processes; dynamic programming; reinforcement learning;
D O I
10.1109/TWC.2006.1673076
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
An efficient channel allocation policy that prioritizes handoffs is an indispensable ingredient in future cellular networks in order to support multimedia traffic while ensuring quality of service requirements (QoS). In this paper we study the application of a reinforcement-learning algorithm to develop an alternative channel allocation scheme in mobile cellular networks that supports multiple heterogeneous traffic classes. The proposed scheme prioritizes handoff call requests over new calls and provides differentiated services for different traffic classes with diverse characteristics and quality of service requirements. Furthermore, it is asymptotically optimal, computationally inexpensive, model-free, and can adapt to changing traffic conditions. Simulations are provided to compare the effectiveness of the proposed algorithm with other known resource-sharing policies such as complete sharing and reservation policies.
引用
收藏
页码:1651 / 1660
页数:10
相关论文
共 24 条
[1]  
[Anonymous], 1981, INTRO QUEUING THEORY
[2]  
Bertsekas D. P., 1996, Neuro Dynamic Programming, V1st
[3]  
Bertsekas DP, 2012, DYNAMIC PROGRAMMING, V2
[4]   Adaptive channel allocation for wireless PCN [J].
Boumerdassi, S ;
Beylot, AL .
MOBILE NETWORKS & APPLICATIONS, 1999, 4 (02) :111-116
[5]   QUEUEING-BLOCKING SYSTEM WITH 2 ARRIVAL STREAMS AND GUARD CHANNELS [J].
GUERIN, R .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1988, 36 (02) :153-163
[6]   EQUIVALENT CAPACITY AND ITS APPLICATION TO BANDWIDTH ALLOCATION IN HIGH-SPEED NETWORKS [J].
GUERIN, R ;
AHMADI, H ;
NAGHSHINEH, M .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 1991, 9 (07) :968-981
[7]   Improving call admission policies in wireless networks [J].
Ho, CJ ;
Lea, CT .
WIRELESS NETWORKS, 1999, 5 (04) :257-265
[8]  
HONG D, 1986, IEEE T VEH TECHNOL, V35, P77, DOI 10.1109/T-VT.1986.24076
[9]   BLOCKING IN A SHARED RESOURCE ENVIRONMENT [J].
KAUFMAN, JS .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1981, 29 (10) :1474-1481
[10]   Average reward reinforcement learning: Foundations, algorithms, and empirical results [J].
Mahadevan, S .
MACHINE LEARNING, 1996, 22 (1-3) :159-195