Dynamic traffic steering based on fuzzy Q-Learning approach in a multi-RAT multi-layer wireless network

被引:12
作者
Munoz, P. [1 ]
Laselva, D. [2 ]
Barco, R. [1 ]
Mogensen, P. [2 ,3 ]
机构
[1] Univ Malaga, Dept Commun Engn, E-29071 Malaga, Spain
[2] Nokia Siemens Networks, Aalborg, Denmark
[3] Aalborg Univ, Aalborg, Denmark
关键词
Traffic steering; Q-Learning; Fuzzy logic controller; Handover; Heterogeneous networks; MULTISERVICE; OPTIMIZATION;
D O I
10.1016/j.comnet.2014.06.003
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The infrastructure of current cellular networks must evolve to cope with the increasing demand for mobile-broadband services. Heterogeneous networks are an attractive solution for operators to expand network capacity, based on deploying different Radio Access Technologies, cell sizes and carrier frequencies in the same environment. As a result, operators gain flexibility to distribute traffic across the different networks (or layers) in order to make a more efficient use of resources and enhance network performance. In this work, a dynamic traffic steering technique in multi-RAT multi-layer wireless networks is proposed. In particular, a fuzzy rule-based reinforcement learning algorithm modifies handover parameters according to a specific policy set by the operator, which typically searches for a trade-off between key performance indicators. Results show that the proposed optimization algorithm provides good flexibility to support different policies by simply adjusting some weighting factors. In addition, the Q-Learning algorithm is shown as an effective solution to adapt the network to context variations, such as those produced in the user spatial distribution. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:100 / 116
页数:17
相关论文
共 50 条
[31]   Q-learning based routing for in-network aggregation in wireless sensor networks [J].
Maivizhi, Radhakrishnan ;
Yogesh, Palanichamy .
WIRELESS NETWORKS, 2021, 27 (03) :2231-2250
[32]   Q-learning based routing for in-network aggregation in wireless sensor networks [J].
Radhakrishnan Maivizhi ;
Palanichamy Yogesh .
Wireless Networks, 2021, 27 :2231-2250
[33]   Multi-UAV Coverage Path Planning Based on Q-Learning [J].
Chen, Jiayu ;
Wang, Ziyi ;
Li, Zhiru ;
Shen, Jian ;
Chen, Pengyun .
IEEE SENSORS JOURNAL, 2025, 25 (16) :30444-30454
[34]   A Q-learning approach based on human reasoning for navigation in a dynamic environment [J].
Yuan, Rupeng ;
Zhang, Fuhai ;
Wang, Yu ;
Fu, Yili ;
Wang, Shuguo .
ROBOTICA, 2019, 37 (03) :445-468
[35]   A Dynamic Adaptation Mechanism of Network Resource Based on Fuzzy Q-learning in High-speed Mobile Environment [J].
Li, Jialin ;
Dong, Ping .
PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, :1079-1083
[36]   Study on Online εNN Q-Learning for Multi-Robot System Based on Community Perception Network [J].
Jin, Lu ;
Yang, Yuequan ;
Ni, Chunbo ;
Kong, Yifei ;
Cao, Zhiqiang .
PROCEEDINGS OF 2013 CHINESE INTELLIGENT AUTOMATION CONFERENCE: INTELLIGENT AUTOMATION, 2013, 254 :861-868
[37]   Multi-objective virtual network embedding algorithm based on Q-learning and curiosity-driven [J].
Mengyang He ;
Lei Zhuang ;
Shuaikui Tian ;
Guoqing Wang ;
Kunli Zhang .
EURASIP Journal on Wireless Communications and Networking, 2018
[38]   Integration of Q-learning and Behavior Network Approach with Hierarchical Task Network Planning for Dynamic Environments [J].
Sung, Yunsick ;
Cho, Kyungeun ;
Um, Kyhyun .
INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 2012, 15 (05) :2079-2090
[39]   Multi-agent reinforcement learning using modular neural network Q-learning algorithms [J].
杨银贤 .
Journal of Chongqing University, 2005, (01) :50-54
[40]   A multi-layer fuzzy model based on fuzzy-rule clustering for prediction tasks [J].
Fan, Zongwen ;
Chiong, Raymond ;
Hu, Zhongyi ;
Lin, Yuqing .
NEUROCOMPUTING, 2020, 410 :114-124