A novel QoS-enabled load scheduling algorithm based on reinforcement learning in software-defined energy internet

被引:21
作者
Qiu, Chao [1 ]
Cui, Shaohua [2 ]
Yao, Haipeng [3 ]
Xu, Fangmin [1 ]
Yu, F. Richard [4 ]
Zhao, Chenglin [1 ]
机构
[1] Beijing Univ Posts & Telecom, Key Lab Univ Wireless Comm, Beijing, Peoples R China
[2] China Petr Technol & Dev Corp, Beijing, Peoples R China
[3] Beijing Univ Posts & Telecom, State Key Lab Networking & Switching Tech, Beijing, Peoples R China
[4] Carleton Univ, Dept Syst & Comp Eng, Ottawa, ON, Canada
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2019年 / 92卷
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Software-defined networking; Load scheduling; Quality of Service (QoS); Energy internet; Smart grid;
D O I
10.1016/j.future.2018.09.023
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recently, smart grid and Energy Internet (EI) are proposed to solve energy crisis and global warming, where improved communication mechanisms are important. Software-defined networking (SON) has been used in smart grid for real-time monitoring and communicating, which requires steady web environment with no packet loss and less time delay. With the explosion of network scales, the idea of multiple controllers has been proposed, where the problem of load scheduling needs to be solved. However, some traditional load scheduling algorithms have inferior robustness under the complicated environments in smart grid, and inferior time efficiency without pre-strategy, which are hard to meet the requirement of smart grid. Therefore, we present a novel controller mind (CM) framework to implement automatic management among multiple controllers. Specially, in order to solve the problem of complexity and pre-strategy in the system, we propose a novel Quality of Service (QoS) enabled load scheduling algorithm based on reinforcement learning in this paper. Simulation results show the effectiveness of our proposed scheme in the aspects of load variation and time efficiency. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:43 / 51
页数:9
相关论文
共 42 条
  • [31] Sufiev H., 2016, 2016 IEEE INT C SCI, P1, DOI 10.1109/ICSEE.2016.7806104
  • [32] Tootoonchian Amin., 2010, P 2010 INTERNET NETW, P3
  • [33] A Survey on Software-Defined Networking
    Xia, Wenfeng
    Wen, Yonggang
    Foh, Chuan Heng
    Niyato, Dusit
    Xie, Haiyong
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2015, 17 (01): : 27 - 51
  • [34] Fair Energy Scheduling for Vehicle-to-Grid Networks Using Adaptive Dynamic Programming
    Xie, Shengli
    Zhong, Weifeng
    Xie, Kan
    Yu, Rong
    Zhang, Yan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (08) : 1697 - 1707
  • [35] Yao H., 2015, INT J DISTRIB SENS N, V11, P41
  • [36] Yu JX, 2016, CHINA REV, V16, P1
  • [37] A Load Balancing Strategy for SDN Controller based on Distributed Decision
    Zhou, Yuanhao
    Zhu, Mingfa
    Xiao, Limin
    Ruan, Li
    Duan, Wenbo
    Li, Deguo
    Liu, Rui
    Zhu, Mingming
    [J]. 2014 IEEE 13TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM), 2014, : 851 - 856
  • [38] Workload-aware load balancing for clustered Web servers
    Zhang, Q
    Riska, A
    Sun, W
    Smirini, E
    Ciardo, G
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2005, 16 (03) : 219 - 233
  • [39] Zhang Y., 2012, IEEE NETW, V26
  • [40] Home M2M Networks: Architectures, Standards, and QoS Improvement
    Zhang, Yan
    Yu, Rong
    Xie, Shengli
    Yao, Wenqing
    Xiao, Yang
    Guizani, Mohsen
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2011, 49 (04) : 44 - 52