A novel QoS-enabled load scheduling algorithm based on reinforcement learning in software-defined energy internet

被引:21
作者
Qiu, Chao [1 ]
Cui, Shaohua [2 ]
Yao, Haipeng [3 ]
Xu, Fangmin [1 ]
Yu, F. Richard [4 ]
Zhao, Chenglin [1 ]
机构
[1] Beijing Univ Posts & Telecom, Key Lab Univ Wireless Comm, Beijing, Peoples R China
[2] China Petr Technol & Dev Corp, Beijing, Peoples R China
[3] Beijing Univ Posts & Telecom, State Key Lab Networking & Switching Tech, Beijing, Peoples R China
[4] Carleton Univ, Dept Syst & Comp Eng, Ottawa, ON, Canada
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2019年 / 92卷
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Software-defined networking; Load scheduling; Quality of Service (QoS); Energy internet; Smart grid;
D O I
10.1016/j.future.2018.09.023
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recently, smart grid and Energy Internet (EI) are proposed to solve energy crisis and global warming, where improved communication mechanisms are important. Software-defined networking (SON) has been used in smart grid for real-time monitoring and communicating, which requires steady web environment with no packet loss and less time delay. With the explosion of network scales, the idea of multiple controllers has been proposed, where the problem of load scheduling needs to be solved. However, some traditional load scheduling algorithms have inferior robustness under the complicated environments in smart grid, and inferior time efficiency without pre-strategy, which are hard to meet the requirement of smart grid. Therefore, we present a novel controller mind (CM) framework to implement automatic management among multiple controllers. Specially, in order to solve the problem of complexity and pre-strategy in the system, we propose a novel Quality of Service (QoS) enabled load scheduling algorithm based on reinforcement learning in this paper. Simulation results show the effectiveness of our proposed scheme in the aspects of load variation and time efficiency. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:43 / 51
页数:9
相关论文
共 42 条
  • [1] Industrial Internet of Things Driven by SDN Platform for Smart Grid Resiliency
    Al-Rubaye, Saba
    Kadhum, Ekhlas
    Ni, Qiang
    Anpalagan, Alagan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (01) : 267 - 277
  • [2] [Anonymous], 2013, ACM SIGCOMM computer communication review, DOI DOI 10.1145/2534169.2491193
  • [3] SeLINA: A Self-Learning Insightful Network Analyzer
    Apiletti, Daniele
    Baralis, Elena
    Cerquitelli, Tania
    Garza, Paolo
    Giordano, Danilo
    Mellia, Marco
    Venturini, Luca
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2016, 13 (03): : 696 - 710
  • [4] Big Data Meets Telcos: A Proactive Caching Perspective
    Bastug, Ejder
    Bennis, Mehdi
    Zeydan, Engin
    Kader, Manhal Abdel
    Karatepe, Ilyas Alper
    Er, Ahmet Salih
    Debbah, Merouane
    [J]. JOURNAL OF COMMUNICATIONS AND NETWORKS, 2015, 17 (06) : 549 - 557
  • [5] Berde Pankaj, 2014, P 3 WORKSHOP HOT TOP, P1, DOI 10.1145
  • [6] Canini Marco, 2015, 2015 IEEE Conference on Computer Communications (INFOCOM). Proceedings, P190, DOI 10.1109/INFOCOM.2015.7218382
  • [7] SDN-Enabled Multi-Attribute-Based Secure Communication for Smart Grid in IIoT Environment
    Chaudhary, Rajat
    Aujla, Gagangeet Singh
    Garg, Sahil
    Kumar, Neeraj
    Rodrigues, Joel J. P. C.
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (06) : 2629 - 2640
  • [8] A QoS-Enabled OpenFlow Environment for Scalable Video Streaming
    Civanlar, Seyhan
    Parlakisik, Murat
    Tekalp, A. Murat
    Gorkemli, Burak
    Kaytaz, Bulent
    Onem, Evren
    [J]. 2010 IEEE GLOBECOM WORKSHOPS, 2010, : 351 - 356
  • [9] Queue-Aware Dynamic Clustering and Power Allocation for Network MIMO Systems via Distributed Stochastic Learning
    Cui, Ying
    Huang, Qingqing
    Lau, Vincent K. N.
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (03) : 1229 - 1238
  • [10] Fan B, 2016, IEEE NETWORK, V30, P6, DOI 10.1109/MNET.2016.7389824