Intelligent Multi-Microgrid Energy Management Based on Deep Neural Network and Model-Free Reinforcement Learning

被引:254
作者
Du, Yan [1 ]
Li, Fangxing [1 ]
机构
[1] Univ Tennessee, Dept EECS, Knoxville, TN 37996 USA
关键词
Microgrids; Reinforcement learning; Peak to average power ratio; Mathematical model; Energy management; Computational modeling; Deep neural network (DNN); Monte Carlo method; multi-microgrid; reinforcement learning; peak-to-average ratio (PAR); DEMAND-SIDE MANAGEMENT; POWER;
D O I
10.1109/TSG.2019.2930299
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, an intelligent multi-microgrid (MMG) energy management method is proposed based on deep neural network (DNN) and model-free reinforcement learning (RL) techniques. In the studied problem, multiple microgrids are connected to a main distribution system and they purchase power from the distribution system to maintain local consumption. From the perspective of the distribution system operator (DSO), the target is to decrease the demand-side peak-to-average ratio (PAR), and to maximize the profit from selling energy. To protect user privacy, DSO learns the MMG response by implementing a DNN without direct access to user's information. Further, the DSO selects its retail pricing strategy via a Monte Carlo method from RL, which optimizes the decision based on prediction. The simulation results from the proposed data-driven deep learning method, as well as comparisons with conventional model-based methods, substantiate the effectiveness of the proposed approach in solving power system problems with partial or uncertain information.
引用
收藏
页码:1066 / 1076
页数:11
相关论文
共 33 条
  • [1] [Anonymous], 2015, ARXIV PREPRINT ARXIV
  • [2] [Anonymous], 2016, DEEP LEARNING
  • [3] [Anonymous], IEEE T SMART GRID
  • [4] An Online Learning Algorithm for Demand Response in Smart Grid
    Bahraini, Shahab
    Wong, Vincent W. S.
    Huang, Jianwei
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (05) : 4712 - 4725
  • [5] Guest Editorial Special Section on Industrial and Commercial Demand Response
    Catalao, J. P. S.
    Siano, P.
    Li, F.
    Masoum, M. A. S.
    Aghaei, J.
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (11) : 5017 - 5019
  • [6] Model-Free Renewable Scenario Generation Using Generative Adversarial Networks
    Chen, Yize
    Wang, Yishen
    Kirschen, Daniel
    Zhang, Baosen
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (03) : 3265 - 3275
  • [7] Convolutional Neural Networks for Automatic State-Time Feature Extraction in Reinforcement Learning Applied to Residential Load Control
    Claessens, Bert J.
    Vrancx, Peter
    Ruelens, Frederik
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (04) : 3259 - 3269
  • [8] Residential Energy Consumption Scheduling: A Coupled-Constraint Game Approach
    Deng, Ruilong
    Yang, Zaiyue
    Chen, Jiming
    Asr, Navid Rahbari
    Chow, Mo-Yuen
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2014, 5 (03) : 1340 - 1350
  • [9] Du Y., IEEE T SUSTAINABLE E
  • [10] Achieving 100x Acceleration for N-1 Contingency Screening With Uncertain Scenarios Using Deep Convolutional Neural Network
    Du, Yan
    Li, Fangxing
    Li, Jiang
    Zheng, Tongxin
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2019, 34 (04) : 3303 - 3305