Intelligent Multi-Microgrid Energy Management Based on Deep Neural Network and Model-Free Reinforcement Learning

被引:251
|
作者
Du, Yan [1 ]
Li, Fangxing [1 ]
机构
[1] Univ Tennessee, Dept EECS, Knoxville, TN 37996 USA
关键词
Microgrids; Reinforcement learning; Peak to average power ratio; Mathematical model; Energy management; Computational modeling; Deep neural network (DNN); Monte Carlo method; multi-microgrid; reinforcement learning; peak-to-average ratio (PAR); DEMAND-SIDE MANAGEMENT; POWER;
D O I
10.1109/TSG.2019.2930299
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, an intelligent multi-microgrid (MMG) energy management method is proposed based on deep neural network (DNN) and model-free reinforcement learning (RL) techniques. In the studied problem, multiple microgrids are connected to a main distribution system and they purchase power from the distribution system to maintain local consumption. From the perspective of the distribution system operator (DSO), the target is to decrease the demand-side peak-to-average ratio (PAR), and to maximize the profit from selling energy. To protect user privacy, DSO learns the MMG response by implementing a DNN without direct access to user's information. Further, the DSO selects its retail pricing strategy via a Monte Carlo method from RL, which optimizes the decision based on prediction. The simulation results from the proposed data-driven deep learning method, as well as comparisons with conventional model-based methods, substantiate the effectiveness of the proposed approach in solving power system problems with partial or uncertain information.
引用
收藏
页码:1066 / 1076
页数:11
相关论文
共 50 条
  • [1] Energy Optimization Management of Multi-microgrid using Deep Reinforcement Learning
    Zhang, Tingjun
    Yue, Dong
    Zhao, Nan
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4049 - 4053
  • [2] Deep Reinforcement Learning-Based Model-Free On-Line Dynamic Multi-Microgrid Formation to Enhance Resilience
    Zhao, Jin
    Li, Fangxing
    Mukherjee, Srijib
    Sticht, Christopher
    IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (04) : 2557 - 2567
  • [3] Frequency regulation of multi-microgrid with shared energy storage based on deep reinforcement learning
    He, Xingtang
    Ge, Shaoyun
    Liu, Hong
    Xu, Zhengyang
    Mi, Yang
    Wang, Chengshan
    ELECTRIC POWER SYSTEMS RESEARCH, 2023, 214
  • [4] Multi-Microgrid Energy Management Strategy Based on Multi-Agent Deep Reinforcement Learning with Prioritized Experience Replay
    Guo, Guodong
    Gong, Yanfeng
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [5] Model-free data-driven approach assisted Deep Reinforcement Learning for Optimal Energy Management in MicroGrid
    Kaewdornhan, Niphon
    Chatthaworn, Rongrit
    ENERGY REPORTS, 2023, 9 : 850 - 858
  • [6] Model-free data-driven approach assisted Deep Reinforcement Learning for Optimal Energy Management in MicroGrid
    Kaewdornhan, Niphon
    Chatthaworn, Rongrit
    ENERGY REPORTS, 2023, 9 : 850 - 858
  • [7] Multi-energy Management of Interconnected Multi-microgrid System Using Multi-agent Deep Reinforcement Learning
    Sichen Li
    Di Cao
    Weihao Hu
    Qi Huang
    Zhe Chen
    Frede Blaabjerg
    JournalofModernPowerSystemsandCleanEnergy, 2023, 11 (05) : 1606 - 1617
  • [8] Multi-energy Management of Interconnected Multi-microgrid System Using Multi-agent Deep Reinforcement Learning
    Li, Sichen
    Cao, Di
    Hu, Weihao
    Huang, Qi
    Chen, Zhe
    Blaabjerg, Frede
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2023, 11 (05) : 1606 - 1617
  • [9] Contingency based energy management of multi-microgrid based distribution network
    Aghdam, Farid Hamzeh
    Salehi, Javad
    Ghaemi, Sina
    SUSTAINABLE CITIES AND SOCIETY, 2018, 41 : 265 - 274
  • [10] Joint Energy and Carbon Trading for Multi-Microgrid System Based on Multi-Agent Deep Reinforcement Learning
    Zhou, Yanting
    Ma, Zhongjing
    Wang, Tianyu
    Zhang, Jinhui
    Shi, Xingyu
    Zou, Suli
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (06) : 7376 - 7388