Intelligent Multi-Microgrid Energy Management Based on Deep Neural Network and Model-Free Reinforcement Learning

被引:251
|
作者
Du, Yan [1 ]
Li, Fangxing [1 ]
机构
[1] Univ Tennessee, Dept EECS, Knoxville, TN 37996 USA
关键词
Microgrids; Reinforcement learning; Peak to average power ratio; Mathematical model; Energy management; Computational modeling; Deep neural network (DNN); Monte Carlo method; multi-microgrid; reinforcement learning; peak-to-average ratio (PAR); DEMAND-SIDE MANAGEMENT; POWER;
D O I
10.1109/TSG.2019.2930299
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, an intelligent multi-microgrid (MMG) energy management method is proposed based on deep neural network (DNN) and model-free reinforcement learning (RL) techniques. In the studied problem, multiple microgrids are connected to a main distribution system and they purchase power from the distribution system to maintain local consumption. From the perspective of the distribution system operator (DSO), the target is to decrease the demand-side peak-to-average ratio (PAR), and to maximize the profit from selling energy. To protect user privacy, DSO learns the MMG response by implementing a DNN without direct access to user's information. Further, the DSO selects its retail pricing strategy via a Monte Carlo method from RL, which optimizes the decision based on prediction. The simulation results from the proposed data-driven deep learning method, as well as comparisons with conventional model-based methods, substantiate the effectiveness of the proposed approach in solving power system problems with partial or uncertain information.
引用
收藏
页码:1066 / 1076
页数:11
相关论文
共 50 条
  • [21] Optimal Scheduling of Integrated Energy Multi-Microgrid System Based on Hierarchical Constraint Reinforcement Learning
    Dong L.
    Yang Z.
    Qiao J.
    Chen S.
    Wang X.
    Pu T.
    Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2024, 39 (05): : 1436 - 1453
  • [22] Microgrid energy management using deep Q-network reinforcement learning
    Alabdullah, Mohammed H.
    Abido, Mohammad A.
    ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (11) : 9069 - 9078
  • [23] Online Microgrid Energy Management Based on Safe Deep Reinforcement Learning
    Li, Hepeng
    Wang, Zhenhua
    Li, Lusi
    He, Haibo
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [24] A Two-Level Energy Management Strategy for Multi-Microgrid Systems With Interval Prediction and Reinforcement Learning
    Xiong, Luolin
    Tang, Yang
    Mao, Shuai
    Liu, Hangyue
    Meng, Ke
    Dong, Zhaoyang
    Qian, Feng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2022, 69 (04) : 1788 - 1799
  • [25] Intelligent Microgrid Energy Management System Based on Deep Learning Approach
    Khayaty, Mohammad Saeed
    Movludiazar, Amanj
    Fotouhi, Ramin
    Sheikh-El-Eslami, Mohammad Kazem
    2021 11TH SMART GRID CONFERENCE (SGC), 2021, : 285 - 291
  • [26] Towards Real-Time Energy Management of Multi-Microgrid Using a Deep Convolution Neural Network and Cooperative Game Approach
    Samuel, Omaji
    Javaid, Nadeem
    Khalid, Adia
    Khan, Wazir Zada
    Aalsalem, Mohammed Y.
    Afzal, Muhammad Khalil
    Kim, Byung-Seo
    IEEE ACCESS, 2020, 8 : 161377 - 161395
  • [27] Energy Management of a Multi-Agent Based Multi-Microgrid System
    Ren, J. S.
    Tan, K. T.
    Sivaneasan, B.
    So, P. L.
    Gunawan, E.
    2014 IEEE PES ASIA-PACIFIC POWER AND ENERGY ENGINEERING CONFERENCE (IEEE PES APPEEC), 2014,
  • [28] Spiking neural network model of free-energy-based reinforcement learning
    Takashi Nakano
    Makoto Otsuka
    BMC Neuroscience, 12 (Suppl 1)
  • [29] Power management in multi-microgrid system based on energy routers
    Minh-Cong Pham
    Razi, Reza
    Hably, Ahmad
    Bacha, Seddik
    Quoc-Tuan Tran
    Iman-Eini, Hossein
    2020 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2020, : 1178 - 1183
  • [30] Distributed Energy Management for the Multi-Microgrid System Based on ADMM
    Liu, Yun
    Gooi, Hoay Beng
    Xin, Huanhai
    2017 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, 2017,