Intelligent Multi-Microgrid Energy Management Based on Deep Neural Network and Model-Free Reinforcement Learning

被引:251
|
作者
Du, Yan [1 ]
Li, Fangxing [1 ]
机构
[1] Univ Tennessee, Dept EECS, Knoxville, TN 37996 USA
关键词
Microgrids; Reinforcement learning; Peak to average power ratio; Mathematical model; Energy management; Computational modeling; Deep neural network (DNN); Monte Carlo method; multi-microgrid; reinforcement learning; peak-to-average ratio (PAR); DEMAND-SIDE MANAGEMENT; POWER;
D O I
10.1109/TSG.2019.2930299
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, an intelligent multi-microgrid (MMG) energy management method is proposed based on deep neural network (DNN) and model-free reinforcement learning (RL) techniques. In the studied problem, multiple microgrids are connected to a main distribution system and they purchase power from the distribution system to maintain local consumption. From the perspective of the distribution system operator (DSO), the target is to decrease the demand-side peak-to-average ratio (PAR), and to maximize the profit from selling energy. To protect user privacy, DSO learns the MMG response by implementing a DNN without direct access to user's information. Further, the DSO selects its retail pricing strategy via a Monte Carlo method from RL, which optimizes the decision based on prediction. The simulation results from the proposed data-driven deep learning method, as well as comparisons with conventional model-based methods, substantiate the effectiveness of the proposed approach in solving power system problems with partial or uncertain information.
引用
收藏
页码:1066 / 1076
页数:11
相关论文
共 50 条
  • [41] Control of neural systems at multiple scales using model-free, deep reinforcement learning
    B. A. Mitchell
    L. R. Petzold
    Scientific Reports, 8
  • [42] Microgrid Energy Management Strategy Based on Hierarchical Federated Deep Reinforcement Learning
    Liu, Yiran
    Li, Haitao
    Xie, Dongxue
    2024 INTERNATIONAL CONFERENCE ON ELECTRONIC ENGINEERING AND INFORMATION SYSTEMS, EEISS 2024, 2024, : 7 - 12
  • [43] Novel Architecture of Energy Management Systems Based on Deep Reinforcement Learning in Microgrid
    Lee, Seongwoo
    Seon, Joonho
    Sun, Young Ghyu
    Kim, Soo Hyun
    Kyeong, Chanuk
    Kim, Dong In
    Kim, Jin Young
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1646 - 1658
  • [44] Intelligent Deep-Q-Network-Based Energy Management for an Isolated Microgrid
    Phan, Bao Chau
    Lee, Meng-Tse
    Lai, Ying-Chih
    APPLIED SCIENCES-BASEL, 2022, 12 (17):
  • [45] Collaborative Optimization of Multi-microgrid System Based on Multi-agent Game and Reinforcement Learning
    Liu, Junfeng
    Wang, Xiaosheng
    Lu, Junbo
    Zeng, Jun
    Dianwang Jishu/Power System Technology, 2022, 46 (07): : 2722 - 2732
  • [46] Deep reinforcement learning for energy management in a microgrid with flexible demand
    Nakabi, Taha Abdelhalim
    Toivanen, Pekka
    SUSTAINABLE ENERGY GRIDS & NETWORKS, 2021, 25
  • [47] Improve the Stability and Robustness of Power Management through Model-free Deep Reinforcement Learning
    Chen, Lin
    Li, Xiao
    Xu, Jiang
    PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 1371 - 1376
  • [48] Hierarchical energy optimization management of active distribution network with multi-microgrid system
    Sun Wenzhi
    Zhang, Huijuan
    Tseng, Ming-Lang
    Zhang Weipeng
    Li Xinyang
    JOURNAL OF INDUSTRIAL AND PRODUCTION ENGINEERING, 2022, 39 (03) : 210 - 229
  • [49] Multi-Microgrid Based Coordinated Consensus Control for Demand Energy Management
    Gamage, Don
    Wanigasekara, Chathura
    Ukil, Abhisek
    Swain, Akshya
    18TH INTERNATIONAL CONFERENCE ON PROBABILISTIC METHODS APPLIED TO POWER SYSTEMS, PMAPS 2024, 2024, : 426 - 431
  • [50] Model-Free Deep Inverse Reinforcement Learning by Logistic Regression
    Eiji Uchibe
    Neural Processing Letters, 2018, 47 : 891 - 905