Intelligent Multi-Microgrid Energy Management Based on Deep Neural Network and Model-Free Reinforcement Learning

被引:281
作者
Du, Yan [1 ]
Li, Fangxing [1 ]
机构
[1] Univ Tennessee, Dept EECS, Knoxville, TN 37996 USA
关键词
Microgrids; Reinforcement learning; Peak to average power ratio; Mathematical model; Energy management; Computational modeling; Deep neural network (DNN); Monte Carlo method; multi-microgrid; reinforcement learning; peak-to-average ratio (PAR); DEMAND-SIDE MANAGEMENT; POWER;
D O I
10.1109/TSG.2019.2930299
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, an intelligent multi-microgrid (MMG) energy management method is proposed based on deep neural network (DNN) and model-free reinforcement learning (RL) techniques. In the studied problem, multiple microgrids are connected to a main distribution system and they purchase power from the distribution system to maintain local consumption. From the perspective of the distribution system operator (DSO), the target is to decrease the demand-side peak-to-average ratio (PAR), and to maximize the profit from selling energy. To protect user privacy, DSO learns the MMG response by implementing a DNN without direct access to user's information. Further, the DSO selects its retail pricing strategy via a Monte Carlo method from RL, which optimizes the decision based on prediction. The simulation results from the proposed data-driven deep learning method, as well as comparisons with conventional model-based methods, substantiate the effectiveness of the proposed approach in solving power system problems with partial or uncertain information.
引用
收藏
页码:1066 / 1076
页数:11
相关论文
共 32 条
[1]  
[Anonymous], ICML
[2]  
[Anonymous], 2016, DEEP LEARNING
[3]  
[Anonymous], IEEE Transactions on Smart Grid
[4]  
[Anonymous], 2018, REINFORCEMENT LEARNI
[5]  
[Anonymous], IEEE T SUSTAINABLE E
[6]   An Online Learning Algorithm for Demand Response in Smart Grid [J].
Bahraini, Shahab ;
Wong, Vincent W. S. ;
Huang, Jianwei .
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (05) :4712-4725
[7]   Guest Editorial Special Section on Industrial and Commercial Demand Response [J].
Catalao, J. P. S. ;
Siano, P. ;
Li, F. ;
Masoum, M. A. S. ;
Aghaei, J. .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (11) :5017-5019
[8]   Model-Free Renewable Scenario Generation Using Generative Adversarial Networks [J].
Chen, Yize ;
Wang, Yishen ;
Kirschen, Daniel ;
Zhang, Baosen .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (03) :3265-3275
[9]   Convolutional Neural Networks for Automatic State-Time Feature Extraction in Reinforcement Learning Applied to Residential Load Control [J].
Claessens, Bert J. ;
Vrancx, Peter ;
Ruelens, Frederik .
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (04) :3259-3269
[10]   Residential Energy Consumption Scheduling: A Coupled-Constraint Game Approach [J].
Deng, Ruilong ;
Yang, Zaiyue ;
Chen, Jiming ;
Asr, Navid Rahbari ;
Chow, Mo-Yuen .
IEEE TRANSACTIONS ON SMART GRID, 2014, 5 (03) :1340-1350