Optimal scheduling of a wind energy dominated distribution network via a deep reinforcement learning approach

被引:16
作者
Zhu, Jiaoyiling [1 ]
Hu, Weihao [1 ]
Xu, Xiao [2 ]
Liu, Haoming [1 ]
Pan, Li [2 ]
Fan, Haoyang [1 ]
Zhang, Zhenyuan [1 ]
Chen, Zhe [3 ]
机构
[1] Univ Elect Sci & Technol China, Coll Mech & Elect Engn, Chengdu, Peoples R China
[2] Sichuan Univ, Coll Elect Engn, Chengdu, Peoples R China
[3] Aalborg Univ, Dept Energy Technol, Aalborg, Denmark
关键词
Deep reinforcement learning; Distribution network; Wind energy; Optimal scheduling; STORAGE; POWER; OPTIMIZATION; MANAGEMENT; DEMAND; SYSTEM; OPERATION; STATION;
D O I
10.1016/j.renene.2022.10.094
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the development of clean energy systems, large-scale renewable energy is being connected to the traditional distribution network, which also brings new challenges to the reliable and economic scheduling of the power grid. To address these challenges, this paper proposes an intelligent scheduling strategy for a wind energy dominated distribution network, which aims to reduce the fluctuation caused by the wind energy. First, the energy scheduling model and objective function of the distribution network system are established and the constraints of various types of components are considered. Then, deep reinforcement learning is introduced to realize real-time decision in distribution network to solve the problem of fluctuation caused by the uncertain wind power output. The energy scheduling method is developed into a Markov decision process based on deep deterministic policy gradient (DDPG) algorithm. Finally, the simulation is verified on the IEEE14 node system. The results verify that the proposed approach can effectively reduce power fluctuations in the distribution network. The superiority of the adopted DDPG algorithm is demonstrated by comparing with the deep Q network algorithm.
引用
收藏
页码:792 / 801
页数:10
相关论文
共 43 条
[1]   Overview on recent developments in energy storage: Mechanical, electrochemical and hydrogen technologies [J].
Amirante, Riccardo ;
Cassone, Egidio ;
Distaso, Elia ;
Tamburrano, Paolo .
ENERGY CONVERSION AND MANAGEMENT, 2017, 132 :372-387
[2]   Multi objective particle swarm optimization of hybrid micro-grid system: A case study in Sweden [J].
Azaza, Maher ;
Wallin, Fredrik .
ENERGY, 2017, 123 :108-118
[3]   Cost-efficient demand-pull policies for multi-purpose technologies - The case of stationary electricity storage [J].
Battke, Benedikt ;
Schmidt, Tobias S. .
APPLIED ENERGY, 2015, 155 :334-348
[4]   Deep Reinforcement Learning Based Approach for Optimal Power Flow of Distribution Networks Embedded with Renewable Energy and Storage Devices [J].
Cao, Di ;
Hu, Weihao ;
Xu, Xiao ;
Wu, Qiuwei ;
Huang, Qi ;
Chen, Zhe ;
Blaabjerg, Frede .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2021, 9 (05) :1101-1110
[5]   Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review [J].
Cao, Di ;
Hu, Weihao ;
Zhao, Junbo ;
Zhang, Guozhou ;
Zhang, Bin ;
Liu, Zhou ;
Chen, Zhe ;
Blaabjerg, Frede .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) :1029-1042
[6]   Deep Reinforcement Learning-Based Energy Storage Arbitrage With Accurate Lithium-Ion Battery Degradation Model [J].
Cao, Jun ;
Harrold, Dan ;
Fan, Zhong ;
Morstyn, Thomas ;
Healey, David ;
Li, Kang .
IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (05) :4513-4521
[7]   An environmentally friendly factory in Egypt based on hybrid photovoltaic/wind/diesel/battery system [J].
Diab, Fahd ;
Lan, Hai ;
Zhang, Lijun ;
Ali, Salwa .
JOURNAL OF CLEANER PRODUCTION, 2016, 112 :3884-3894
[8]   Decentralized Control Algorithm for the Hybrid Energy Storage of Shipboard Power System [J].
Faddel, Samy ;
Saad, Ahmed A. ;
Youssef, Tarek ;
Mohammed, Osama .
IEEE JOURNAL OF EMERGING AND SELECTED TOPICS IN POWER ELECTRONICS, 2020, 8 (01) :720-731
[9]   Reinforcement Learning Approach for Optimal Distributed Energy Management in a Microgrid [J].
Foruzan, Elham ;
Soh, Leen-Kiat ;
Asgarpoor, Sohrab .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (05) :5749-5758
[10]   Deep Reinforcement Learning Based Optimal Schedule for a Battery Swapping Station Considering Uncertainties [J].
Gao, Yuan ;
Yang, Jiajun ;
Yang, Ming ;
Li, Zhengshuo .
IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2020, 56 (05) :5775-5784