Microgrid Energy Management Strategy Base on UCB-A3C Learning

被引:7
作者
Yang, Yanhong [1 ]
Li, Haitao [2 ]
Shen, Baochen [2 ]
Pei, Wei [1 ]
Peng, Dajian [1 ]
机构
[1] Chinese Acad Sci, Beijing, Peoples R China
[2] Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
microgrid; energy management; A3C; UCB; edge computing;
D O I
10.3389/fenrg.2022.858895
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The uncertainty of renewable energy and demand response brings many challenges to the microgrid energy management. Driven by the recent advances and applications of deep reinforcement learning a microgrid energy management strategy, i.e., upper confidence bound based advantage actor-critic (A3C), is proposed to utilize a novel action exploration mechanism to learn the power output of wind power generation, the price of electricity trading and power load. The simulation results indicate that the UCB-A3C learning based energy management strategy is better than conventional PPO, actor critical and A3C algorithm.
引用
收藏
页数:8
相关论文
共 19 条
[1]   Machine-Learning-Based Real-Time Economic Dispatch in Islanding Microgrids in a Cloud-Edge Computing Environment [J].
Dong, Wei ;
Yang, Qiang ;
Li, Wei ;
Zomaya, Albert Y. .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (17) :13703-13711
[2]   Optimal Scheduling of Microgrid Based on Deep Deterministic Policy Gradient and Transfer Learning [J].
Fan, Luqin ;
Zhang, Jing ;
He, Yu ;
Liu, Ying ;
Hu, Tao ;
Zhang, Heng .
ENERGIES, 2021, 14 (03)
[3]  
Fingrid Open Datasets, 2018, FINGR OP DAT
[4]  
Guan L., 2020, POWER SYST TECHNOL
[5]   Research on some key problems related to integrated energy systems [J].
Jia, Hongjie ;
Wang, Dan ;
Xu, Xiandong ;
Yu, Xiaodan .
Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2015, 39 (07) :198-207
[6]   Learning based cost optimal energy management model for campus microgrid systems [J].
Kim, Jangkyum ;
Oh, Hyeontaek ;
Choi, Jun Kyun .
APPLIED ENERGY, 2022, 311
[7]  
Lee J., 2020, 2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), P1, DOI DOI 10.1109/SMARTGRIDCOMM47815.2020.9302935
[8]   Federated Reinforcement Learning for Energy Management of Multiple Smart Homes With Distributed Energy Resources [J].
Lee, Sangyoon ;
Choi, Dae-Hyun .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (01) :488-497
[9]   Real-Time Residential Demand Response [J].
Li, Hepeng ;
Wan, Zhiqiang ;
He, Haibo .
IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (05) :4144-4154
[10]   Intelligent Edge Computing for IoT-Based Energy Management in Smart Cities [J].
Liu, Yi ;
Yang, Chao ;
Jiang, Li ;
Xie, Shengli ;
Zhang, Yan .
IEEE NETWORK, 2019, 33 (02) :111-117