DRL based low carbon economic dispatch by considering power transmission safety limitations in internet of energy

被引:4
作者
Zhu, Renjie [1 ]
Guan, Xin [1 ]
Zheng, Jun [2 ]
Wang, Ning [3 ]
Jiang, Haiyang [3 ]
Cui, Chen [1 ]
Ohtsuki, Tomoaki [4 ]
机构
[1] Heilongjiang Univ, Sch Data Sci & Technol, Harbin 150080, Peoples R China
[2] State Grid Heilongjiang Elect Power Co Ltd, Elect Power Res Inst, Harbin 150080, Peoples R China
[3] State Grid Heilongjiang Elect Power Co Ltd, Harbin 150080, Peoples R China
[4] Keio Univ, Dept Informat & Comp Sci, Yokohama 2238522, Japan
关键词
Low-carbon economic dispatch; Transmission safety; Markov decision process; Deep reinforcement learning; ELECTRICITY; SYSTEMS; CHINA;
D O I
10.1016/j.iot.2023.100979
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Economic dispatch, as a crucial method for ensuring the normal operation of power systems, is typically modeled as an optimization problem and solved using solvers. The introduction of low-carbon requirements has increased the complexity of the optimization problem, as economic dispatch now needs to consider effectively reducing the emission of CO2. The utilization of renewable energy can mitigate carbon emissions during power system operation, but its inherent uncertainty poses safety risks to transmission lines between microgrids and the main grid. Hence, this paper explores the issue of low-carbon economic dispatch to ensure the reliability of power transmission. We introduce a two-stage low-carbon economic dispatch model grounded in deep reinforcement learning. In the first stage, we incorporate the transmission power limits between microgrids and the main grid as constraints, generate day-ahead dispatch strategies, and determine the weights of factors in the reward function. In the second stage, we employ two methods: adjusting the weight of the penalty for exceeding the transmission limits and adding conservative safety limit constraints, to solve the problem of transmission power exceeding limits caused by uncertainties of renewable energy and prediction errors. Three deep reinforcement learning algorithms, all rooted in the Actor-Critic structure, are employed to implement the two-stage economic dispatch model. Experimental results affirm the efficacy of the proposed model in mitigating the risk of transmission power exceeding its limit, reducing carbon emissions, and minimizing operational costs.
引用
收藏
页数:17
相关论文
共 43 条
[1]   The role of frequency regulation remuneration schemes in an energy matrix with high penetration of renewable energy [J].
Agostini, Claudio A. ;
Armijo, Franco A. ;
Silva, Carlos ;
Nasirov, Shahriyar .
RENEWABLE ENERGY, 2021, 171 (171) :1097-1114
[2]   Economic-Emission Dispatch Problem in Power Systems With Carbon Capture Power Plants [J].
Akbari-Dibavar, Alireza ;
Mohammadi-ivatloo, Behnam ;
Zare, Kazem ;
Khalili, Tohid ;
Bidram, Ali .
IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2021, 57 (04) :3341-3351
[3]   A Private and Efficient Mechanism for Data Uploading in Smart Cyber-Physical Systems [J].
Cai, Zhipeng ;
Zheng, Xu .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (02) :766-775
[4]   The mutual benefits of renewables and carbon capture: Achieved by an artificial intelligent scheduling strategy [J].
Chen, Xianhao ;
Wu, Xiao ;
Lee, Kwang Y. .
ENERGY CONVERSION AND MANAGEMENT, 2021, 233
[5]   Integrated Carbon-Capture-Based Low-Carbon Economic Dispatch of Power Systems Based on EEMD-LSTM-SVR Wind Power Forecasting [J].
Ding, Can ;
Zhou, Yiyuan ;
Ding, Qingchang ;
Li, Kaiming .
ENERGIES, 2022, 15 (05)
[6]   Performance and energy optimization of building automation and management systems: Towards smart sustainable carbon-neutral sports facilities [J].
Elnour, Mariam ;
Fadli, Fodil ;
Himeur, Yassine ;
Petri, Ioan ;
Rezgui, Yacine ;
Meskin, Nader ;
Ahmad, Ahmad M. .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2022, 162
[7]   Deep Reinforcement Learning for Scenario-Based Robust Economic Dispatch Strategy in Internet of Energy [J].
Fang, Dawei ;
Guan, Xin ;
Hu, Benran ;
Peng, Yu ;
Chen, Min ;
Hwang, Kai .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (12) :9654-9663
[8]   The distributed economic dispatch of smart grid based on deep reinforcement learning [J].
Fu, Yang ;
Guo, Xiaoyan ;
Mi, Yang ;
Yuan, Minghan ;
Ge, Xiaolin ;
Su, Xiangjing ;
Li, Zhenkun .
IET GENERATION TRANSMISSION & DISTRIBUTION, 2021, 15 (18) :2645-2658
[9]  
Fujimoto S, 2018, PR MACH LEARN RES, V80
[10]   Low carbon dispatch of electricity-gas-thermal-storage integrated energy system based on stepped carbon trading [J].
Guo, Rui ;
Ye, Hanwen ;
Zhao, Yan .
ENERGY REPORTS, 2022, 8 :449-455