Reinforcement Learning-based Electricity Market Vulnerability Analysis under Cyber-Topology Attack

被引:2
作者
Dey, Arnab [1 ]
Salapaka, Murti V. [1 ]
机构
[1] Univ Minnesota Twin Cities, Dept Elect & Comp Engn, Minneapolis, MN 55455 USA
来源
2023 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE, ISGT | 2023年
关键词
Cyber-security; electricity market; locational marginal price; reinforcement learning; topology attack;
D O I
10.1109/ISGT51731.2023.10066378
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, we propose a reinforcement learning (RL)-based methodology to analyze vulnerability of real-time (RT) electricity market under grid topology attack. In RT electricity market, the electricity prices at different buses in the grid network are decided based on the locational marginal price (LMP). LMP is derived from the solution to DC optimal power flow (DCOPF) which depends on the grid topology, generation cost, and real-time demand. Hence, an attacker can manipulate the topology information to alter the solution to DCOPF leading to alteration of LMPs, thus harnessing monetary profit. Our analysis entails realistic cyber-topology attack, that is, the attacker can only manipulate the breaker status, but not the physical topology, and it has no knowledge of the topology prior to attack. Under such cyber-topology attack, our proposed RL-based methodology identifies the critical breakers in the power network that, if attacked, can lead to large deviation in LMP from the actual value and disrupt the electricity market. We instantiate our proposed technique in IEEE-39 and 300 bus network and establish that the critical branches, identified by our algorithm, are crucial in terms of maintaining the stability of RT market, hence must be protected by the grid operator.
引用
收藏
页数:5
相关论文
共 15 条
[1]  
Cochran J., 2013, Market Evolution: Wholesale Electricity Market Design for 21st Century Power Systems
[2]  
Dayaratne T., 2019, 2019 IEEE PES INNOVA, P1
[3]   Impact of Data Quality on Real-Time Locational Marginal Price [J].
Jia, Liyan ;
Kim, Jinsub ;
Thomas, Robert J. ;
Tong, Lang .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2014, 29 (02) :627-636
[4]   On Topology Attack of a Smart Grid: Undetectable Attacks and Countermeasures [J].
Kim, Jinsub ;
Tong, Lang .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2013, 31 (07) :1294-1305
[5]   A Framework for Cyber-Topology Attacks: Line-Switching and New Attack Scenarios [J].
Liang, Gaoqi ;
Weller, Steven R. ;
Zhao, Junhua ;
Luo, Fengji ;
Dong, Zhao Yang .
IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (02) :1704-1712
[6]   Generalized FDIA-Based Cyber Topology Attack With Application to the Australian Electricity Market Trading Mechanism [J].
Liang, Gaoqi ;
Weller, Steven R. ;
Luo, Fengji ;
Zhao, Junhua ;
Dong, Zhao Yang .
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (04) :3820-3829
[7]   Financially Motivated FDI on SCED in Real-Time Electricity Markets: Attacks and Mitigation [J].
Liu, Chensheng ;
Zhou, Min ;
Wu, Jing ;
Long, Chengnian ;
Kundur, Deepa .
IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (02) :1949-1959
[8]  
Liu HW, 2009, PROCEEDINGS OF THE FIBER SOCIETY 2009 SPRING CONFERENCE, VOLS I AND II, P1
[9]   Data Injection Attacks on Electricity Markets by Limited Adversaries: Worst-Case Robustness [J].
Mengis, Mateo R. ;
Tajer, Ali .
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (06) :5710-5720
[10]  
Pai M. A., 2012, Energy Function Analysis for Power System Stability