Scaling Graph Neural Networks for Large-Scale Power Systems Analysis: Empirical Laws for Emergent Abilities

被引:53
作者
Zhu, Yuhong [1 ,2 ]
Zhou, Yongzhi [1 ,2 ]
Yan, Lei [1 ,2 ]
Li, Zuyi [1 ,2 ]
Xin, Huanhai [1 ,2 ]
Wei, Wei [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Polytech Inst, Hangzhou 310027, Peoples R China
基金
国家重点研发计划;
关键词
Power systems; Computational modeling; Task analysis; Training; Data models; Graph neural networks; Analytical models; graph transformers; emergent abilities; large-scale power system analysis; scaling law;
D O I
10.1109/TPWRS.2024.3437651
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The scale-up of AI models for analyzing large-scale power systems necessitates a thorough understanding of their scaling properties. Existing studies on these properties provide only partial insights, showing predictable decreases in loss function with increased model scales; yet no scaling law for power system AI models has been established, resulting in unpredictable performance. This letter introduces and explores the concept of "emergent abilities" in graph neural networks (GNN) used for analyzing large-scale power systems-a phenomenon where model performance improves dramatically once its scale exceeds a threshold. We further introduce an empirical power-law formula to quantify the relationship between this threshold and the power system size. Our theory precisely predicts the threshold for the emergence of these abilities in large-scale power systems, including both a synthetic 10,000-bus and a real-world 19,402-bus system.
引用
收藏
页码:7445 / 7448
页数:4
相关论文
共 11 条
[1]   A Physics-Guided Graph Convolution Neural Network for Optimal Power Flow [J].
Gao, Maosheng ;
Yu, Juan ;
Yang, Zhifang ;
Zhao, Junbo .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (01) :380-390
[2]  
Hestness J, 2017, Arxiv, DOI [arXiv:1712.00409, DOI 10.1038/D41586-024-01137]
[3]  
Hoffmann J., 2022, P ADV NEUR INF PROC, V35, P30030
[4]   A Review of Graph Neural Networks and Their Applications in Power Systems [J].
Liao, Wenlong ;
Bak-Jensen, Birgitte ;
Pillai, Jayakrishnan Radhakrishna ;
Wang, Yuelong ;
Wang, Yusen .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2022, 10 (02) :345-360
[5]   Talking about Large Language Models [J].
Shanahan, Murray .
COMMUNICATIONS OF THE ACM, 2024, 67 (02) :68-79
[6]   Online Static Security Assessment Module Using Artificial Neural Networks [J].
Sunitha, R. ;
Kumar, R. Sreerama ;
Mathew, Abraham T. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2013, 28 (04) :4328-4335
[7]   Automatic tuning of hyperparameters using Bayesian optimization [J].
Victoria, A. Helen ;
Maragatham, G. .
EVOLVING SYSTEMS, 2021, 12 (01) :217-223
[8]  
Wei JS, 2022, Arxiv, DOI [arXiv:2206.07682, 10.48550/arXiv.2206.07682]
[9]   Massively Digitized Power Grid: Opportunities and Challenges of Use-Inspired AI [J].
Xie, Le ;
Zheng, Xiangtian ;
Sun, Yannan ;
Huang, Tong ;
Bruton, Tony .
PROCEEDINGS OF THE IEEE, 2023, 111 (07) :762-787
[10]   On hyperparameter optimization of machine learning algorithms: Theory and practice [J].
Yang, Li ;
Shami, Abdallah .
NEUROCOMPUTING, 2020, 415 :295-316