Small modular reactor reinforcement learning framework: Automating reactor core startup

被引:0
作者
Bae, Seong Jun [1 ]
Son, Hong Hyun [1 ]
Lee, Yongjae [1 ]
Yang, Jongin [2 ]
机构
[1] Korea Atom Energy Res Inst, Daejeon 34057, South Korea
[2] Kumoh Natl Inst Technol, 61 Daehak Ro, Gumi Si 39177, Gyeongsangbuk D, South Korea
基金
新加坡国家研究基金会;
关键词
Reinforcement learning; SMR simulation; Reactor core startup; INSTABILITY; FLOW;
D O I
10.1016/j.net.2024.10.009
中图分类号
TL [原子能技术]; O571 [原子核物理学];
学科分类号
0827 ; 082701 ;
摘要
A small modular reactor (SMR) has been considered a potential alternative for achieving carbon neutrality, and therefore, an increasing number of countries are performing extensive research and development. However, this is still in the development stage, and there are several technological or economical challenges that need to be overcome. Minimizing manual operations may be considered a wise approach to reduce the number of operators. Reactor core startup, which is a manual operation, is considered as an example. A method to automate the reactor core startup via the reinforcement learning (RL) algorithm is proposed in this paper. Further, an efficient SMR dynamic simulation model that performs simulations considering the action of the RL agent to achieve states and reward is developed. The suggested SMR dynamic simulation model is validated by the data available in the existing literature. The proposed method can perform automatic reactor core startup. The proposed framework that incorporates the SMR simulator to the RL algorithm is expected to be applied to various cases for reducing manual operations and contributing to realizing a higher level of SMR automation.
引用
收藏
页数:15
相关论文
共 37 条
[11]   Deep reinforcement learning optimal control strategy for temperature setpoint real-time reset in multi-zone building HVAC system [J].
Fang, Xi ;
Gong, Guangcai ;
Li, Guannan ;
Chun, Liang ;
Peng, Pei ;
Li, Wenqiang ;
Shi, Xing ;
Chen, Xiang .
APPLIED THERMAL ENGINEERING, 2022, 212
[12]   Centralized Cooperation for Connected and Automated Vehicles at Intersections by Proximal Policy Optimization [J].
Guan, Yang ;
Ren, Yangang ;
Li, Shengbo Eben ;
Sun, Qi ;
Luo, Laiquan ;
Li, Keqiang .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) :12597-12608
[13]   NUMERICAL STANDARDS FOR FLOW-BOILING ANALYSIS [J].
HANCOX, WT ;
BANERJEE, S .
NUCLEAR SCIENCE AND ENGINEERING, 1977, 64 (01) :106-123
[14]   Considerations on the potential use of Nuclear Small Modular Reactor (SMR) technology for merchant marine propulsion [J].
Hirdaris, S. E. ;
Cheng, Y. F. ;
Shallcross, P. ;
Bonafoux, J. ;
Carlson, D. ;
Prince, B. ;
Sarris, G. A. .
OCEAN ENGINEERING, 2014, 79 :101-130
[15]   Strategy to coordinate actions through a plant parameter prediction model during startup operation of a nuclear power plant [J].
Kim, Jae Min ;
Bae, Junyong ;
Lee, Seung Jun .
NUCLEAR ENGINEERING AND TECHNOLOGY, 2023, 55 (03) :839-849
[16]   The influence of tube and membrane structure on dynamic instability in furnace wall tubes of a fossil fired once-through boiler in a simulated furnace environment [J].
Kim, Jinil ;
Choi, Sangmin .
JOURNAL OF MECHANICAL SCIENCE AND TECHNOLOGY, 2013, 27 (11) :3553-3560
[17]   Comparison of Deep Reinforcement Learning and PID Controllers for Automatic Cold Shutdown Operation [J].
Lee, Daeil ;
Koo, Seoryong ;
Jang, Inseok ;
Kim, Jonghyun .
ENERGIES, 2022, 15 (08)
[18]   Algorithm for Autonomous Power-Increase Operation Using Deep Reinforcement Learning and a Rule-Based System [J].
Lee, Daeil ;
Arigi, Awwal Mohammed ;
Kim, Jonghyun .
IEEE ACCESS, 2020, 8 :196727-196746
[19]  
Lemmon Eric W., 2002, NIST standard reference database 23
[20]   A New Measurement Model for Main Steam Flow of Power plants [J].
Liu, Jizhen ;
Yan, Shu ;
Zeng, Deliang .
2011 2ND INTERNATIONAL CONFERENCE ON CHALLENGES IN ENVIRONMENTAL SCIENCE AND COMPUTER ENGINEERING (CESCE 2011), VOL 11, PT A, 2011, 11 :18-24