Optimal control strategy for solid oxide fuel cell-based hybrid energy system using deep reinforcement learning

被引:9
作者
Chen, Tao [1 ]
Gao, Ciwei [1 ]
Song, Yutong [1 ]
机构
[1] Southeast Univ, Sch Elect Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1049/rpg2.12391
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This paper proposes a self-adaptive control strategy for solid oxide fuel cell (SOFC) based hybrid energy system using deep reinforcement learning (DRL) techniques. Highly efficient use of hydrogen in a hybrid energy system with the aid of SOFC could create a new paradigm of renewable energy ecosystem and a series of operation principles. Instead of modeling the energy system operation decision-making process as an optimization problem, a DRL framework is used to seek the optimal control strategy with consideration of various physical constraints in the SOFC components and hybrid energy system operation. Specifically, a deep deterministic policy gradient (DDPG) algorithm is used to solve the operation problem and provide the optimal policy guiding the control actions of a tubular SOFC stack, which involves various dynamic characteristics besides the electric measurement. The learnt control strategy may not produce the best result every time, but can guarantee the ultimate benefit in a non-deterministic way in the long-term operation.
引用
收藏
页码:912 / 921
页数:10
相关论文
共 32 条
  • [1] Hydrogen energy, economy and storage: Review and recommendation
    Abe, J. O.
    Popoola, A. P. I.
    Ajenifuja, E.
    Popoola, O. M.
    [J]. INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2019, 44 (29) : 15072 - 15086
  • [2] Anode-supported intermediate temperature direct internal reforming solid oxide fuel cell. I: model-based steady-state performance
    Aguiar, P
    Adjiman, CS
    Brandon, NP
    [J]. JOURNAL OF POWER SOURCES, 2004, 138 (1-2) : 120 - 136
  • [3] Control of battery charging based on reinforcement learning and long short-term memory networks
    Chang, Fangyuan
    Chen, Tao
    Su, Wencong
    Alsafasfeh, Qais
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2020, 85
  • [4] A generalized additive model-based data-driven solution for lithium-ion battery capacity prediction and local effects analysis
    Chen, Tao
    Gao, Ciwei
    Hui, Hongxun
    Cui, Qiushi
    Long, Huan
    [J]. TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2021,
  • [5] Battery Electrode Mass Loading Prognostics and Analysis for Lithium-Ion Battery-Based Energy Storage Systems
    Chen, Tao
    Song, Meng
    Hui, Hongxun
    Long, Huan
    [J]. FRONTIERS IN ENERGY RESEARCH, 2021, 9 (09):
  • [6] Optimal demand response strategy of commercial building-based virtual power plant using reinforcement learning
    Chen, Tao
    Cui, Qiushi
    Gao, Ciwei
    Hu, Qinran
    Lai, Kexing
    Yang, Jianlin
    Lyu, Ran
    Zhang, Hao
    Zhang, Jinyuan
    [J]. IET GENERATION TRANSMISSION & DISTRIBUTION, 2021, 15 (16) : 2309 - 2318
  • [7] Indirect Customer-to-Customer Energy Trading With Reinforcement Learning
    Chen, Tao
    Su, Wencong
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (04) : 4338 - 4348
  • [8] Local Energy Trending Behavior Modeling With Deep Reinforcement Learning
    Chen, Tao
    Su, Wencong
    [J]. IEEE ACCESS, 2018, 6 : 62806 - 62814
  • [9] Convolutional Neural Networks for Automatic State-Time Feature Extraction in Reinforcement Learning Applied to Residential Load Control
    Claessens, Bert J.
    Vrancx, Peter
    Ruelens, Frederik
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (04) : 3259 - 3269
  • [10] An environment-adaptive protection scheme with long-term reward for distribution networks
    Cui, Qiushi
    Weng, Yang
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2021, 124