Efficient Replay Deep Meta-Reinforcement Learning for Active Fault-Tolerant Control of Solid Oxide Fuel Cell Systems Considering Multivariable Coordination

被引:1
作者
Li, Jiawen [1 ,2 ]
Zhou, Tao [1 ]
机构
[1] Shanghai Univ Elect Power, Sch Elect & Informat Engn, Shanghai 201306, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Dept Elect Engn, Shanghai 200240, Peoples R China
来源
IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION | 2025年 / 11卷 / 01期
基金
中国国家自然科学基金;
关键词
Fault tolerant systems; Fault tolerance; Hydrogen; Voltage control; Fuels; Fuel cells; Temperature control; Prediction algorithms; Heuristic algorithms; Genetic algorithms; Active fault-tolerant integrated control; constraint violations; deep meta-reinforcement learning (DMRL); fuel utilization; solid oxide fuel cell (SOFC); MANAGEMENT;
D O I
10.1109/TTE.2024.3470240
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A data-driven integrated active fault-tolerant control (IAFT) strategy for controlling the solid oxide fuel cell (SOFC) output voltage is proposed, which maintains satisfactory dynamic performance and eliminates constraint violations in the event of system failure. In addition, this article introduces an efficient replay deep meta-deterministic policy gradient (ER-DMDPG) for IAFTs, which combines priority experience replay and meta-learning techniques to improve the robustness and multitask cooperative learning capability of the IAFTs. The algorithm combines the controllers of the fuel reformer and direct current-direct current (dc-dc) converter into a single independent agent, which is trained by a cooperative meta-learner and a base learner to achieve multiobjective optimal active fault-tolerant control (FTC). It is experimentally demonstrated that the proposed method can maintain better dynamic performance and prevent constraint violations of fuel utilization across a wide range of working conditions.
引用
收藏
页码:4803 / 4817
页数:15
相关论文
共 21 条
  • [1] Thermal Management-Oriented Multivariable Robust Control of a kW-Scale Solid Oxide Fuel Cell Stand-Alone System
    Cao, Hongliang
    Li, Xi
    [J]. IEEE TRANSACTIONS ON ENERGY CONVERSION, 2016, 31 (02) : 603 - 612
  • [2] A study of cost-optimized operation of a grid-parallel PEM fuel cell power plant
    El-Sharkh, M. Y.
    Tanrioven, M.
    Rahman, A.
    Alam, M. S.
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2006, 21 (03) : 1104 - 1114
  • [3] High-precision and efficiency diagnosis for polymer electrolyte membrane fuel cell based on physical mechanism and deep learning
    Gong, Zhichao
    Wang, Bowen
    Xing, Yanqiu
    Xu, Yifan
    Qin, Zhengguo
    Chen, Yongqian
    Zhang, Fan
    Gao, Fei
    Li, Bin
    Yin, Yan
    Du, Qing
    Jiao, Kui
    [J]. ETRANSPORTATION, 2023, 18
  • [4] Adaptive optimization strategy of air supply for automotive polymer electrolyte membrane fuel cell in life cycle
    Gong, Zhichao
    Wang, Bowen
    Xu, Yifan
    Ni, Meng
    Gao, Qingchen
    Hou, Zhongjun
    Cai, Jun
    Gu, Xin
    Yuan, Xinjie
    Jiao, Kui
    [J]. APPLIED ENERGY, 2022, 325
  • [5] Thermal stress management of a solid oxide fuel cell using neural network predictive control
    Hajimolana, S. A.
    Tonekabonimoghadam, S. M.
    Hussain, M. A.
    Chakrabarti, M. H.
    Jayakumar, N. S.
    Hashim, M. A.
    [J]. ENERGY, 2013, 62 : 320 - 329
  • [6] Thermal management of an independent steam reformer for a solid oxide fuel cell with constrained generalized predictive control
    Jiang, Jianhua
    Li, Xi
    Deng, Zhonghua
    Yang, Jie
    Zhang, Yisheng
    Li, Jian
    [J]. INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2012, 37 (17) : 12317 - 12331
  • [7] A multi-objective energy coordinative and management policy for solid oxide fuel cell using triune brain large-scale multi-agent deep deterministic policy gradient
    Li, Jiawen
    [J]. APPLIED ENERGY, 2022, 324
  • [8] Optimal adaptive control for solid oxide fuel cell with operating constraints via large-scale deep reinforcement learning
    Li, Jiawen
    Yu, Tao
    [J]. CONTROL ENGINEERING PRACTICE, 2021, 117
  • [9] A novel data-driven controller for solid oxide fuel cell via deep reinforcement learning
    Li, Jiawen
    Yu, Tao
    [J]. JOURNAL OF CLEANER PRODUCTION, 2021, 321
  • [10] A Novel Integral Reinforcement Learning-Based Control Method Assisted by Twin Delayed Deep Deterministic Policy Gradient for Solid Oxide Fuel Cell in DC Microgrid
    Liu, Yulin
    Qie, Tianhao
    Yu, Yang
    Wang, Yuxuan
    Chau, Tat Kei
    Zhang, Xinan
    Manandhar, Ujjal
    Li, Sinan
    Iu, Herbert H. C.
    Fernando, Tyrone
    [J]. IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2023, 14 (01) : 688 - 703