Longevity-aware energy management for fuel cell hybrid electric bus based on a novel proximal policy optimization deep reinforcement learning framework

被引:45
作者
Huang, Ruchen [1 ,2 ,3 ]
He, Hongwen [1 ,2 ,3 ]
Zhao, Xuyang [1 ,3 ]
Gao, Miaojue [1 ,3 ]
机构
[1] Beijing Inst Technol, Natl Engn Res Ctr Elect Vehicles, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Collaborat Innovat Ctr Elect Vehicles Beijing, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Sch Mech Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Fuel cell hybrid electric bus; Energy management strategy; Deep reinforcement learning; Proximal policy optimization (PPO); Multi-thread distributed computation; GRADIENT METHODS; PREDICTION; LIFETIME; GO;
D O I
10.1016/j.jpowsour.2023.232717
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
With the prosperity of artificial intelligence and new energy vehicles, energy-saving technologies for zero -emission fuel cell hybrid electric vehicles through high-efficient deep reinforcement learning algorithms have become a research focus. This article proposes an energy management strategy based on a novel deep rein-forcement learning framework to reduce the hydrogen consumption of a fuel cell hybrid electric bus while suppressing the degradation of the fuel cell. To begin, a novel proximal policy optimization framework is designed by taking advantage of multi-thread distributed computation, and then a promising energy manage-ment strategy based on this novel framework is proposed. Furthermore, the fuel cell degradation model is established and fuel cell longevity is incorporated into the optimization objective. Finally, the adaptability and computational efficiency of the proposed strategy are verified under the test cycle. Simulation results indicate that the proposed strategy improves the training efficiency effectively, and achieves efficient optimization of hydrogen conservation and fuel cell degradation suppression compared with the strategy based on the proximal policy optimization algorithm. This article contributes to energy conservation and lifespan extension for fuel cell vehicles through deep reinforcement learning methods.
引用
收藏
页数:13
相关论文
共 58 条
  • [1] [Anonymous], 2016, DEEP REINFORCEMENT L
  • [2] [Anonymous], 2019, GB/T 38146.2
  • [3] Bertsekas D.P., 2003, Parallel and Distributed Computation: Numerical Methods
  • [4] Estimation of KL Divergence: Optimal Minimax Rate
    Bu, Yuheng
    Zou, Shaofeng
    Liang, Yingbin
    Veeravalli, Venugopal V.
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (04) : 2648 - 2674
  • [5] Lifetime prediction and the economic lifetime of Proton Exchange Membrane fuel cells
    Chen, Huicui
    Pei, Pucheng
    Song, Mancun
    [J]. APPLIED ENERGY, 2015, 142 : 154 - 163
  • [6] A survey on key techniques and development perspectives of equivalent consumption minimisation strategy for hybrid electric vehicles
    Chen, Z.
    Liu, Y.
    Ye, M.
    Zhang, Y.
    Li, G.
    [J]. RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2021, 151
  • [7] De Asis K, 2018, AAAI CONF ARTIF INTE, P2902
  • [8] Deep reinforcement learning based energy management strategy of fuel cell hybrid railway vehicles considering fuel cell aging
    Deng, Kai
    Liu, Yingxu
    Hai, Di
    Peng, Hujun
    Lowenstein, Lars
    Pischinger, Stefan
    Hameyer, Kay
    [J]. ENERGY CONVERSION AND MANAGEMENT, 2022, 251
  • [9] Battery State-of-Health Perceptive Energy Management for Hybrid Electric Vehicles
    Ebbesen, Soren
    Elbert, Philipp
    Guzzella, Lino
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2012, 61 (07) : 2893 - 2900
  • [10] Fadi I., 2011, COMPUT SCI TELECOMMU, V30