Optimizing fuel economy and durability of hybrid fuel cell electric vehicles using deep reinforcement learning-based energy management systems

被引:38
作者
Hu, Haowen [1 ]
Yuan, Wei-Wei [2 ]
Su, Minghang [1 ]
Ou, Kai [1 ]
机构
[1] Fuzhou Univ, Sch Mech Engn & Automat, Fuzhou 350108, Peoples R China
[2] Minjiang Univ, Fujian Prov Key Lab Informat Proc & Intelligent Co, Fuzhou 350108, Peoples R China
关键词
Energy management strategy (EMS); Deep reinforcement learning; Fuel economy; Battery degradation; Fuel cell degradation; Overall cost; STRATEGY; OPTIMIZATION; BATTERY; DEGRADATION;
D O I
10.1016/j.enconman.2023.117288
中图分类号
O414.1 [热力学];
学科分类号
摘要
An effective energy management strategy (EMS) is crucial for the reliable operation of fuel cell hybrid electric vehicles (FCHEVs). This study proposes a power distribution optimization strategy for FCHEVs that leverages deep reinforcement learning (DRL) and Pontryagin's minimum principle (PMP). The DRL algorithm effectively balances fuel economy, battery durability, and fuel cell durability objectives. The degradation mechanisms of battery and fuel cell under extreme working conditions are considered in the PMP optimization. A comprehensive evaluation framework is established with degradation and energy consumption models to serve as a reward for deep reinforcement learning to balance fuel economy and power sources' lifetime. Simulation results show that the proposed EMS framework reduces FC degradation by 18.4% and battery degradation by 71.1% compared to traditional PMP-based EMS under the NEDC driving condition. Hardware-in-the-loop (HIL) testing demonstrates that the proposed EMS framework has the potential for real-time application, with an average relative error between experiment and simulation of approximately 0.0203. This research highlights the significance of the proposed EMS framework in ensuring the reliable operation of FCHEVs with enhanced performance and reduced cost.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Dyna algorithm-based reinforcement learning energy management for fuel cell hybrid engineering vehicles
    Liu, Huiying
    Yao, Yongming
    Li, Tianyu
    Du, Miaomiao
    Wang, Xiao
    Li, Haofa
    Li, Ming
    JOURNAL OF ENERGY STORAGE, 2024, 94
  • [42] Integrated Thermal and Energy Management of Connected Hybrid Electric Vehicles Using Deep Reinforcement Learning
    Zhang, Hao
    Chen, Boli
    Lei, Nuo
    Li, Bingbing
    Li, Rulong
    Wang, Zhi
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (02): : 4594 - 4603
  • [43] Incentive learning-based energy management for hybrid energy storage system in electric vehicles
    Li, Fei
    Gao, Yang
    Wu, Yue
    Xia, Yaoxin
    Wang, Chenglong
    Hu, Jiajian
    Huang, Zhiwu
    ENERGY CONVERSION AND MANAGEMENT, 2023, 293
  • [44] Near-optimal energy management for plug-in hybrid fuel cell and battery propulsion using deep reinforcement learning
    Wu, Peng
    Partridge, Julius
    Anderlini, Enrico
    Liu, Yuanchang
    Bucknall, Richard
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2021, 46 (80) : 40022 - 40040
  • [45] A reinforcement learning-based energy management strategy for fuel cell electric vehicle considering coupled-energy sources degradations
    Huo, Weiwei
    Liu, Teng
    Lu, Bing
    SUSTAINABLE ENERGY GRIDS & NETWORKS, 2024, 40
  • [46] Reinforcement Learning Energy Management for Fuel Cell Hybrid System: A Review
    Li, Qi
    Meng, Xiang
    Gao, Fei
    Zhang, Guorui
    Chen, Weirong
    Rajashekara, Kaushik
    IEEE INDUSTRIAL ELECTRONICS MAGAZINE, 2023, 17 (04) : 45 - 54
  • [47] Fuel Economy Energy Management of Electric Vehicles Using Harris Hawks Optimization
    Rezk, Hegazy
    Abdelkareem, Mohammad Ali
    Alshathri, Samah Ibrahim
    Sayed, Enas Taha
    Ramadan, Mohamad
    Olabi, Abdul Ghani
    SUSTAINABILITY, 2023, 15 (16)
  • [48] Energy management for hybrid electric vehicles based on imitation reinforcement learning
    Liu, Yonggang
    Wu, Yitao
    Wang, Xiangyu
    Li, Liang
    Zhang, Yuanjian
    Chen, Zheng
    ENERGY, 2023, 263
  • [49] Deep reinforcement learning-based energy management system enhancement using digital twin for electric vehicles
    Ye, Yiming
    Xu, Bin
    Wang, Hanchen
    Zhang, Jiangfeng
    Lawler, Benjamin
    Ayalew, Beshah
    ENERGY, 2024, 312
  • [50] Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning framework
    Huang, Ruchen
    He, Hongwen
    Gao, Miaojue
    APPLIED ENERGY, 2023, 346