Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning

被引:131
作者
Tang, Xiaolin [1 ]
Zhou, Haitao [1 ]
Wang, Feng [2 ]
Wang, Weida [3 ]
Lin, Xianke [4 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Inst Energy Econ, Sch Econ & Business Adm, Chongqing 400044, Peoples R China
[3] Beijing Inst Technol, Sch Mech Engn, Beijing 100081, Peoples R China
[4] Ontario Tech Univ, Dept Automot Mech & Mfg Engn, Oshawa, ON L1G 0C5, Canada
基金
中国国家自然科学基金;
关键词
Energy management strategy; Deep reinforcement learning; Fuel cell hybrid electric vehicles; DQN algorithm; Prioritized experience replay; Degradation; POWER MANAGEMENT; OPTIMIZATION; ALGORITHM; LIFETIME; DESIGN;
D O I
10.1016/j.energy.2021.121593
中图分类号
O414.1 [热力学];
学科分类号
摘要
Deep reinforcement learning-based energy management strategy play an essential role in improving fuel economy and extending fuel cell lifetime for fuel cell hybrid electric vehicles. In this work, the traditional Deep Q-Network is compared with the Deep Q-Network with prioritized experience replay. Furthermore, the Deep Q-Network with prioritized experience replay is designed for energy management strategy to minimize hydrogen consumption and compared with the dynamic programming. Moreover, the fuel cell system degradation is incorporated into the objective function, and a balance between fuel economy and fuel cell system degradation is achieved by adjusting the degradation weight and the hydrogen consumption weight. Finally, the combined driving cycle is selected to further verify the effectiveness of the proposed strategy in unfamiliar driving environments and untrained situations. The training results under UDDS show that the fuel economy of the EMS decreases by 0.53 % when fuel cell system degradation is considered, reaching 88.73 % of the DP-based EMS in the UDDS, and the degradation of fuel cell system is effectively suppressed. At the same time, the computational efficiency is improved by more than 70 % compared to the DP-based strategy. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:14
相关论文
共 46 条
[1]   Pathways to electric mobility integration in the Italian automotive sector [J].
Alla, Sara Abd ;
Bianco, Vincenzo ;
Tagliafico, Luca A. ;
Scarpa, Federico .
ENERGY, 2021, 221
[2]   Comprehensive investigation on hydrogen and fuel cell technology in the aviation and aerospace sectors [J].
Baroutaji, Ahmad ;
Wilberforce, Tabbi ;
Ramadan, Mohamad ;
Olabi, Abdul Ghani .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2019, 106 :31-40
[3]   Real-time strategies to optimize the fueling of the fuel cell hybrid power source: A review of issues, challenges and a new approach [J].
Bizon, Nicu ;
Thounthong, Phatiphat .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2018, 91 :1089-1102
[4]   Lifetime prediction and the economic lifetime of Proton Exchange Membrane fuel cells [J].
Chen, Huicui ;
Pei, Pucheng ;
Song, Mancun .
APPLIED ENERGY, 2015, 142 :154-163
[5]   Fuel cell hybrid electric vehicles: A review on power conditioning units and topologies [J].
Das, Himadry Shekhar ;
Tan, Chee Wei ;
Yatim, A. H. M. .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2017, 76 :268-291
[6]   Dynamical Hyperparameter Optimization via Deep Reinforcement Learning in Tracking [J].
Dong, Xingping ;
Shen, Jianbing ;
Wang, Wenguan ;
Shao, Ling ;
Ling, Haibin ;
Porikli, Fatih .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1515-1529
[7]   Deep reinforcement learning based energy management for a hybrid electric vehicle [J].
Du, Guodong ;
Zou, Yuan ;
Zhang, Xudong ;
Liu, Teng ;
Wu, Jinlong ;
He, Dingbo .
ENERGY, 2020, 201 (201)
[8]   An Energy Management Strategy to concurrently optimise fuel consumption & PEM fuel cell lifetime in a hybrid vehicle [J].
Fletcher, Toni ;
Thring, Rob ;
Watkinson, Martin .
INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2016, 41 (46) :21503-21515
[9]  
Gao ZM, 2020, 2020 5TH IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (IEEE ICBDA 2020), P268, DOI 10.1109/ICBDA49040.2020.9101333
[10]   Powertrain Design and Control in Electrified Vehicles: A Critical Review [J].
Hu, Xiaosong ;
Han, Jie ;
Tang, Xiaolin ;
Lin, Xianke .
IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2021, 7 (03) :1990-2009