Energy management strategy;
Deep reinforcement learning;
Fuel cell hybrid electric vehicles;
DQN algorithm;
Prioritized experience replay;
Degradation;
POWER MANAGEMENT;
OPTIMIZATION;
ALGORITHM;
LIFETIME;
DESIGN;
D O I:
10.1016/j.energy.2021.121593
中图分类号:
O414.1 [热力学];
学科分类号:
摘要:
Deep reinforcement learning-based energy management strategy play an essential role in improving fuel economy and extending fuel cell lifetime for fuel cell hybrid electric vehicles. In this work, the traditional Deep Q-Network is compared with the Deep Q-Network with prioritized experience replay. Furthermore, the Deep Q-Network with prioritized experience replay is designed for energy management strategy to minimize hydrogen consumption and compared with the dynamic programming. Moreover, the fuel cell system degradation is incorporated into the objective function, and a balance between fuel economy and fuel cell system degradation is achieved by adjusting the degradation weight and the hydrogen consumption weight. Finally, the combined driving cycle is selected to further verify the effectiveness of the proposed strategy in unfamiliar driving environments and untrained situations. The training results under UDDS show that the fuel economy of the EMS decreases by 0.53 % when fuel cell system degradation is considered, reaching 88.73 % of the DP-based EMS in the UDDS, and the degradation of fuel cell system is effectively suppressed. At the same time, the computational efficiency is improved by more than 70 % compared to the DP-based strategy. (c) 2021 Elsevier Ltd. All rights reserved.
机构:
Univ Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, ItalyUniv Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, Italy
Alla, Sara Abd
;
Bianco, Vincenzo
论文数: 0引用数: 0
h-index: 0
机构:
Univ Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, ItalyUniv Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, Italy
Bianco, Vincenzo
;
Tagliafico, Luca A.
论文数: 0引用数: 0
h-index: 0
机构:
Univ Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, ItalyUniv Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, Italy
Tagliafico, Luca A.
;
Scarpa, Federico
论文数: 0引用数: 0
h-index: 0
机构:
Univ Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, ItalyUniv Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, Italy
机构:
Univ Wolverhampton, Sch Engn, Fac Sci & Engn, Telford, Shrops, EnglandUniv Wolverhampton, Sch Engn, Fac Sci & Engn, Telford, Shrops, England
Baroutaji, Ahmad
;
Wilberforce, Tabbi
论文数: 0引用数: 0
h-index: 0
机构:
Univ West Scotland, Inst Engn & Energy Technol, Paisley, Renfrew, ScotlandUniv Wolverhampton, Sch Engn, Fac Sci & Engn, Telford, Shrops, England
Wilberforce, Tabbi
;
论文数: 引用数:
h-index:
机构:
Ramadan, Mohamad
;
Olabi, Abdul Ghani
论文数: 0引用数: 0
h-index: 0
机构:
Univ Sharjah, Sustainable & Renewable Energy Engn Dept, POB 27272, Sharjah, U Arab Emirates
Aston Univ, Sch Engn & Appl Sci, Birmingham B4 7ET, W Midlands, EnglandUniv Wolverhampton, Sch Engn, Fac Sci & Engn, Telford, Shrops, England
机构:
Univ Pitesti, Fac Elect Commun & Comp Sci, 1 Targu Din Vale, Arges 110040, Pitesti, Romania
Univ Politehn Bucuresti, Doctoral Sch, Bucharest, RomaniaUniv Pitesti, Fac Elect Commun & Comp Sci, 1 Targu Din Vale, Arges 110040, Pitesti, Romania
Bizon, Nicu
;
Thounthong, Phatiphat
论文数: 0引用数: 0
h-index: 0
机构:
King Mongkuts Univ Technol North Bangkok, Sci & Technol Res Inst, Bangkok, ThailandUniv Pitesti, Fac Elect Commun & Comp Sci, 1 Targu Din Vale, Arges 110040, Pitesti, Romania
机构:
Univ Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, MalaysiaUniv Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, Malaysia
Das, Himadry Shekhar
;
Tan, Chee Wei
论文数: 0引用数: 0
h-index: 0
机构:
Univ Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, MalaysiaUniv Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, Malaysia
Tan, Chee Wei
;
Yatim, A. H. M.
论文数: 0引用数: 0
h-index: 0
机构:
Univ Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, MalaysiaUniv Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, Malaysia
机构:
Incept Inst Artificial Intelligence, Abu Dhabi, U Arab EmiratesBeijing Inst Technol, Sch Comp Sci, Beijing Lab Intelligent Informat Technol, Beijing 100081, Peoples R China
Shao, Ling
;
Ling, Haibin
论文数: 0引用数: 0
h-index: 0
机构:
SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USABeijing Inst Technol, Sch Comp Sci, Beijing Lab Intelligent Informat Technol, Beijing 100081, Peoples R China
机构:
Univ Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, ItalyUniv Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, Italy
Alla, Sara Abd
;
Bianco, Vincenzo
论文数: 0引用数: 0
h-index: 0
机构:
Univ Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, ItalyUniv Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, Italy
Bianco, Vincenzo
;
Tagliafico, Luca A.
论文数: 0引用数: 0
h-index: 0
机构:
Univ Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, ItalyUniv Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, Italy
Tagliafico, Luca A.
;
Scarpa, Federico
论文数: 0引用数: 0
h-index: 0
机构:
Univ Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, ItalyUniv Genoa DIME TEC, Div Thermal Energy & Environm Conditioning, Via AllOpera Pia 15-A, I-16145 Genoa, Italy
机构:
Univ Wolverhampton, Sch Engn, Fac Sci & Engn, Telford, Shrops, EnglandUniv Wolverhampton, Sch Engn, Fac Sci & Engn, Telford, Shrops, England
Baroutaji, Ahmad
;
Wilberforce, Tabbi
论文数: 0引用数: 0
h-index: 0
机构:
Univ West Scotland, Inst Engn & Energy Technol, Paisley, Renfrew, ScotlandUniv Wolverhampton, Sch Engn, Fac Sci & Engn, Telford, Shrops, England
Wilberforce, Tabbi
;
论文数: 引用数:
h-index:
机构:
Ramadan, Mohamad
;
Olabi, Abdul Ghani
论文数: 0引用数: 0
h-index: 0
机构:
Univ Sharjah, Sustainable & Renewable Energy Engn Dept, POB 27272, Sharjah, U Arab Emirates
Aston Univ, Sch Engn & Appl Sci, Birmingham B4 7ET, W Midlands, EnglandUniv Wolverhampton, Sch Engn, Fac Sci & Engn, Telford, Shrops, England
机构:
Univ Pitesti, Fac Elect Commun & Comp Sci, 1 Targu Din Vale, Arges 110040, Pitesti, Romania
Univ Politehn Bucuresti, Doctoral Sch, Bucharest, RomaniaUniv Pitesti, Fac Elect Commun & Comp Sci, 1 Targu Din Vale, Arges 110040, Pitesti, Romania
Bizon, Nicu
;
Thounthong, Phatiphat
论文数: 0引用数: 0
h-index: 0
机构:
King Mongkuts Univ Technol North Bangkok, Sci & Technol Res Inst, Bangkok, ThailandUniv Pitesti, Fac Elect Commun & Comp Sci, 1 Targu Din Vale, Arges 110040, Pitesti, Romania
机构:
Univ Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, MalaysiaUniv Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, Malaysia
Das, Himadry Shekhar
;
Tan, Chee Wei
论文数: 0引用数: 0
h-index: 0
机构:
Univ Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, MalaysiaUniv Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, Malaysia
Tan, Chee Wei
;
Yatim, A. H. M.
论文数: 0引用数: 0
h-index: 0
机构:
Univ Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, MalaysiaUniv Teknol Malaysia, Dept Elect Power Engn, Fac Elect Engn, Johor Baharu 81310, Malaysia
机构:
Incept Inst Artificial Intelligence, Abu Dhabi, U Arab EmiratesBeijing Inst Technol, Sch Comp Sci, Beijing Lab Intelligent Informat Technol, Beijing 100081, Peoples R China
Shao, Ling
;
Ling, Haibin
论文数: 0引用数: 0
h-index: 0
机构:
SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USABeijing Inst Technol, Sch Comp Sci, Beijing Lab Intelligent Informat Technol, Beijing 100081, Peoples R China