Data-driven transferred energy management strategy for hybrid electric vehicles via deep reinforcement learning

被引:9
作者
Chen, Hao [1 ,2 ]
Guo, Gang [1 ]
Tang, Bangbei [3 ]
Hu, Guo [2 ]
Tang, Xiaolin [1 ]
Liu, Teng [1 ]
机构
[1] Chongqing Univ, Dept Automot Engn, Chongqing 400044, Peoples R China
[2] Chongqing Normal Univ, Dept Prod Design, Chongqing 401331, Peoples R China
[3] Chongqing Univ Arts & Sci, Sch Intelligent Mfg Engn, Chongqing 402160, Peoples R China
关键词
Transfer learning; Deep reinforcement learning; Proximal policy optimization; Energy management; Hybrid electric vehicle; Real-world driving cycles;
D O I
10.1016/j.egyr.2023.09.087
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Real-time applications of energy management strategies (EMSs) in hybrid electric vehicles (HEVs) are the harshest requirements for researchers and engineers. Inspired by the excellent problemsolving capabilities of deep reinforcement learning (DRL), this paper proposes a real-time EMS via incorporating the DRL method and transfer learning (TL). The related EMSs are derived from and evaluated on the real-world collected driving cycle dataset from Transportation Secure Data Center (TSDC). The concrete DRL algorithm is proximal policy optimization (PPO) belonging to the policy gradient (PG) techniques. For specification, many source driving cycles are utilized for training the parameters of deep networks based on PPO. The learned parameters are transformed into the target driving cycles under the TL framework. The EMSs related to the target driving cycles are estimated and compared in different training conditions. Simulation results indicate that the presented transfer DRL-based EMS could effectively reduce the time consumption and guarantee the control performance. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2680 / 2692
页数:13
相关论文
共 42 条
[1]  
Andre M., 1995, 950926 SAE, P193, DOI [10.4271/950926, DOI 10.4271/950926]
[2]   A Rule-Based Energy Management Strategy for Plug-in Hybrid Electric Vehicle (PHEV) [J].
Banvait, Harpreetsingh ;
Anwar, Sohel ;
Chen, Yaobin .
2009 AMERICAN CONTROL CONFERENCE, VOLS 1-9, 2009, :3938-3943
[3]   Multi-Objective Energy Management Strategy Based on PSO Optimization for Power-Split Hybrid Electric Vehicles [J].
Du, Aimin ;
Chen, Yaoyi ;
Zhang, Dongxu ;
Han, Yeyang .
ENERGIES, 2021, 14 (09)
[4]   A hybrid deep transfer learning strategy for short term cross-building energy prediction [J].
Fang, Xi ;
Gong, Guangcai ;
Li, Guannan ;
Chun, Liang ;
Li, Wenqiang ;
Peng, Pei .
ENERGY, 2021, 215
[5]   Archiving data from new survey technologies: enabling research with high-precision data while preserving participant privacy [J].
Gonder, Jeffrey ;
Burton, Evan ;
Murakami, Elaine .
TRANSPORT SURVEY METHODS: EMBRACING BEHAVIOURAL AND TECHNOLOGICAL CHANGES, 2015, 11 :85-97
[6]  
Guan Y., 2019, ARXIV
[7]  
Guo XW, 2020, Arxiv, DOI arXiv:2007.08690
[8]   Energy management based on reinforcement learning with double deep Q-learning for a hybrid electric tracked vehicle [J].
Han, Xuefeng ;
He, Hongwen ;
Wu, Jingda ;
Peng, Jiankun ;
Li, Yuecheng .
APPLIED ENERGY, 2019, 254
[9]   Reinforcement learning for Hybrid and Plug-In Hybrid Electric Vehicle Energy Management Recent Advances and Prospects [J].
Hu, Xiaosong ;
Liu, Teng ;
Qi, Xuewei ;
Barth, Matthew .
IEEE INDUSTRIAL ELECTRONICS MAGAZINE, 2019, 13 (03) :16-25
[10]   Optimal energy management strategies for energy Internet via deep reinforcement learning approach [J].
Hua, Haochen ;
Qin, Yuchao ;
Hao, Chuantong ;
Cao, Junwei .
APPLIED ENERGY, 2019, 239 (598-609) :598-609