Advanced deep deterministic policy gradient based energy management strategy design for dual-motor four-wheel-drive electric vehicle

被引:35
作者
Cui, Hanghang [1 ]
Ruan, Jiageng [1 ]
Wu, Changcheng [1 ]
Zhang, Kaixuan [1 ]
Li, Tongyang [1 ]
机构
[1] Beijing Univ Technol, Dept Mat & Mfg, Beijing, Peoples R China
关键词
Energy management strategy; Dual-motor four-wheel-drive system; Deep reinforcement learning; DDPG; DDQN; Pure electric vehicle; TRANSMISSION;
D O I
10.1016/j.mechmachtheory.2022.105119
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Four-wheel-drive battery electric vehicles (BEV) driven by multiple motors on different axles are getting popular by offering outstanding dynamic and safety performance without sacrificing structure complexity. However, efficiently splitting the power flow between power sources is crucial and difficult. In this study, an intelligent energy management strategy (EMS) is proposed for a specific dual-motor four-wheel-drive (DM-4WD) BEV to reduce energy consumption in unknown traffic conditions. A novel reward factor involved deep deterministic policy gradient (DDPG) algorithm is proposed in EMS design, whose parameters matching are based on particle swarm optimization algorithm to provide a platform to investigate the maximum potential of energy performance improvement for the proposed EMS. The simulation results show that the proposed DDPG-EMS reaches 95.7%, 94.8%, and 95.5% of benchmark dynamic programming-EMS energy performance and outperforms the discontinued-action-based double deep Q-learning strategy in unknow driving cycles. Furthermore, the adaptability of DDPG-EMS is improved by introducing novel rewards setting, which is 3%, 3.8%, and 2.4% better than the traditional State-of-Charge (SOC)-based DDPG-EMS. The simulation results suggest the proposed strategy is efficient and instructive for multi-power BEV EMS design.
引用
收藏
页数:15
相关论文
共 44 条
[1]  
Biswas A., 2019, REAL TIME OPTIMAL EN, DOI [10.1109/ITEC.2019.8790482, DOI 10.1109/ITEC.2019.8790482]
[2]   Safe Approximate Dynamic Programming via Kernelized Lipschitz Estimation [J].
Chakrabarty, Ankush ;
Jha, Devesh K. ;
Buzzard, Gregery T. ;
Wang, Yebin ;
Vamvoudakis, Kyriakos G. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) :405-419
[3]   Torque-Fill Control and Energy Management for a Four-Wheel-Drive Electric Vehicle Layout With Two-Speed Transmissions [J].
De Pinto, Stefano ;
Camocardi, Pablo ;
Sorniotti, Aldo ;
Gruber, Patrick ;
Perlo, Pietro ;
Viotto, Fabio .
IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2017, 53 (01) :447-458
[4]   Optimization design and performance comparison of different powertrains of electric vehicles [J].
Du, Wei ;
Zhao, Shengdun ;
Jin, Liying ;
Gao, Jingzhou ;
Zheng, Zhenhao .
MECHANISM AND MACHINE THEORY, 2021, 156
[5]   Particle Swarm Optimisation: A Historical Review Up to the Current Developments [J].
Freitas, Diogo ;
Lopes, Luiz Guerreiro ;
Morgado-Dias, Fernando .
ENTROPY, 2020, 22 (03)
[6]   Energy management based on reinforcement learning with double deep Q-learning for a hybrid electric tracked vehicle [J].
Han, Xuefeng ;
He, Hongwen ;
Wu, Jingda ;
Peng, Jiankun ;
Li, Yuecheng .
APPLIED ENERGY, 2019, 254
[7]   Parameter matching and optimal energy management for a novel dual-motor multi-modes powertrain system [J].
Hu, Jianjun ;
Zu, Guoqiang ;
Jia, Meixia ;
Niu, Xiyuan .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2019, 116 :113-128
[8]   Multi-Objective Optimization Control of Distributed Electric Drive Vehicles Based on Optimal Torque Distribution [J].
Huang, Juhua ;
Liu, Yingkang ;
Liu, Mingchun ;
Cao, Ming ;
Yan, Qihao .
IEEE ACCESS, 2019, 7 :16377-16394
[9]   Real-time frequency regulation using aggregated electric vehicles in smart grid [J].
Islam, Md. Monirul ;
Zhong, Xiao ;
Sun, Zeyi ;
Xiong, Haoyi ;
Hu, Wenqing .
COMPUTERS & INDUSTRIAL ENGINEERING, 2019, 134 :11-26
[10]   A Survey of Traction Control and Antilock Braking Systems of Full Electric Vehicles With Individually Controlled Electric Motors [J].
Ivanov, Valentin ;
Savitski, Dzmitry ;
Shyrokau, Barys .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2015, 64 (09) :3878-3896