Optimal Rule-Interposing Reinforcement Learning-Based Energy Management of Series-Parallel-Connected Hybrid Electric Vehicles

被引:1
作者
Dai, Lihong [1 ,2 ]
Hu, Peng [2 ]
Wang, Tianyou [1 ]
Bian, Guosheng [3 ]
Liu, Haoye [1 ]
机构
[1] Tianjin Univ, State Key Lab Engines, Tianjin 300072, Peoples R China
[2] Chery Jetour Automobile Co Ltd, Wuhu 241100, Peoples R China
[3] KUNTYE Vehicle Syst Co Ltd, Tongling 213025, Peoples R China
关键词
series-parallel HEVs; energy management; reinforcement learning; connected environment;
D O I
10.3390/su16166848
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
P2-P3 series-parallel hybrid electric vehicles exhibit complex configurations with multiple power sources and operational modes, presenting a difficulty in developing efficient energy management strategies. This paper takes a P2-P3 series-parallel hybrid power system-KunTye 2DHT system as the research object and proposes a deep reinforcement learning framework based on pre-optimized energy management to improve the energy consumption performance of the hybrid electric vehicles. Firstly, a control-oriented model is established based on its system configuration and characteristics. Then, the optimal distribution of the motor energy under different operating modes is pre-optimized, which aims to reduce the energy management task's dimensionality by equating two motors as an equivalent motor. Subsequently, based on real-time traffic information under connected conditions, deep reinforcement learning is utilized to optimize the optimal operating modes of the hybrid system and the optimal distribution between the engine and equivalent motors. Combining the pre-optimized results, the optimal energy distribution between the engine and the two motors in the system is achieved. Finally, performance comparisons are made between the predictive control and the traditional Dynamic Programming and Adaptive Equivalent Consumption Minimization Strategy, revealing the proposed optimization algorithm's promising potential in reducing fuel consumption.
引用
收藏
页数:17
相关论文
共 19 条
  • [1] Energy management for a hybrid electric vehicle based on prioritized deep reinforcement learning framework
    Du, Guodong
    Zou, Yuan
    Zhang, Xudong
    Guo, Lingxiong
    Guo, Ningyuan
    [J]. ENERGY, 2022, 241
  • [2] Intelligent Learning Algorithm and Intelligent Transportation-Based Energy Management Strategies for Hybrid Electric Vehicles: A Review
    Gan, Jiongpeng
    Li, Shen
    Wei, Chongfeng
    Deng, Lei
    Tang, Xiaolin
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (10) : 10345 - 10361
  • [3] Real-time predictive energy management of plug-in hybrid electric vehicles for coordination of fuel economy and battery degradation
    Guo, Ningyuan
    Zhang, Xudong
    Zou, Yuan
    Guo, Lingxiong
    Du, Guodong
    [J]. ENERGY, 2021, 214
  • [4] Battery life constrained real-time energy management strategy for hybrid electric vehicles based on reinforcement learning
    Han, Lijin
    Yang, Ke
    Ma, Tian
    Yang, Ningkang
    Liu, Hui
    Guo, Lingxiong
    [J]. ENERGY, 2022, 259
  • [5] Deep Reinforcement Learning for Autonomous Driving: A Survey
    Kiran, B. Ravi
    Sobh, Ibrahim
    Talpaert, Victor
    Mannion, Patrick
    Al Sallab, Ahmad A.
    Yogamani, Senthil
    Perez, Patrick
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 4909 - 4926
  • [6] Cross-Type Transfer for Deep Reinforcement Learning Based Hybrid Electric Vehicle Energy Management
    Lian, Renzong
    Tan, Huachun
    Peng, Jiankun
    Li, Qin
    Wu, Yuankai
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (08) : 8367 - 8380
  • [7] Energy management for hybrid electric vehicles based on imitation reinforcement learning
    Liu, Yonggang
    Wu, Yitao
    Wang, Xiangyu
    Li, Liang
    Zhang, Yuanjian
    Chen, Zheng
    [J]. ENERGY, 2023, 263
  • [8] A deep reinforcement learning approach to energy management control with connected information for hybrid electric vehicles
    Mei, Peng
    Karimi, Hamid Reza
    Xie, Hehui
    Chen, Fei
    Huang, Cong
    Yang, Shichun
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [9] Multi-objective optimum energy management strategies for parallel hybrid electric vehicles: A comparative study
    Nassar, Mohamed Y.
    Shaltout, Mohamed L.
    Hegazi, Hesham A.
    [J]. ENERGY CONVERSION AND MANAGEMENT, 2023, 277
  • [10] Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle
    Qi, Chunyang
    Zhu, Yiwen
    Song, Chuanxue
    Yan, Guangfu
    Wang, Da
    Xiao, Feng
    Zhang, Xu
    Cao, Jingwei
    Song, Shixin
    [J]. ENERGY, 2022, 238