A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:15
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
收藏
页码:1674 / 1688
页数:15
相关论文
共 44 条
  • [31] Dynamic Traffic Feedback Data Enabled Energy Management in Plug-in Hybrid Electric Vehicles
    Sun, Chao
    Moura, Scott Jason
    Hu, Xiaosong
    Hedrick, J. Karl
    Sun, Fengchun
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2015, 23 (03) : 1075 - 1086
  • [32] A multi-level energy management system for multi-source electric vehicles - An integrated rule-based meta-heuristic approach
    Trovao, Joao P.
    Pereirinha, Paulo G.
    Jorge, Humberto M.
    Antunes, Carlos Henggeler
    [J]. APPLIED ENERGY, 2013, 105 : 304 - 318
  • [33] van Hasselt H, 2012, ADAPT LEARN OPTIM, V12, P207
  • [34] Joint Estimation of SOC of Lithium Battery Based on Dual Kalman Filter
    Wang, Hao
    Zheng, Yanping
    Yu, Yang
    [J]. PROCESSES, 2021, 9 (08)
  • [35] Weida Wang, 2021, Proceedings of China SAE Congress 2019: Selected Papers. Lecture Notes in Electrical Engineering (LNNS 646), P511, DOI 10.1007/978-981-15-7945-5_36
  • [36] Classification and Review of Control Strategies for Plug-In Hybrid Electric Vehicles
    Wirasingha, Sanjaka G.
    Emadi, Ali
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2011, 60 (01) : 111 - 122
  • [37] Deep reinforcement learning of energy management with continuous control strategy and traffic information for a series-parallel plug-in hybrid electric bus
    Wu, Yuankai
    Tan, Huachun
    Peng, Jiankun
    Zhang, Hailong
    He, Hongwen
    [J]. APPLIED ENERGY, 2019, 247 : 454 - 466
  • [38] Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle
    Xiong, Rui
    Cao, Jiayi
    Yu, Quanqing
    [J]. APPLIED ENERGY, 2018, 211 : 538 - 548
  • [39] Yu Z., 2009, AUTOMOBILE THEORY
  • [40] Fuzzy multi-objective control strategy for parallel hybrid electric vehicle
    Zhang, Y.
    Liu, H. -P.
    [J]. IET ELECTRICAL SYSTEMS IN TRANSPORTATION, 2012, 2 (02) : 39 - 50