A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification

被引:15
作者
Chang, Chengcheng [1 ]
Zhao, Wanzhong [1 ]
Wang, Chunyan [1 ]
Song, Yingdong [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Jiangsu Engn Res Ctr Vehicle Distributed Drive & I, Nanjing 210016, Peoples R China
关键词
Energy management; Torque; Batteries; Employee welfare; Engines; Fuels; Q-learning; Condition identification; deep reinforcement learning; energy management system; rule; HYBRID VEHICLE POWER; ELECTRIC VEHICLES; SYSTEM; BUS;
D O I
10.1109/TVT.2022.3209817
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to reduce the driving cost of plug-in hybrid electric vehicles, a novel energy management strategy integrating deep reinforcement learning and rule based on condition identification is proposed. Firstly, principal component analysis is used to reduce the dimension of kinematic sequences features, and fuzzy clustering is used to classify the kinematics sequences, and then the working conditions are reorganized according to the classification results to obtain the three kinds of training conditions, and learning vector quantization neural network is used to train and identify the type of working conditions. Then, the rule taking engine torque, state of charge, and motor torque as control variables and driving mode as output is designed, which is integrated into the agent of deep reinforcement learning. Combined with the designed energy management strategy trained under three working conditions, the numerical simulation is carried out under the verification working condition based on condition identification, the simulation results are systematically analyzed to show the effectiveness of the designed energy management strategy.
引用
收藏
页码:1674 / 1688
页数:15
相关论文
共 44 条
  • [1] A Fuzzy Logic Global Power Management Strategy for Hybrid Electric Vehicles Based on a Permanent Magnet Electric Variable Transmission
    Abdelsalam, Abdelsalam Ahmed
    Cui, Shumei
    [J]. ENERGIES, 2012, 5 (04) : 1175 - 1198
  • [2] A Rule-Based Energy Management Strategy for Plug-in Hybrid Electric Vehicle (PHEV)
    Banvait, Harpreetsingh
    Anwar, Sohel
    Chen, Yaobin
    [J]. 2009 AMERICAN CONTROL CONFERENCE, VOLS 1-9, 2009, : 3938 - 3943
  • [3] Chen Z., 2014, ENERGY EDUC SCI TECH, V32, P2585
  • [4] Energy Management for a Power-Split Plug-in Hybrid Electric Vehicle Based on Dynamic Programming and Neural Networks
    Chen, Zheng
    Mi, Chunting Chris
    Xu, Jun
    Gong, Xianzhi
    You, Chenwen
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2014, 63 (04) : 1567 - 1580
  • [5] A Supervisory Control Strategy for Plug-In Hybrid Electric Vehicles Based on Energy Demand Prediction and Route Preview
    Feng Tianheng
    Yang Lin
    Gu Qing
    Hu Yanqing
    Yan Ting
    Yan Bin
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2015, 64 (05) : 1691 - 1700
  • [6] Predictive Energy Management of Plug-in Hybrid Electric Vehicles by Real-Time Optimization and Data-Driven Calibration
    Guo, Ningyuan
    Zhang, Xudong
    Zou, Yuan
    Du, Guangze
    Wang, Chao
    Guo, Lingxiong
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (06) : 5677 - 5691
  • [7] Real-time predictive energy management of plug-in hybrid electric vehicles for coordination of fuel economy and battery degradation
    Guo, Ningyuan
    Zhang, Xudong
    Zou, Yuan
    Guo, Lingxiong
    Du, Guodong
    [J]. ENERGY, 2021, 214
  • [8] Hsu RC, 2016, JOINT INT CONF SOFT, P460, DOI [10.1109/SCIS-ISIS.2016.0104, 10.1109/SCIS&ISIS.2016.30]
  • [9] Adaptive intelligent energy management system of plug-in hybrid electric vehicle
    Khayyam, Hamid
    Bab-Hadiashar, Alireza
    [J]. ENERGY, 2014, 69 : 319 - 335
  • [10] Energy and Battery Management of a Plug-In Series Hybrid Electric Vehicle Using Fuzzy Logic
    Li, S. G.
    Sharkh, S. M.
    Walsh, F. C.
    Zhang, C. N.
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2011, 60 (08) : 3571 - 3585