Driving-Behavior-Aware Optimal Energy Management Strategy for Multi-Source Fuel Cell Hybrid Electric Vehicles Based on Adaptive Soft Deep-Reinforcement Learning

被引:31
|
作者
Sun, Haochen [1 ]
Tao, Fazhan [2 ,3 ]
Fu, Zhumu [3 ,4 ]
Gao, Aiyun [5 ]
Jiao, Longyin [3 ,4 ]
机构
[1] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[2] Henan Univ Sci & Technol, Longmen Lab, Luoyang 471023, Peoples R China
[3] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[4] Henan Univ Sci & Technol, Henan Key Lab Robot & Intelligent Syst, Luoyang 471023, Peoples R China
[5] Henan Univ Sci & Technol, Coll Vehicle & Traff Engn, Luoyang 471023, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy management; Behavioral sciences; Real-time systems; Support vector machines; Q-learning; Hybrid electric vehicles; Optimization; Deep reinforcement learning; energy management strategy; FCHEV; driving behavior recognition; adaptive soft learning; TIME POWER MANAGEMENT; CRUISE CONTROL; OPTIMIZATION; NETWORK; SYSTEM; MODEL;
D O I
10.1109/TITS.2022.3233564
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The majority of existing energy management strategies (EMSs), merely considering external driving conditions, often allocate demand power in an irrational way, resulting in a waste of energy and a short service life of power sources. Therefore, it is necessary to integrate driving behavior in EMS to reduce the fuel consumption and improve the lifespan of power sources. In this paper, a driving-behavior-aware adaptive deep-reinforcement-learning (DRL) based EMS is proposed for a three-power-source fuel cell hybrid electric vehicle (FCHEV). To fully utilize each power source, a hierarchical power splitting method is adopted by an adaptive fuzzy filter. Then, a high-performance driving behavior recognizer is employed, and Pontryagin's minimum principle (PMP) method is used to compute the optimal equivalent factor (EF) of each driving behavior. To realize a trade-off between global learning and real-time implementation, an improved multi-learning-space DRL-based algorithm, applying driving-behavior-aware adaptive equivalent consumption minimization strategy (A-ECMS) and soft learning mechanism, is proposed and verified by a series of simulations. Simulation results show that, compared with the benchmark method ECMS, the proposed P-DQL method can reduce the hydrogen consumption by 49.9% on average, and the total cost to use by 31.4% , showing a promising ability to increase fuel economy and reduce hydrogen consumption and the total cost to use of FCHEV.
引用
收藏
页码:4127 / 4146
页数:20
相关论文
共 50 条
  • [41] Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning framework
    Huang, Ruchen
    He, Hongwen
    Gao, Miaojue
    APPLIED ENERGY, 2023, 346
  • [42] Battery-degradation-involved energy management strategy based on deep reinforcement learning for fuel cell/battery/ultracapacitor hybrid electric vehicle
    Lu, Hongxin
    Tao, Fazhan
    Fu, Zhumu
    Sun, Haochen
    ELECTRIC POWER SYSTEMS RESEARCH, 2023, 220
  • [43] Driving style-aware energy management for battery/supercapacitor electric vehicles using deep reinforcement learning
    Wu, Yue
    Huang, Zhiwu
    Zhang, Rui
    Huang, Pei
    Gao, Yang
    Li, Heng
    Liu, Yongjie
    Peng, Jun
    JOURNAL OF ENERGY STORAGE, 2023, 73
  • [44] Reinforcement Learning Based Energy Management Strategy for Hybrid Electric Vehicles Using Multi-mode Combustion
    Zhang H.
    Fan Q.
    Wang W.
    Huang J.
    Wang Z.
    Qiche Gongcheng/Automotive Engineering, 2021, 43 (05): : 683 - 691
  • [45] Research on energy management strategy for fuel cell hybrid electric vehicles based on multi-scale information fusion
    Min, Haitao
    Wu, Huiduo
    Zhao, Honghui
    Sun, Weiyi
    Yu, Yuanbin
    APPLIED ENERGY, 2024, 368
  • [46] Multi-mode energy management strategy for fuel cell electric vehicles based on driving pattern identification using learning vector quantization neural network algorithm
    Song, Ke
    Li, Feiqiang
    Hu, Xiao
    He, Lin
    Niu, Wenxu
    Lu, Sihao
    Zhang, Tong
    JOURNAL OF POWER SOURCES, 2018, 389 : 230 - 239
  • [47] Multi-Agent Deep Reinforcement Learning-Based Multi-Objective Cooperative Control Strategy for Hybrid Electric Vehicles
    Gan, Jiongpeng
    Li, Shen
    Lin, Xianke
    Tang, Xiaolin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (08) : 11123 - 11135
  • [48] Deep reinforcement learning based energymanagement strategy considering running costs and energy source aging for fuel cell hybrid electric vehicle
    Huang, Yin
    Kang, Zehao
    Mao, Xuping
    Hu, Haoqin
    Tan, Jiaqi
    Xuan, Dongji
    ENERGY, 2023, 283
  • [49] Online-Learning Adaptive Energy Management for Hybrid Electric Vehicles in Various Driving Scenarios Based on Dyna Framework
    Yang, Ningkang
    Han, Lijin
    Zhou, Xuan
    Liu, Rui
    Liu, Hui
    Xiang, Changle
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (02): : 2572 - 2589
  • [50] Multi-mode predictive energy management for fuel cell hybrid electric vehicles using Markov driving pattern recognizer
    Zhou, Yang
    Ravey, Alexandre
    Pera, Marie-Cecile
    APPLIED ENERGY, 2020, 258