Driving-Behavior-Aware Optimal Energy Management Strategy for Multi-Source Fuel Cell Hybrid Electric Vehicles Based on Adaptive Soft Deep-Reinforcement Learning

被引:31
|
作者
Sun, Haochen [1 ]
Tao, Fazhan [2 ,3 ]
Fu, Zhumu [3 ,4 ]
Gao, Aiyun [5 ]
Jiao, Longyin [3 ,4 ]
机构
[1] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[2] Henan Univ Sci & Technol, Longmen Lab, Luoyang 471023, Peoples R China
[3] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[4] Henan Univ Sci & Technol, Henan Key Lab Robot & Intelligent Syst, Luoyang 471023, Peoples R China
[5] Henan Univ Sci & Technol, Coll Vehicle & Traff Engn, Luoyang 471023, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy management; Behavioral sciences; Real-time systems; Support vector machines; Q-learning; Hybrid electric vehicles; Optimization; Deep reinforcement learning; energy management strategy; FCHEV; driving behavior recognition; adaptive soft learning; TIME POWER MANAGEMENT; CRUISE CONTROL; OPTIMIZATION; NETWORK; SYSTEM; MODEL;
D O I
10.1109/TITS.2022.3233564
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The majority of existing energy management strategies (EMSs), merely considering external driving conditions, often allocate demand power in an irrational way, resulting in a waste of energy and a short service life of power sources. Therefore, it is necessary to integrate driving behavior in EMS to reduce the fuel consumption and improve the lifespan of power sources. In this paper, a driving-behavior-aware adaptive deep-reinforcement-learning (DRL) based EMS is proposed for a three-power-source fuel cell hybrid electric vehicle (FCHEV). To fully utilize each power source, a hierarchical power splitting method is adopted by an adaptive fuzzy filter. Then, a high-performance driving behavior recognizer is employed, and Pontryagin's minimum principle (PMP) method is used to compute the optimal equivalent factor (EF) of each driving behavior. To realize a trade-off between global learning and real-time implementation, an improved multi-learning-space DRL-based algorithm, applying driving-behavior-aware adaptive equivalent consumption minimization strategy (A-ECMS) and soft learning mechanism, is proposed and verified by a series of simulations. Simulation results show that, compared with the benchmark method ECMS, the proposed P-DQL method can reduce the hydrogen consumption by 49.9% on average, and the total cost to use by 31.4% , showing a promising ability to increase fuel economy and reduce hydrogen consumption and the total cost to use of FCHEV.
引用
收藏
页码:4127 / 4146
页数:20
相关论文
共 50 条
  • [31] Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles
    Li, Weihan
    Cui, Han
    Nemeth, Thomas
    Jansen, Jonathan
    Uenluebayir, Cem
    Wei, Zhongbao
    Zhang, Lei
    Wang, Zhenpo
    Ruan, Jiageng
    Dai, Haifeng
    Wei, Xuezhe
    Sauer, Dirk Uwe
    JOURNAL OF ENERGY STORAGE, 2021, 36
  • [32] A Long-term Energy Management Strategy for Fuel Cell Electric Vehicles Using Reinforcement Learning
    Zhou, Y. F.
    Huang, L. J.
    Sun, X. X.
    Li, L. H.
    Lian, J.
    FUEL CELLS, 2020, 20 (06) : 753 - 761
  • [33] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Chunhua Zheng
    Wei Li
    Weimin Li
    Kun Xu
    Lei Peng
    Suk Won Cha
    International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 885 - 897
  • [34] Investigation of energy management strategy based on deep reinforcement learning algorithm for multi-speed pure electric vehicles
    Yang, Weiwei
    Luo, Denghao
    Zhang, Wenming
    Zhang, Nong
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024,
  • [35] Deep reinforcement learning and fuzzy logic controller codesign for energy management of hydrogen fuel cell powered electric vehicles
    Rostami, Seyed Mehdi Rakhtala
    Al-Shibaany, Zeyad
    Kay, Peter
    Karimi, Hamid Reza
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [36] A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle
    Zhang, Yuxiang
    Ma, Rui
    Zhao, Dongdong
    Huangfu, Yigeng
    Liu, Weiguo
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (02) : 1537 - 1547
  • [37] Deep Reinforcement Learning Based Energy Management Strategy for Fuel Cell and Battery Powered Rail Vehicles
    Deng, Kai
    Hai, Di
    Peng, Hujun
    Loewenstein, Lars
    Hameyer, Kay
    2021 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2021,
  • [38] Research on energy management strategy of fuel cell hybrid power via an improved TD3 deep reinforcement learning
    Zhou, Yujie
    Huang, Yin
    Mao, Xuping
    Kang, Zehao
    Huang, Xuejin
    Xuan, Dongji
    ENERGY, 2024, 293
  • [39] Knowledge-Guided Deep Reinforcement Learning for Multiobjective Energy Management of Fuel Cell Electric Vehicles
    Li, Xinyu
    He, Hongwen
    Wu, Jingda
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2025, 11 (01): : 2344 - 2355
  • [40] Reliability-aware management strategy for hybrid fuel cell-battery system of electric vehicles based on potential field theory
    Li, Jianwei
    Liu, Jie
    He, Shucheng
    Tian, Zhonghao
    Zhang, Shuo
    Li, Junqiu
    Yang, Qingqing
    JOURNAL OF ENERGY STORAGE, 2025, 110