Driving-Behavior-Aware Optimal Energy Management Strategy for Multi-Source Fuel Cell Hybrid Electric Vehicles Based on Adaptive Soft Deep-Reinforcement Learning

被引:31
|
作者
Sun, Haochen [1 ]
Tao, Fazhan [2 ,3 ]
Fu, Zhumu [3 ,4 ]
Gao, Aiyun [5 ]
Jiao, Longyin [3 ,4 ]
机构
[1] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[2] Henan Univ Sci & Technol, Longmen Lab, Luoyang 471023, Peoples R China
[3] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[4] Henan Univ Sci & Technol, Henan Key Lab Robot & Intelligent Syst, Luoyang 471023, Peoples R China
[5] Henan Univ Sci & Technol, Coll Vehicle & Traff Engn, Luoyang 471023, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy management; Behavioral sciences; Real-time systems; Support vector machines; Q-learning; Hybrid electric vehicles; Optimization; Deep reinforcement learning; energy management strategy; FCHEV; driving behavior recognition; adaptive soft learning; TIME POWER MANAGEMENT; CRUISE CONTROL; OPTIMIZATION; NETWORK; SYSTEM; MODEL;
D O I
10.1109/TITS.2022.3233564
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The majority of existing energy management strategies (EMSs), merely considering external driving conditions, often allocate demand power in an irrational way, resulting in a waste of energy and a short service life of power sources. Therefore, it is necessary to integrate driving behavior in EMS to reduce the fuel consumption and improve the lifespan of power sources. In this paper, a driving-behavior-aware adaptive deep-reinforcement-learning (DRL) based EMS is proposed for a three-power-source fuel cell hybrid electric vehicle (FCHEV). To fully utilize each power source, a hierarchical power splitting method is adopted by an adaptive fuzzy filter. Then, a high-performance driving behavior recognizer is employed, and Pontryagin's minimum principle (PMP) method is used to compute the optimal equivalent factor (EF) of each driving behavior. To realize a trade-off between global learning and real-time implementation, an improved multi-learning-space DRL-based algorithm, applying driving-behavior-aware adaptive equivalent consumption minimization strategy (A-ECMS) and soft learning mechanism, is proposed and verified by a series of simulations. Simulation results show that, compared with the benchmark method ECMS, the proposed P-DQL method can reduce the hydrogen consumption by 49.9% on average, and the total cost to use by 31.4% , showing a promising ability to increase fuel economy and reduce hydrogen consumption and the total cost to use of FCHEV.
引用
收藏
页码:4127 / 4146
页数:20
相关论文
共 50 条
  • [1] Distributed Deep Reinforcement Learning-Based Energy and Emission Management Strategy for Hybrid Electric Vehicles
    Tang, Xiaolin
    Chen, Jiaxin
    Liu, Teng
    Qin, Yechen
    Cao, Dongpu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) : 9922 - 9934
  • [2] Energy Management Strategy for Fuel Cell/Battery/Ultracapacitor Hybrid Electric Vehicles Using Deep Reinforcement Learning With Action Trimming
    Fu, Zhumu
    Wang, Haocong
    Tao, Fazhan
    Ji, Baofeng
    Dong, Yongsheng
    Song, Shuzhong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (07) : 7171 - 7185
  • [3] A reinforcement learning energy management strategy for fuel cell hybrid electric vehicles considering driving condition classification
    Kang, Xu
    Wang, Yujie
    Chen, Zonghai
    SUSTAINABLE ENERGY GRIDS & NETWORKS, 2024, 38
  • [4] A collaborative energy management strategy based on multi-agent reinforcement learning for fuel cell hybrid electric vehicles
    Xiao, Yao
    Fu, Shengxiang
    Choi, Jongwoo
    Zheng, Chunhua
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [5] Deep stochastic reinforcement learning-based energy management strategy for fuel cell hybrid electric vehicles
    Jouda, Basel
    Al-Mahasneh, Ahmad Jobran
    Abu Mallouh, Mohammed
    ENERGY CONVERSION AND MANAGEMENT, 2024, 301
  • [6] A health-aware energy management strategy for fuel cell hybrid electric UAVs based on safe reinforcement learning
    Gao, Qinxiang
    Lei, Tao
    Yao, Wenli
    Zhang, Xingyu
    Zhang, Xiaobin
    ENERGY, 2023, 283
  • [7] Energy management strategy of fuel cell vehicles with hybrid energy sources: A novel framework via deep reinforcement learning and transfer learning
    Zhou, Jianhao
    Guo, Aijun
    Wang, Jie
    Wang, Chunyan
    Zhao, Wanzhong
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024, 238 (14) : 4659 - 4675
  • [8] Longevity-conscious energy management strategy of fuel cell hybrid electric Vehicle Based on deep reinforcement learning
    Tang, Xiaolin
    Zhou, Haitao
    Wang, Feng
    Wang, Weida
    Lin, Xianke
    ENERGY, 2022, 238
  • [9] Online energy management strategy of fuel cell hybrid electric vehicles based on rule learning
    Liu, Yonggang
    Liu, Junjun
    Qin, Datong
    Li, Guang
    Chen, Zheng
    Zhang, Yi
    JOURNAL OF CLEANER PRODUCTION, 2020, 260
  • [10] Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
    Hu, Yue
    Li, Weimin
    Xu, Kun
    Zahid, Taimoor
    Qin, Feiyan
    Li, Chenming
    APPLIED SCIENCES-BASEL, 2018, 8 (02):