Driving-Behavior-Aware Optimal Energy Management Strategy for Multi-Source Fuel Cell Hybrid Electric Vehicles Based on Adaptive Soft Deep-Reinforcement Learning

被引:31
|
作者
Sun, Haochen [1 ]
Tao, Fazhan [2 ,3 ]
Fu, Zhumu [3 ,4 ]
Gao, Aiyun [5 ]
Jiao, Longyin [3 ,4 ]
机构
[1] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[2] Henan Univ Sci & Technol, Longmen Lab, Luoyang 471023, Peoples R China
[3] Henan Univ Sci & Technol, Coll Informat Engn, Luoyang 471023, Peoples R China
[4] Henan Univ Sci & Technol, Henan Key Lab Robot & Intelligent Syst, Luoyang 471023, Peoples R China
[5] Henan Univ Sci & Technol, Coll Vehicle & Traff Engn, Luoyang 471023, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy management; Behavioral sciences; Real-time systems; Support vector machines; Q-learning; Hybrid electric vehicles; Optimization; Deep reinforcement learning; energy management strategy; FCHEV; driving behavior recognition; adaptive soft learning; TIME POWER MANAGEMENT; CRUISE CONTROL; OPTIMIZATION; NETWORK; SYSTEM; MODEL;
D O I
10.1109/TITS.2022.3233564
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The majority of existing energy management strategies (EMSs), merely considering external driving conditions, often allocate demand power in an irrational way, resulting in a waste of energy and a short service life of power sources. Therefore, it is necessary to integrate driving behavior in EMS to reduce the fuel consumption and improve the lifespan of power sources. In this paper, a driving-behavior-aware adaptive deep-reinforcement-learning (DRL) based EMS is proposed for a three-power-source fuel cell hybrid electric vehicle (FCHEV). To fully utilize each power source, a hierarchical power splitting method is adopted by an adaptive fuzzy filter. Then, a high-performance driving behavior recognizer is employed, and Pontryagin's minimum principle (PMP) method is used to compute the optimal equivalent factor (EF) of each driving behavior. To realize a trade-off between global learning and real-time implementation, an improved multi-learning-space DRL-based algorithm, applying driving-behavior-aware adaptive equivalent consumption minimization strategy (A-ECMS) and soft learning mechanism, is proposed and verified by a series of simulations. Simulation results show that, compared with the benchmark method ECMS, the proposed P-DQL method can reduce the hydrogen consumption by 49.9% on average, and the total cost to use by 31.4% , showing a promising ability to increase fuel economy and reduce hydrogen consumption and the total cost to use of FCHEV.
引用
收藏
页码:4127 / 4146
页数:20
相关论文
共 50 条
  • [21] Optimizing fuel economy and durability of hybrid fuel cell electric vehicles using deep reinforcement learning-based energy management systems
    Hu, Haowen
    Yuan, Wei-Wei
    Su, Minghang
    Ou, Kai
    ENERGY CONVERSION AND MANAGEMENT, 2023, 291
  • [22] Benchmarking Deep Reinforcement Learning Based Energy Management Systems for Hybrid Electric Vehicles
    Wu Yuankai
    Lian Renzong
    Wang Yong
    Lin Yi
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT II, 2022, 13605 : 613 - 625
  • [23] Reinforcement learning based energy management for fuel cell hybrid electric vehicles: A comprehensive review on decision process reformulation and strategy implementation
    Li, Jianwei
    Liu, Jie
    Yang, Qingqing
    Wang, Tianci
    He, Hongwen
    Wang, Hanxiao
    Sun, Fengchun
    RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2025, 213
  • [24] Effective energy management strategy based on deep reinforcement learning for fuel cell hybrid vehicle considering multiple performance of integrated energy system
    Hu, Haoqin
    Lu, Chenlei
    Tan, Jiaqi
    Liu, Shengnan
    Xuan, Dongji
    INTERNATIONAL JOURNAL OF ENERGY RESEARCH, 2022, 46 (15) : 24254 - 24272
  • [25] A Deep Reinforcement Learning Based Energy Management Strategy for Hybrid Electric Vehicles in Connected Traffic Environment
    Li, Jie
    Wu, Xiaodong
    Hu, Sunan
    Fan, Jiawei
    IFAC PAPERSONLINE, 2021, 54 (10): : 150 - 156
  • [26] An Adaptive Hierarchical Energy Management Strategy for Hybrid Electric Vehicles Combining Heuristic Domain Knowledge and Data-Driven Deep Reinforcement Learning
    Hu, Bo
    Li, Jiaxi
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2022, 8 (03) : 3275 - 3288
  • [27] Energy management optimization of fuel cell hybrid electric vehicle based on deep reinforcement learning
    Wang, Hao-Cong
    Wang, Yue-Yang
    Fu, Zhu-Mu
    Chen, Qi-Hong
    Tao, Fa-Zhan
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (10): : 1831 - 1841
  • [28] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Zheng, Chunhua
    Li, Wei
    Li, Weimin
    Xu, Kun
    Peng, Lei
    Cha, Suk Won
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 885 - 897
  • [29] Management and control strategy of a hybrid energy source fuel cell/supercapacitor in electric vehicles
    Rezzak, Daoud
    Boudjerda, Nasserdine
    INTERNATIONAL TRANSACTIONS ON ELECTRICAL ENERGY SYSTEMS, 2017, 27 (06):
  • [30] Online energy management strategy of fuel cell hybrid electric vehicles based on data fusion approach
    Zhou, Daming
    Al-Durra, Ahmed
    Gao, Fei
    Ravey, Alexandre
    Matraji, Imad
    Simoes, Marcelo Godoy
    JOURNAL OF POWER SOURCES, 2017, 366 : 278 - 291