An Online Energy Management Strategy for Fuel Cell Vehicles Based on Fuzzy Q-Learning and Road Condition Recognition

被引:3
作者
Yang, Duo [1 ,2 ]
Wang, Siyu [1 ]
Liao, Yuefeng [1 ,2 ]
Pan, Rui [3 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Peoples R China
[2] State Key Lab Intelligent Agr Power Equipment, Luoyang 471003, Peoples R China
[3] Xiangtan Univ, Sch Automat & Elect Informat, Xiangtan 411105, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy management; Roads; Fuel cells; Hydrogen; Q-learning; Lithium batteries; Real-time systems; Fuel cell vehicle; energy management strategy; road condition recognition; fuzzy inference system; reinforcement learning;
D O I
10.1109/TITS.2024.3368149
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Fuel cell vehicles represent a groundbreaking form of new energy vehicles, garnering considerable attention and development in recent years. The energy management of fuel cell hybrid electric vehicles has always been a research difficulty. This paper aims to improve the economy and durability of fuel cell and lithium battery hybrid systems, and proposes an innovative online energy management strategy that incorporates road condition recognition. Key features from multiple driving datasets are extracted to construct a classifier based on ensemble learning and decision tree, which can effectively identify road patterns. Then, a fuzzy Q-learning method is proposed for online power allocation. Different action spaces of Q-learning are designed to cater to different road patterns, enabling more effective adaptation to diverse roadway environments. In addition, the reward function is designed to account for hydrogen costs and degradation expenses. Through a series of simulation and hardware tests, the proposed method has been demonstrated to effectively achieve online energy management of fuel cell/battery system under varying road conditions. And a quantitative comparison validates that the proposed method outperforms traditional reinforcement learning algorithms in reducing both fuel consumption and system degradation rates.
引用
收藏
页码:12120 / 12130
页数:11
相关论文
共 50 条
  • [1] A Novel Energy Management Strategy Based on Dual Reward Function Q-learning for Fuel Cell Hybrid Electric Vehicle
    Zhang, Yuxiang
    Ma, Rui
    Zhao, Dongdong
    Huangfu, Yigeng
    Liu, Weiguo
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (02) : 1537 - 1547
  • [2] A Q-learning fuzzy inference system based online energy management strategy for off-road hybrid electric vehicles
    Bo, Lin
    Han, Lijin
    Xiang, Changle
    Liu, Hui
    Ma, Tian
    ENERGY, 2022, 252
  • [3] Energy management strategy for hybrid electric vehicles based on double Q-learning
    Han, Lijin
    Yang, Ke
    Zhang, Xin
    Yang, Ningkang
    Liu, Hui
    Liu, Jiaxin
    INTERNATIONAL CONFERENCE ON MECHANICAL DESIGN AND SIMULATION (MDS 2022), 2022, 12261
  • [4] Online energy management strategy of fuel cell hybrid electric vehicles based on rule learning
    Liu, Yonggang
    Liu, Junjun
    Qin, Datong
    Li, Guang
    Chen, Zheng
    Zhang, Yi
    JOURNAL OF CLEANER PRODUCTION, 2020, 260
  • [5] Q-learning based energy management strategy for a hybrid multi-stack fuel cell system considering degradation
    Ghaderi, Razieh
    Kandidayeni, Mohsen
    Boulon, Loic
    Trovao, Joao P.
    ENERGY CONVERSION AND MANAGEMENT, 2023, 293
  • [6] An Online Home Energy Management System using Q-Learning and Deep Q-Learning
    Izmitligil, Hasan
    Karamancioglu, Abdurrahman
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2024, 43
  • [7] Energy Management Strategy for Fuel Cell Vehicles Based on Online Driving Condition Recognition Using Dual-Model Predictive Control
    Li, Fuxiang
    Wang, Xiaolin
    Bao, Xucong
    Wang, Ziyu
    Li, Ruixuan
    SENSORS, 2024, 24 (23)
  • [8] Genetic Based Fuzzy Q-Learning Energy Management for Smart Grid
    Li Xin
    Zang Chuanzhi
    Zeng Peng
    Yu Haibin
    PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE, 2012, : 6924 - 6927
  • [9] An online energy management strategy for fuel cell hybrid vehicles
    Zhang, Yu
    Chen, Ming
    Cai, Shuo
    Hou, Shengyan
    Yin, Hai
    Gao, Jinwu
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 6034 - 6039
  • [10] Online correction predictive energy management strategy using the Q-learning based swarm optimization with fuzzy neural network
    Lin, Xinyou
    Zeng, Songrong
    Li, Xuefan
    ENERGY, 2021, 223