A Decentralized Multi-agent Energy Management Strategy Based on a Look-Ahead Reinforcement Learning Approach

被引：8
作者：
Khalatbarisoltani A. [1 ]
Kandidayeni M. [2 ,3 ]
Boulon L. [1 ]
Hu X. [4 ,5 ]
机构：
[1] Hydrogen Research Institute, Department of Electrical and Computer Engineering, Université du Québec À Trois-Rivières, G8Z 4M3, QC
[2] Electric-Transport, Energy Storage and Conversion Lab (E-TESC), Université de Sherbrooke
[3] State Key Laboratory for Mechanical Transmission, Department of Automotive Engineering, Chongqing University, Chongqing
[4] Advanced Vehicle Engineering Centre, Cranfield University, Cranfield
来源：
SAE International Journal of Electrified Vehicles | 2021年 / 11卷 / 02期
关键词：
Energy management - Fuel cells - Reinforcement learning - Electric load flow - Powertrains - Energy efficiency;
D O I：
10.4271/14-11-02-0012
中图分类号：
学科分类号：
摘要：
An energy management strategy (EMS) has an essential role in ameliorating the efficiency and lifetime of the powertrain components in a hybrid fuel cell vehicle (HFCV). The EMS of intelligent HFCVs is equipped with advanced data-driven techniques to efficiently distribute the power flow among the power sources, which have heterogeneous energetic characteristics. Decentralized EMSs provide higher modularity (plug and play) and reliability compared to the centralized data-driven strategies. Modularity is the specification that promotes the discovery of new components in a powertrain system without the need for reconfiguration. Hence, this article puts forward a decentralized reinforcement learning (Dec-RL) framework for designing an EMS in a heavy-duty HFCV. The studied powertrain is composed of two parallel fuel cell systems (FCSs) and a battery pack. The contribution of the suggested multi-agent approach lies in the development of a fully decentralized learning strategy composed of several connected local modules. The performance of the proposed approach is investigated through several simulations and experimental tests. The results indicate the advantage of the established Dec-RL control scheme in convergence speed and optimization criteria. © 2021 SAE International Journal of Electrified Vehicles.
引用
收藏
相关论文
共 63 条
[1]  
Cano Z.P., Banham D., Ye S., Hintennach A., Et al., Batteries and Fuel Cells for Emerging Electric Vehicle Markets, Nature Energy, 3, pp. 279-289, (2018)
[2]  
Das H.S., Tan C.W., Yatim A.H.M., Fuel Cell Hybrid Electric Vehicles: A Review on Power Conditioning Units and Topologies, Renewable and Sustainable Energy Reviews, 76, pp. 268-291, (2017)
[3]  
Hua T., Ahluwalia R., Eudy L., Singer G., Et al., Status of Hydrogen Fuel Cell Electric Buses Worldwide, Journal of Power Sources, 269, pp. 975-993, (2014)
[4]  
Eberle U., Muller B., Helmolt R., Fuel Cell Electric Vehicles and Hydrogen Infrastructure: Status 2012, Energy & Environmental Science, 5, pp. 8790-8798, (2012)
[5]  
Marx N., Boulon L., Gustin F., Hissel D., Et al., A Review of Multi-Stack and Modular Fuel Cell Systems: Interests, Application Areas and On-Going Research Activities, International Journal of Hydrogen Energy, 39, pp. 12101-12111, (2014)
[6]  
Garcia J.E., Herrera D.F., Boulon L., Sicard P., Et al., Power Sharing for Efficiency Optimisation into a Multi Fuel Cell System, pp. 218-223, (2014)
[7]  
Marx N., Hissel D., Gustin F., Boulon L., Et al., On the Sizing and Energy Management of an Hybrid Multistack Fuel Cell - Battery System for Automotive Applications, International Journal of Hydrogen Energy, 42, pp. 1518-1526, (2017)
[8]  
Khalatbarisoltani A., Cepeda J.C.O., Boulon L., St-Pierre D.L., Et al., A New Real-Time Centralized Energy Management Strategy for Modular Electric Vehicles, pp. 1-5, (2018)
[9]  
Somaiah B., Agarwal V., Distributed Maximum Power Extraction from Fuel Cell Stack Arrays Using Dedicated Power Converters in Series and Parallel Configuration, Ieee Transactions on Energy Conversion, 31, pp. 1442-1451, (2016)
[10]  
Zhang H., Li X., Liu X., Yan J., Enhancing Fuel Cell Durability for Fuel Cell Plug-In Hybrid Electric Vehicles through Strategic Power Management, Applied Energy, 241, pp. 483-490, (2019)
1234567