Real-Time Optimal Energy Management of Electrified Powertrains with Reinforcement Learning

被引:18
作者
Biswas, Atriya [1 ]
Anselma, Pier G. [2 ]
Emadi, Ali [1 ]
机构
[1] McMaster Univ, MARC, Hamilton, ON, Canada
[2] Politecn Torino, Dept Mech & Aerosp Engn DIMEAS, Turin, Italy
来源
2019 IEEE TRANSPORTATION ELECTRIFICATION CONFERENCE AND EXPO (ITEC) | 2019年
关键词
Automotive systems; electric and hybrid electric vehicles; electrified powertrains; energy management system; premeditated EMS; Q-learning; real-world driving scenario; real-time; reinforcement learning;
D O I
10.1109/itec.2019.8790482
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reinforcement learning (RL) algorithm is employed in solving energy management problem for electrified powertrain in real-world driving scenarios and the application process is streamlined. A near-global optimal control policy is articulated for the energy management system (EMS) using Q-learning algorithm which is real-time implementable. The core of the EMS is an updating optimal control policy in the form of a changing look-up table comprising near-global optimal action value function (Q-values) corresponding to all feasible state-action combinations. Using the updating control policy, the EMS can optimally decide power-split between electric machines (EMs) and internal combustion engine (ICE) in real-world driving situations.
引用
收藏
页数:6
相关论文
共 15 条
[1]   Explicit optimal control policy and its practical application for hybrid electric powertrains [J].
Ambuehl, Daniel ;
Sundstroem, E. ;
Sciarretta, Antonio ;
Guzzella, Lino .
CONTROL ENGINEERING PRACTICE, 2010, 18 (12) :1429-1439
[2]  
Bellman RichardE., 1957, Ann. Oper. Res, DOI [10.1007/BF02188548, DOI 10.1007/BF02188548]
[3]  
Emadi A., 2014, Advanced Electric Drive Vehicles
[4]  
Hester T, 2012, IEEE INT CONF ROBOT, P85, DOI 10.1109/ICRA.2012.6225072
[5]   Optimal Control of Hybrid Electric Vehicles Based on Pontryagin's Minimum Principle [J].
Kim, Namwook ;
Cha, Sukwon ;
Peng, Huei .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2011, 19 (05) :1279-1287
[6]  
Lin X, 2014, ICCAD-IEEE ACM INT, P32
[7]   Reinforcement Learning Optimized Look-Ahead Energy Management of a Parallel Hybrid Electric Vehicle [J].
Liu, Teng ;
Hu, Xiaosong ;
Li, Shengbo Eben ;
Cao, Dongpu .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2017, 22 (04) :1497-1507
[8]   Rule based energy management strategy for a series-parallel plug-in hybrid electric bus optimized by dynamic programming [J].
Peng, Jiankun ;
He, Hongwen ;
Xiong, Rui .
APPLIED ENERGY, 2017, 185 :1633-1643
[9]  
Pontryagin L. S., 2018, The mathematical theory of optimal processes
[10]   Development of Near Optimal Rule-Based Control for Plug-In Hybrid Electric Vehicles Taking into Account Drivetrain Component Losses [J].
Son, Hanho ;
Kim, Hyunsoo .
ENERGIES, 2016, 9 (06)