Real-Time Optimal Energy Management of Electrified Powertrains with Reinforcement Learning

被引:16
作者
Biswas, Atriya [1 ]
Anselma, Pier G. [2 ]
Emadi, Ali [1 ]
机构
[1] McMaster Univ, MARC, Hamilton, ON, Canada
[2] Politecn Torino, Dept Mech & Aerosp Engn DIMEAS, Turin, Italy
来源
2019 IEEE TRANSPORTATION ELECTRIFICATION CONFERENCE AND EXPO (ITEC) | 2019年
关键词
Automotive systems; electric and hybrid electric vehicles; electrified powertrains; energy management system; premeditated EMS; Q-learning; real-world driving scenario; real-time; reinforcement learning;
D O I
10.1109/itec.2019.8790482
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reinforcement learning (RL) algorithm is employed in solving energy management problem for electrified powertrain in real-world driving scenarios and the application process is streamlined. A near-global optimal control policy is articulated for the energy management system (EMS) using Q-learning algorithm which is real-time implementable. The core of the EMS is an updating optimal control policy in the form of a changing look-up table comprising near-global optimal action value function (Q-values) corresponding to all feasible state-action combinations. Using the updating control policy, the EMS can optimally decide power-split between electric machines (EMs) and internal combustion engine (ICE) in real-world driving situations.
引用
收藏
页数:6
相关论文
共 15 条
  • [1] Explicit optimal control policy and its practical application for hybrid electric powertrains
    Ambuehl, Daniel
    Sundstroem, E.
    Sciarretta, Antonio
    Guzzella, Lino
    [J]. CONTROL ENGINEERING PRACTICE, 2010, 18 (12) : 1429 - 1439
  • [2] Bellman RichardE., 1957, Ann. Oper. Res, DOI [10.1007/BF02188548, DOI 10.1007/BF02188548]
  • [3] Emadi A., 2014, Advanced Electric Drive Vehicles
  • [4] Hester T, 2012, IEEE INT CONF ROBOT, P85, DOI 10.1109/ICRA.2012.6225072
  • [5] Optimal Control of Hybrid Electric Vehicles Based on Pontryagin's Minimum Principle
    Kim, Namwook
    Cha, Sukwon
    Peng, Huei
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2011, 19 (05) : 1279 - 1287
  • [6] Lin X, 2014, ICCAD-IEEE ACM INT, P32
  • [7] Reinforcement Learning Optimized Look-Ahead Energy Management of a Parallel Hybrid Electric Vehicle
    Liu, Teng
    Hu, Xiaosong
    Li, Shengbo Eben
    Cao, Dongpu
    [J]. IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2017, 22 (04) : 1497 - 1507
  • [8] Rule based energy management strategy for a series-parallel plug-in hybrid electric bus optimized by dynamic programming
    Peng, Jiankun
    He, Hongwen
    Xiong, Rui
    [J]. APPLIED ENERGY, 2017, 185 : 1633 - 1643
  • [9] Pontryagin L. S., 2018, The mathematical theory of optimal processes
  • [10] Development of Near Optimal Rule-Based Control for Plug-In Hybrid Electric Vehicles Taking into Account Drivetrain Component Losses
    Son, Hanho
    Kim, Hyunsoo
    [J]. ENERGIES, 2016, 9 (06)