Deep Deterministic Policy Gradient-DRL Enabled Multiphysics-Constrained Fast Charging of Lithium-Ion Battery

被引:151
作者
Wei, Zhongbao [1 ]
Quan, Zhongyi [2 ]
Wu, Jingda [1 ]
Li, Yang [3 ]
Pou, Josep [4 ]
Zhong, Hao [1 ]
机构
[1] Beijing Inst Technol, Sch Mech Engn, Natl Engn Lab Elect Vehicles, Beijing 100081, Peoples R China
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[3] Chalmers Univ Technol, Dept Elect Engn, S-41296 Gteborg, Sweden
[4] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Batteries; Computational modeling; Safety; Observers; Heating systems; Trajectory; Integrated circuit modeling; Battery health; deep deterministic policy gradient (DDPG); fast charging; lithium-ion battery (LIB); thermal safety; MODEL-PREDICTIVE CONTROL; STATE; OPTIMIZATION; MANAGEMENT;
D O I
10.1109/TIE.2021.3070514
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Fast charging is an enabling technique for the large-scale penetration of electric vehicles. This article proposes a knowledge-based, multiphysics-constrained fast charging strategy for lithium-ion battery (LIB), with a consciousness of the thermal safety and degradation. A universal algorithmic framework combining model-based state observer and a deep reinforcement learning (DRL)-based optimizer is proposed, for the first time, to provide a LIB fast charging solution. Within the DRL framework, a multiobjective optimization problem is formulated by penalizing the over-temperature and degradation. An improved environmental perceptive deep deterministic policy gradient (DDPG) algorithm with priority experience replay is exploited to tradeoff smartly the charging rapidity and the compliance of physical constraints. The proposed DDPG-DRL strategy is compared experimentally with the rule-based strategies and the state-of-the-art model predictive controller to validate its superiority in terms of charging rapidity, enforcement of LIB thermal safety and life extension, as well as the computational tractability.
引用
收藏
页码:2588 / 2598
页数:11
相关论文
共 35 条
  • [1] Fast charging technique for high power LiFePO4 batteries: A mechanistic analysis of aging
    Ansean, D.
    Dubarry, M.
    Devie, A.
    Liaw, B. Y.
    Garcia, V. M.
    Viera, J. C.
    Gonzalez, M.
    [J]. JOURNAL OF POWER SOURCES, 2016, 321 : 201 - 209
  • [2] Deep Reinforcement Learning-Based Energy Storage Arbitrage With Accurate Lithium-Ion Battery Degradation Model
    Cao, Jun
    Harrold, Dan
    Fan, Zhong
    Morstyn, Thomas
    Healey, David
    Li, Kang
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (05) : 4513 - 4521
  • [3] Reinforcement Learning-Based Plug-in Electric Vehicle Charging With Forecasted Price
    Chis, Adriana
    Lunden, Jarmo
    Koivunen, Visa
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2017, 66 (05) : 3674 - 3684
  • [4] Non-destructive fast charging algorithm of lithium-ion batteries based on the control-oriented electrochemical model
    Chu, Zhengyu
    Feng, Xuning
    Lu, Languang
    Li, Jianqiu
    Han, Xuebing
    Ouyang, Minggao
    [J]. APPLIED ENERGY, 2017, 204 : 1240 - 1250
  • [5] Reinforcement Learning-Based Load Forecasting of Electric Vehicle Charging Station Using Q-Learning Technique
    Dabbaghjamanesh, Morteza
    Moeini, Amirhossein
    Kavousi-Fard, Abdollah
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (06) : 4229 - 4237
  • [6] Battery Health Prognosis Using Brownian Motion Modeling and Particle Filtering
    Dong, Guangzhong
    Chen, Zonghai
    Wei, Jingwen
    Ling, Qiang
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2018, 65 (11) : 8646 - 8655
  • [7] Battery State-of-Health Perceptive Energy Management for Hybrid Electric Vehicles
    Ebbesen, Soren
    Elbert, Philipp
    Guzzella, Lino
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2012, 61 (07) : 2893 - 2900
  • [8] Health-Aware and User-Involved Battery Charging Management for Electric Vehicles: Linear Quadratic Strategies
    Fang, Huazhen
    Wang, Yebin
    Chen, Jian
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2017, 25 (03) : 911 - 923
  • [9] Health-Aware Multiobjective Optimal Charging Strategy With Coupled Electrochemical-Thermal-Aging Model for Lithium-Ion Battery
    Gao, Yizhao
    Zhang, Xi
    Guo, Bangjun
    Zhu, Chong
    Wiedemann, Jochen
    Wang, Lin
    Cao, Jianhua
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (05) : 3417 - 3429
  • [10] Advanced Fault Diagnosis for Lithium-Ion Battery Systems: A Review of Fault Mechanisms, Fault Features, and Diagnosis Procedures
    Hu, Xiaosong
    Zhang, Kai
    Liu, Kailong
    Lin, Xianke
    Dey, Satadru
    Onori, Simona
    [J]. IEEE INDUSTRIAL ELECTRONICS MAGAZINE, 2020, 14 (03) : 65 - 91