Deep Reinforcement Learning Based Optimization for Charging of Aggregated Electric Vehicles

被引：0
|
作者：
Zhao X. [1 ]
Hu J. [1 ]
机构：
[1] State Key Laboratory of Alternate Electrical Power System With Renewable Energy Sources, North China Electric Power University, Changping District, Beijing
来源：
Dianwang Jishu/Power System Technology | 2021年 / 45卷 / 06期
基金：
中国国家自然科学基金;
关键词：
Aggregated electric vehicles; Deep reinforcement learning; Distributed deployment; Optimization of charging strategy; TOU tariff;
D O I：
10.13335/j.1000-3673.pst.2020.1418
中图分类号：
学科分类号：
摘要：
With the popularization of electricity data acquisition systems, the application of data-driven machine learning methods has played a significant role on optimal decision-making in demand response. In this paper, based on the real-time feedback data from the charging monitoring system and TOU tariff, a deep reinforcement learning (DRL) method is proposed to optimize the charging strategy of the electric vehicles (EVs) from the perspective of aggregator. A twin delay deep deterministic policy gradient (TD3) algorithm is implemented to model the charging process of a single vehicle. By adding randomly the noises in the states of the trained agent, our model attained generalized abilities to control EV charging strategies under divergent states. With the distributed deployment of the well-trained agents, this method realizes the real-time optimization of aggregated EVs' charging strategy, which is proved with examples. © 2021, Power System Technology Press. All right reserved.
引用
收藏
页码：2319 / 2327
页数：8
相关论文
共 19 条
  • [11] QI Xianjun, LI Dongwei, JI Shuyan, A coordinated charging control strategy for electric vehicles in residential area with power limitation, Power System Technology, 40, 12, pp. 3715-3721, (2016)
  • [12] YI Tao, CHENG Xiaobin, CHEN Yaxuan, Et al., Joint optimization of charging station and energy storage economic capacity based on the effect of alternative energy storage of electric vehicle, Energy, 208, (2020)
  • [13] MOCANU E, MOCANU D C, NGUYEN P H, Et al., On-line building energy optimization using deep reinforcement learning, IEEE Transactions on Smart Grid, 10, 4, pp. 3698-3708, (2019)
  • [14] XU Xu, JIA Youwei, XU Yan, Et al., A multi-agent reinforcement learning-based data-driven method for home energy management, IEEE Transactions on Smart Grid, 11, 4, pp. 3201-3211, (2020)
  • [15] DU Mingqiu, LI Yan, WANG Biao, Et al., Deep reinforcement learning optimization method for charging control of electric vehicles, Proceedings of the CSEE, 39, 14, pp. 4042-4048, (2019)
  • [16] LI Hang, LI Guojie, WANG Keyou, Real-time dispatch strategy for electric vehicles based on deep reinforcement learning, Automation of Electric Power Systems, 44, 22, pp. 161-167, (2020)
  • [17] Fujimoto S, Hoof H, Meger D., Addressing function approximation error in actor-critic methods, International Conference on Machine Learning, pp. 1587-1596, (2018)
  • [18] THINGVAD A., Optimization, modeling and control of distributed electric vehicles for system frequency regulation, (2017)
  • [19] NG A Y, HARADA D, RUSSELL S J., Policy invariance under reward transformations: theory and application to reward shaping, Proceedings of the Sixteenth International Conference on Machine Learning, pp. 278-287, (1999)
12