Optimal EV Fast Charging Station Deployment Based on a Reinforcement Learning Framework

被引:15
作者
Zhao, Zhonghao [1 ]
Lee, Carman K. M. [1 ]
Ren, Jingzheng [1 ]
Tsang, Yung Po [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China
关键词
Charging stations; Anxiety disorders; Electric vehicle charging; Quality of service; Heuristic algorithms; Recurrent neural networks; Reinforcement learning; Electric vehicle; charging station deployment; reinforcement learning; recurrent neural network; quality of service;
D O I
10.1109/TITS.2023.3265517
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This study aims to determine the optimal deployment plan for EV fast charging stations in a transportation network with a limited budget. The objective of the deployment problem is to maximize the quality of service (QoS) with respect to both waiting time and range anxiety from the perspective of EV customers. With the rapid growth of the electric vehicle (EV) market penetration, state-of-the-art algorithms based on mathematical programming are limited in handling high-dimensional optimization problems adequately. Unlike previous studies, we make the first attempt to formulate the fast charging station deployment problem (FCSDP) as a finite discrete Markov decision process (MDP) in a novel reinforcement learning (RL) framework to alleviate the curse of dimensionality problem. Since creating a supervised training dataset is impractical due to the high computational complexity of the FCSDP, we propose a recurrent neural network (RNN) with an attention mechanism to learn the model parameters and determine the optimal policy in a completely unsupervised manner. Finally, numerical experiments are conducted on multiple problem sizes to evaluate the performance of the RNN-based RL framework. Simulation results show that the proposed approach outperforms the comparing algorithms in terms of solution quality and computation time.
引用
收藏
页码:8053 / 8065
页数:13
相关论文
共 40 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] A Game Approach for Charging Station Placement Based on User Preferences and Crowdedness
    Bae, Sangjun
    Jang, Inmo
    Gros, Sebastien
    Kulcsar, Balazs
    Hellgren, Jonas
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (04) : 3654 - 3669
  • [3] Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473, DOI 10.48550/ARXIV.1409.0473]
  • [4] Capacity Planning Frameworks for Electric Vehicle Charging Stations With Multiclass Customers
    Bayram, Islam Safak
    Tajer, Ali
    Abdallah, Mohamed
    Qaraqe, Khalid
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2015, 6 (04) : 1934 - 1943
  • [5] Machine learning for combinatorial optimization: A methodological tour d'horizon
    Bengio, Yoshua
    Lodi, Andrea
    Prouvost, Antoine
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2021, 290 (02) : 405 - 421
  • [6] Bhat U, 2018, An Introduction to Queueing Theory: Modeling and Analysis in applications
  • [7] Fast-Charging Station Deployment Considering Elastic Demand
    Gan, Xiaoying
    Zhang, Haoxiang
    Hang, Gai
    Qin, Zhida
    Jin, Haiming
    [J]. IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2020, 6 (01): : 158 - 169
  • [8] Gecode Team, 2021, GEC GEN CONSTR DEV E
  • [9] Gurobi Optimization LLC, 2022, GUROBI OPTIMIZER REF
  • [10] HODGSON MJ, 1990, GEOGR ANAL, V22, P270