Reinforcement Learning-Based Load Forecasting of Electric Vehicle Charging Station Using Q-Learning Technique

被引:142
作者
Dabbaghjamanesh, Morteza [1 ]
Moeini, Amirhossein [2 ]
Kavousi-Fard, Abdollah [3 ]
机构
[1] Univ Texas Dallas, Elect & Comp Engn Dept, Richardson, TX 75080 USA
[2] Missouri Univ Sci & Technol, Elect & Comp Engn Dept, Rolla, MO 65409 USA
[3] Shiraz Univ Technol, Dept Elect & Elect Engn, Shiraz, Iran
关键词
Electric vehicle (EV) charging stations; ensemble forecasting; machine learning; Q-learning; DEMAND; STRATEGY;
D O I
10.1109/TII.2020.2990397
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The electric vehicles' (EVs) rapid growth can potentially lead power grids to face new challenges due to load profile changes. To this end, a new method is presented to forecast the EV charging station loads with machine learning techniques. The plug-in hybrid EVs (PHEVs) charging can be categorized into three main techniques (smart, uncoordinated, and coordinated). To have a good prediction of the future PHEV loads in this article, the Q-learning technique, which is a kind of the reinforcement learning, is used for different charging scenarios. The proposed Q-learning technique improves the forecasting of the conventional artificial intelligence techniques such as the recurrent neural network and the artificial neural network. Results prove that PHEV loads can accurately be forecasted by using the Q-learning technique under three different scenarios (smart, uncoordinated, and coordinated). The simulations of three different scenarios are obtained in the Keras open source software to validate the effectiveness and advantages of the proposed Q-learning technique.
引用
收藏
页码:4229 / 4237
页数:9
相关论文
共 27 条
[1]   A Scalable Stochastic Model for the Electricity Demand of Electric and Plug-In Hybrid Vehicles [J].
Alizadeh, Mahnoosh ;
Scaglione, Anna ;
Davies, Jamie ;
Kurani, Kenneth S. .
IEEE TRANSACTIONS ON SMART GRID, 2014, 5 (02) :848-860
[2]   Optimal Integration of Plug-In Hybrid Electric Vehicles in Microgrids [J].
Chen, Changsong ;
Duan, Shanxu .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (03) :1917-1926
[3]  
Chollet F., 2015, KERAS 20 COMPUTER SO
[4]   Stochastic Modeling and Forecasting of Load Demand for Electric Bus Battery-Swap Station [J].
Dai, Qian ;
Cai, Tao ;
Duan, Shanxu ;
Zhao, Feng .
IEEE TRANSACTIONS ON POWER DELIVERY, 2014, 29 (04) :1909-1917
[5]   A Novel Ensemble Method for Electric Vehicle Power Consumption Forecasting: Application to the Spanish System [J].
Gomez-Quiles, Catalina ;
Asencio-Cortes, Gualberto ;
Gastalver-Rubio, Adolfo ;
Martinez-Alvarez, Francisco ;
Troncoso, Alicia ;
Manresa, Joan ;
Riquelme, Jose C. ;
Riquelme-Santos, Jesus M. .
IEEE ACCESS, 2019, 7 :120840-120856
[6]  
Hecht-Nielsen R., 1992, NEURAL NETWORKS PERC, P65, DOI [DOI 10.1016/B978-0-12-741252-8.50010-8, 10.1016/B978-0-12-741252-8.50010-8]
[7]   Enabling Localized Peer-to-Peer Electricity Trading Among Plug-in Hybrid Electric Vehicles Using Consortium Blockchains [J].
Kang, Jiawen ;
Yu, Rong ;
Huang, Xumin ;
Maharjan, Sabita ;
Zhang, Yan ;
Hossain, Ekram .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2017, 13 (06) :3154-3164
[8]   Distributed Control of PEV Charging Based on Energy Demand Forecast [J].
Kisacikoglu, Mithat C. ;
Erden, Fatih ;
Erdogan, Nuh .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (01) :332-341
[9]   A strategy of load leveling by charging and discharging time control of electric vehicles [J].
Koyanagi, F ;
Uriu, Y .
IEEE TRANSACTIONS ON POWER SYSTEMS, 1998, 13 (03) :1179-1184
[10]   Modeling of Plug-in Hybrid Electric Vehicle Charging Demand in Probabilistic Power Flow Calculations [J].
Li, Gan ;
Zhang, Xiao-Ping .
IEEE TRANSACTIONS ON SMART GRID, 2012, 3 (01) :492-499