Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning

被引:216
作者
Kim, Byung-Gook [1 ]
Zhang, Yu [2 ]
van der Schaar, Mihaela [3 ]
Lee, Jang-Won [4 ]
机构
[1] Samsung Elect, Networks Business Div, Suwon 433742, South Korea
[2] Microsoft, Online Serv Div, Sunnyvale, CA 94085 USA
[3] Univ Calif Los Angeles, Dept Elect Engn, Los Angeles, CA 90095 USA
[4] Yonsei Univ, Dept Elect & Elect Engn, Seoul 03722, South Korea
基金
美国国家科学基金会; 新加坡国家研究基金会;
关键词
Smart grid; microgrid; dynamic pricing; load scheduling; demand response; electricity market; Markov decision process; reinforcement learning; DEMAND RESPONSE MANAGEMENT; ELECTRIC VEHICLES; SIDE MANAGEMENT; SMART DEVICES; UTILITY; GRIDS; DISPATCH; MARKETS;
D O I
10.1109/TSG.2015.2495145
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we study a dynamic pricing and energy consumption scheduling problem in the microgrid where the service provider acts as a broker between the utility company and customers by purchasing electric energy from the utility company and selling it to the customers. For the service provider, even though dynamic pricing is an efficient tool to manage the microgrid, the implementation of dynamic pricing is highly challenging due to the lack of the customer-side information and the various types of uncertainties in the microgrid. Similarly, the customers also face challenges in scheduling their energy consumption due to the uncertainty of the retail electricity price. In order to overcome the challenges of implementing dynamic pricing and energy consumption scheduling, we develop reinforcement learning algorithms that allow each of the service provider and the customers to learn its strategy without a priori information about the microgrid. Through numerical results, we show that the proposed reinforcement learning-based dynamic pricing algorithm can effectively work without a priori information about the system dynamics and the proposed energy consumption scheduling algorithm further reduces the system cost thanks to the learning capability of each customer.
引用
收藏
页码:2187 / 2198
页数:12
相关论文
共 37 条
[1]  
Albadi AH, 2007, IEEE POWER ENG SOC, P1665
[2]  
[Anonymous], OPTIMAL DEMAND RESPO
[3]  
[Anonymous], P POW SYST COMP C PS
[4]  
[Anonymous], DYN LOAD PROF CAL
[5]  
[Anonymous], 2013, IEEE PES ISGT EUR
[6]   Demand Response Management With Multiple Utility Companies: A Two-Level Game Approach [J].
Chai, Bo ;
Chen, Jiming ;
Yang, Zaiyue ;
Zhang, Yan .
IEEE TRANSACTIONS ON SMART GRID, 2014, 5 (02) :722-731
[7]  
Chen C, 2011, INT CONF ACOUST SPEE, P5956
[8]   Real-Time Demand Response Model [J].
Conejo, Antonio J. ;
Morales, Juan M. ;
Baringo, Luis .
IEEE TRANSACTIONS ON SMART GRID, 2010, 1 (03) :236-242
[9]  
Cornish Christopher John, 1989, (Ph.D. thesis
[10]  
He M, 2011, IEEE INFOCOM SER, P461, DOI 10.1109/INFCOM.2011.5935204