Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning

被引:203
|
作者
Kim, Byung-Gook [1 ]
Zhang, Yu [2 ]
van der Schaar, Mihaela [3 ]
Lee, Jang-Won [4 ]
机构
[1] Samsung Elect, Networks Business Div, Suwon 433742, South Korea
[2] Microsoft, Online Serv Div, Sunnyvale, CA 94085 USA
[3] Univ Calif Los Angeles, Dept Elect Engn, Los Angeles, CA 90095 USA
[4] Yonsei Univ, Dept Elect & Elect Engn, Seoul 03722, South Korea
基金
美国国家科学基金会; 新加坡国家研究基金会;
关键词
Smart grid; microgrid; dynamic pricing; load scheduling; demand response; electricity market; Markov decision process; reinforcement learning; DEMAND RESPONSE MANAGEMENT; ELECTRIC VEHICLES; SIDE MANAGEMENT; SMART DEVICES; UTILITY; GRIDS; DISPATCH; MARKETS;
D O I
10.1109/TSG.2015.2495145
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we study a dynamic pricing and energy consumption scheduling problem in the microgrid where the service provider acts as a broker between the utility company and customers by purchasing electric energy from the utility company and selling it to the customers. For the service provider, even though dynamic pricing is an efficient tool to manage the microgrid, the implementation of dynamic pricing is highly challenging due to the lack of the customer-side information and the various types of uncertainties in the microgrid. Similarly, the customers also face challenges in scheduling their energy consumption due to the uncertainty of the retail electricity price. In order to overcome the challenges of implementing dynamic pricing and energy consumption scheduling, we develop reinforcement learning algorithms that allow each of the service provider and the customers to learn its strategy without a priori information about the microgrid. Through numerical results, we show that the proposed reinforcement learning-based dynamic pricing algorithm can effectively work without a priori information about the system dynamics and the proposed energy consumption scheduling algorithm further reduces the system cost thanks to the learning capability of each customer.
引用
收藏
页码:2187 / 2198
页数:12
相关论文
共 50 条
  • [31] Robust Dynamic Pricing in Online Markets with Reinforcement Learning
    Zhang, Bolei
    Xiao, Fu
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT II, 2022, : 648 - 655
  • [32] A reinforcement and imitation learning method for pricing strategy of electricity retailer with customers' flexibility
    Zhang, Yang
    Yang, Qingyu
    Li, Donghe
    An, Dou
    APPLIED ENERGY, 2022, 323
  • [33] Dynamic pricing of hotel rooms based on reinforcement learning with unknown demand distribution
    Zhu H.
    Zhang M.
    Tang J.
    Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice, 2023, 43 (02): : 509 - 523
  • [34] Dynamic pricing policies for interdependent perishable products or services using reinforcement learning
    Rana, Rupal
    Oliveira, Fernando S.
    EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (01) : 426 - 436
  • [35] Deep Reinforcement Learning for Dynamic Pricing and Ordering Policies in Perishable Inventory Management
    Nomura, Yusuke
    Liu, Ziang
    Nishi, Tatsushi
    APPLIED SCIENCES-BASEL, 2025, 15 (05):
  • [36] Optimal Energy Consumption Scheduling Based on Real-Time Pricing in Smart Grid
    Ma Kai
    Yao Ting
    Ma Juhai
    Guan Xinping
    2013 32ND CHINESE CONTROL CONFERENCE (CCC), 2013, : 8846 - 8850
  • [37] A Deep Reinforcement Learning Based Dynamic Pricing Algorithm in Ride-Hailing
    Shi, Bing
    Cao, Zhi
    Luo, Yikai
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT II, 2022, : 489 - 505
  • [38] An Online Reinforcement Learning Approach for Dynamic Pricing of Electric Vehicle Charging Stations
    Moghaddam, Valeh
    Yazdani, Amirmehdi
    Wang, Hai
    Parlevliet, David
    Shahnia, Farhad
    IEEE ACCESS, 2020, 8 : 130305 - 130313
  • [39] Reinforcement learning-based scheduling strategy for energy storage in microgrid
    Zhou, Kunshu
    Zhou, Kaile
    Yang, Shanlin
    JOURNAL OF ENERGY STORAGE, 2022, 51
  • [40] Reinforcement Learning Based Energy Management Algorithm for Smart Energy Buildings
    Kim, Sunyong
    Lim, Hyuk
    ENERGIES, 2018, 11 (08):