Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning

被引:203
|
作者
Kim, Byung-Gook [1 ]
Zhang, Yu [2 ]
van der Schaar, Mihaela [3 ]
Lee, Jang-Won [4 ]
机构
[1] Samsung Elect, Networks Business Div, Suwon 433742, South Korea
[2] Microsoft, Online Serv Div, Sunnyvale, CA 94085 USA
[3] Univ Calif Los Angeles, Dept Elect Engn, Los Angeles, CA 90095 USA
[4] Yonsei Univ, Dept Elect & Elect Engn, Seoul 03722, South Korea
基金
美国国家科学基金会; 新加坡国家研究基金会;
关键词
Smart grid; microgrid; dynamic pricing; load scheduling; demand response; electricity market; Markov decision process; reinforcement learning; DEMAND RESPONSE MANAGEMENT; ELECTRIC VEHICLES; SIDE MANAGEMENT; SMART DEVICES; UTILITY; GRIDS; DISPATCH; MARKETS;
D O I
10.1109/TSG.2015.2495145
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we study a dynamic pricing and energy consumption scheduling problem in the microgrid where the service provider acts as a broker between the utility company and customers by purchasing electric energy from the utility company and selling it to the customers. For the service provider, even though dynamic pricing is an efficient tool to manage the microgrid, the implementation of dynamic pricing is highly challenging due to the lack of the customer-side information and the various types of uncertainties in the microgrid. Similarly, the customers also face challenges in scheduling their energy consumption due to the uncertainty of the retail electricity price. In order to overcome the challenges of implementing dynamic pricing and energy consumption scheduling, we develop reinforcement learning algorithms that allow each of the service provider and the customers to learn its strategy without a priori information about the microgrid. Through numerical results, we show that the proposed reinforcement learning-based dynamic pricing algorithm can effectively work without a priori information about the system dynamics and the proposed energy consumption scheduling algorithm further reduces the system cost thanks to the learning capability of each customer.
引用
收藏
页码:2187 / 2198
页数:12
相关论文
共 50 条
  • [1] Dynamic Pricing Strategy in Electricity Trading Market Based on Reinforcement Learning
    Hu, Chunlin
    An, Dou
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 5485 - 5489
  • [2] Reinforcement Learning for Fair Dynamic Pricing
    Maestre, Roberto
    Duque, Juan
    Rubio, Alberto
    Arevalo, Juan
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2019, 868 : 120 - 135
  • [3] Duck Curve Aware Dynamic Pricing and Battery Scheduling Strategy Using Reinforcement Learning
    Watari, Daichi
    Taniguchi, Ittetsu
    Onoye, Takao
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (01) : 457 - 471
  • [4] A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach
    Lu, Renzhi
    Hong, Seung Ho
    Zhang, Xiongfeng
    APPLIED ENERGY, 2018, 220 : 220 - 230
  • [5] A Scheduling Algorithm for Appliance Energy Consumption Optimization in a Dynamic Pricing Environment
    Touhs, Hamza
    Temouden, Anas
    Khallaayoun, Ahmed
    Chraibi, Mhammed
    El Hafdaoui, Hamza
    WORLD ELECTRIC VEHICLE JOURNAL, 2024, 15 (01):
  • [6] Dynamic pricing of demand response based on elasticity transfer and reinforcement learning
    Kong, Deqian
    Kong, Xiangyu
    Xiao, Jie
    Zhang, Jian
    Li, Siwei
    Yue, Liang
    2019 22ND INTERNATIONAL CONFERENCE ON ELECTRICAL MACHINES AND SYSTEMS (ICEMS 2019), 2019, : 1846 - 1850
  • [7] A reinforcement learning based dynamic room pricing model for hotel industry
    Tuncay, Gamze
    Kaya, Kiymet
    Yilmaz, Yaren
    Yaslan, Yusuf
    Oguducu, Sule Gunduz
    INFOR, 2024, 62 (02) : 211 - 231
  • [8] Dynamic pricing under competition using reinforcement learning
    Alexander Kastius
    Rainer Schlosser
    Journal of Revenue and Pricing Management, 2022, 21 : 50 - 63
  • [9] Dynamic pricing under competition using reinforcement learning
    Kastius, Alexander
    Schlosser, Rainer
    JOURNAL OF REVENUE AND PRICING MANAGEMENT, 2022, 21 (01) : 50 - 63
  • [10] Reinforcement learning for Multi-Flight Dynamic Pricing
    Zhu, Xinghui
    Jian, Lulu
    Chen, Xin
    Zhao, Qian
    COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 193