Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning

被引:203
|
作者
Kim, Byung-Gook [1 ]
Zhang, Yu [2 ]
van der Schaar, Mihaela [3 ]
Lee, Jang-Won [4 ]
机构
[1] Samsung Elect, Networks Business Div, Suwon 433742, South Korea
[2] Microsoft, Online Serv Div, Sunnyvale, CA 94085 USA
[3] Univ Calif Los Angeles, Dept Elect Engn, Los Angeles, CA 90095 USA
[4] Yonsei Univ, Dept Elect & Elect Engn, Seoul 03722, South Korea
基金
美国国家科学基金会; 新加坡国家研究基金会;
关键词
Smart grid; microgrid; dynamic pricing; load scheduling; demand response; electricity market; Markov decision process; reinforcement learning; DEMAND RESPONSE MANAGEMENT; ELECTRIC VEHICLES; SIDE MANAGEMENT; SMART DEVICES; UTILITY; GRIDS; DISPATCH; MARKETS;
D O I
10.1109/TSG.2015.2495145
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we study a dynamic pricing and energy consumption scheduling problem in the microgrid where the service provider acts as a broker between the utility company and customers by purchasing electric energy from the utility company and selling it to the customers. For the service provider, even though dynamic pricing is an efficient tool to manage the microgrid, the implementation of dynamic pricing is highly challenging due to the lack of the customer-side information and the various types of uncertainties in the microgrid. Similarly, the customers also face challenges in scheduling their energy consumption due to the uncertainty of the retail electricity price. In order to overcome the challenges of implementing dynamic pricing and energy consumption scheduling, we develop reinforcement learning algorithms that allow each of the service provider and the customers to learn its strategy without a priori information about the microgrid. Through numerical results, we show that the proposed reinforcement learning-based dynamic pricing algorithm can effectively work without a priori information about the system dynamics and the proposed energy consumption scheduling algorithm further reduces the system cost thanks to the learning capability of each customer.
引用
收藏
页码:2187 / 2198
页数:12
相关论文
共 50 条
  • [21] Dynamic pricing of differentiated products with incomplete information based on reinforcement learning
    Wang, Cheng
    Cui, Senbing
    Wu, Runhua
    Wang, Ziteng
    IET COLLABORATIVE INTELLIGENT MANUFACTURING, 2022, 4 (02) : 123 - 138
  • [22] Dynamic Pricing for Smart Mobile Edge Computing: A Reinforcement Learning Approach
    Chen, Shiyu
    Li, Lingxiang
    Chen, Zhi
    Li, Shaoqian
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (04) : 700 - 704
  • [23] Deep reinforcement learning based dynamic pricing for demand response considering market and supply constraints
    Fraija, Alejandro
    Henao, Nilson
    Agbossou, Kodjo
    Kelouwani, Sousso
    Fournier, Michael
    Nagarsheth, Shaival Hemant
    SMART ENERGY, 2024, 14
  • [24] Dynamic pricing based electric vehicle charging station location strategy using reinforcement learning
    Li, Yanbin
    Wang, Jiani
    Wang, Weiye
    Liu, Chang
    Li, Yun
    ENERGY, 2023, 281
  • [25] Dynamic Pricing Based on Demand Response Using Actor-Critic Agent Reinforcement Learning
    Ismail, Ahmed
    Baysal, Mustafa
    ENERGIES, 2023, 16 (14)
  • [26] Dynamic Pricing for EV Charging Stations: A Deep Reinforcement Learning Approach
    Zhao, Zhonghao
    Lee, Carman K. M.
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2022, 8 (02): : 2456 - 2468
  • [27] Demand Responsive Dynamic Pricing Framework for Prosumer Dominated Microgrids using Multiagent Reinforcement Learning
    Shojaeighadikolaei, Amin
    Ghasemi, Arman
    Jones, Kailani R.
    Bardas, Alexandru G.
    Hashemi, Morteza
    Ahmadi, Reza
    2020 52ND NORTH AMERICAN POWER SYMPOSIUM (NAPS), 2021,
  • [28] Reinforcement Learning in Dynamic Task Scheduling: A Review
    Shyalika C.
    Silva T.
    Karunananda A.
    SN Computer Science, 2020, 1 (6)
  • [29] Deep Reinforcement Learning for Dynamic Pricing of Perishable Products
    Burman, Vibhati
    Vashishtha, Rajesh Kumar
    Kumar, Rajan
    Ramanan, Sharadha
    OPTIMIZATION AND LEARNING, OLA 2021, 2021, 1443 : 132 - 143
  • [30] Reinforcement Learning for Real-Time Pricing and Scheduling Control in EV Charging Stations
    Wang, Shuoyao
    Bi, Suzhi
    Zhang, Yingjun Angela
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (02) : 849 - 859