DRL-HEMS: Deep Reinforcement Learning Agent for Demand Response in Home Energy Management Systems Considering Customers and Operators Perspectives

被引:30
作者
Amer, Aya A. [1 ]
Shaban, Khaled [2 ]
Massoud, Ahmed M. [1 ]
机构
[1] Qatar Univ, Dept Elect Engn, Doha, Qatar
[2] Qatar Univ, Comp Sci & Engn Dept, Doha, Qatar
关键词
Deep reinforcement learning; multi-objective deep reinforcement learning; demand response; home energy management; APPLIANCES; LOADS;
D O I
10.1109/TSG.2022.3198401
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the smart grid and smart homes development, different data are made available, providing a source for training algorithms, such as deep reinforcement learning (DRL), in smart grid applications. These algorithms allowed the home energy management systems (HEMSs) to deal with the computational complexities and the uncertainties at the end-user side. This article proposes a multi-objective DRL-HEMS: a data-driven solution, which is a trained DRL agent in a HEMS to optimize the energy consumption of a household with different appliances, an energy storage system, a photovoltaic system, and an electric vehicle. The proposed solution reduces the electricity cost considering the resident's comfort level and the loading level of the distribution transformer. The distribution transformer load is optimized by optimizing its loss-of-life. The performance of DRL-HEMS is evaluated using real-world data, and results show that it can optimize multiple appliances operation, reduce electricity bill cost, dissatisfaction cost, and the transformer loading condition.
引用
收藏
页码:239 / 250
页数:12
相关论文
共 35 条
  • [1] Home Energy Management System Embedded with a Multi-Objective Demand Response Optimization Model to Benefit Customers and Operators
    Amer, Aya
    Shaban, Khaled
    Gaouda, Ahmed
    Massoud, Ahmed
    [J]. ENERGIES, 2021, 14 (02)
  • [2] [Anonymous], LEAS BATT EL CAR
  • [3] [Anonymous], 2012, IEEE Standard C57.91-2011
  • [4] [Anonymous], HIST MARK DAT
  • [5] Real-Time Price-Based Demand Response Management for Residential Appliances via Stochastic Optimization and Robust Optimization
    Chen, Zhi
    Wu, Lei
    Fu, Yong
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2012, 3 (04) : 1822 - 1831
  • [6] Reinforcement Learning-Based Plug-in Electric Vehicle Charging With Forecasted Price
    Chis, Adriana
    Lunden, Jarmo
    Koivunen, Visa
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2017, 66 (05) : 3674 - 3684
  • [7] Adaptation to environmental change using reinforcement learning for robotic salamander
    Cho, Younggil
    Manzoor, Sajjad
    Choi, Youngjin
    [J]. INTELLIGENT SERVICE ROBOTICS, 2019, 12 (03) : 209 - 218
  • [8] Coordination of Electric Vehicle Charging Through Multiagent Reinforcement Learning
    Da Silva, Felipe Leno
    Nishida, Cyntia E. H.
    Roijers, Diederik M.
    Costa, Anna H. Reali
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (03) : 2347 - 2356
  • [9] Hierarchical Distributed Robust Optimization for Demand Response Services
    Diekerhof, Michael
    Peterssen, Florian
    Monti, Antonello
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (06) : 6018 - 6029
  • [10] Adaptive Control for Building Energy Management Using Reinforcement Learning
    Eller, Lukas
    Siafara, Lydia C.
    Sauter, Thilo
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2018, : 1562 - 1567