Multiagent-based secure energy management for multimedia grid communication using Q-learning

被引:11
作者
Kumari, Aparna [1 ]
Tanwar, Sudeep [1 ]
机构
[1] Nirma Univ, Inst Technol, Dept Comp Sci & Engn, Ahmadabad, Gujarat, India
关键词
Demand response management; Residential energy management; Reinforcement learning; Artificial intelligence; Q-learning; DEMAND RESPONSE; OPTIMIZATION; SYSTEMS; MODEL;
D O I
10.1007/s11042-021-11491-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In smart grid infrastructure, multimedia communication plays an important role in various applications, for instance, load monitoring, automatic smart meter reading, and energy management. Energy management has gained widespread popularity with the increasing energy demand. The goal of this paper is to explore multiagent-based Reinforcement Learning (RL) for multicarrier (i.e., electricity and gas) Residential Energy Management (REM) systems with data security. It facilitates the possibility for a separate Demand Response Program (DRP) for every energy component accelerates with computational aspects of RL. This paper proposes Q-MSEM, a Q-learning-based Multiagent and Secure Energy Management scheme for the optimal solution of REM problems using RL and Ethereum Blockchain (EB) to reduce energy load and decrease energy costs. Then, Q-MSEM uses Ethereum Smart Contract (ESC) to covenants data security issues using off-chain storage, i.e., InterPlanetary File System (IPFS) to handle data storage costs issues. Experimental results disclose the effectiveness of the proposed Q-MSEM scheme in terms of reduction in load, energy cost (15.82%), and data storage cost.
引用
收藏
页码:36645 / 36665
页数:21
相关论文
共 29 条
  • [1] Multiagent Reinforcement Learning for Energy Management in Residential Buildings
    Ahrarinouri, Mehdi
    Rastegar, Mohammad
    Seifi, Ali Reza
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (01) : 659 - 666
  • [2] Bitcoin-Based Decentralized Carbon Emissions Trading Infrastructure Model
    Al Kawasmi, Enas
    Arnautovic, Edin
    Svetinovic, Davor
    [J]. SYSTEMS ENGINEERING, 2015, 18 (02) : 115 - 130
  • [3] ConsenSys, MYTHR SEC AN TOOL
  • [4] Eia, NAT GAS PRIC
  • [5] A Heuristic Home Electric Energy Management System Considering Renewable Energy Availability
    Gutierrez-Martinez, Victor J.
    Moreno-Bautista, Carlos A.
    Lozano-Garcia, Jose M.
    Pizano-Martinez, Alejandro
    Zamora-Cardenas, Enrique A.
    Gomez-Martinez, Miguel A.
    [J]. ENERGIES, 2019, 12 (04)
  • [6] Hossein F, 2018, THESIS, P1
  • [7] Chance Constrained Optimization in a Home Energy Management System
    Huang, Yantai
    Wang, Lei
    Guo, Weian
    Kang, Qi
    Wu, Qidi
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (01) : 252 - 260
  • [8] GUARDIAN: Blockchain-Based Secure Demand Response Management in Smart Grid System
    Jindal, Anish
    Aujla, Gagangeet Singh
    Kumar, Neeraj
    Villari, Massimo
    [J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2020, 13 (04) : 613 - 624
  • [9] Secure data analytics for smart grid systems in a sustainable smart city: Challenges, solutions, and future directions
    Kumari, Aparna
    Tanwar, Sudeep
    [J]. SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2020, 28
  • [10] When Blockchain Meets Smart Grid: Secure Energy Trading in Demand Response Management
    Kumari, Aparna
    Gupta, Rajesh
    Tanwar, Sudeep
    Tyagi, Sudhanshu
    Kumar, Neeraj
    [J]. IEEE NETWORK, 2020, 34 (05): : 299 - 305