Deep Reinforcement Learning Based Coalition Formation for Energy Trading in Smart Grid

被引:8
作者
Sadeghi, Mohammad [1 ]
Erol-Kantarci, Melike [1 ]
机构
[1] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON, Canada
来源
2021 IEEE 4TH 5G WORLD FORUM (5GWF 2021) | 2021年
关键词
Energy trading; machine learning; microgrid; smart grid; NETWORKS; EXCHANGE;
D O I
10.1109/5GWF52925.2021.00042
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Peer-to-peer energy trading is a promising approach to better integrate renewable energy resources, reduce customer costs and increase the reliability of the smart grid by employing microgrids and allowing them to share their surplus energy with each other using 5G-enabled communications. However, the varying nature of the generation and the demand of each microgrid impose a dynamicity and uncertainty on the system. In this paper, we address the problem of minimizing cost in the coalitional microgrid communities considering the dynamic nature of the system. We propose a deep reinforcement learning approach that helps to minimize the total cost through forming efficient coalitions. The results show 16% to 30% improvement in terms of cost minimization compared to an existing Q-learning-based scheme and a conventional coalitional game theory (CG)-based approach from the literature, respectively.
引用
收藏
页码:200 / 205
页数:6
相关论文
共 19 条
[1]   Low-Latency Communications for Community Resilience Microgrids: A Reinforcement Learning Approach [J].
Elsayed, Medhat ;
Erol-Kantarci, Melike ;
Kantarci, Burak ;
Wu, Lei ;
Li, Jie .
IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (02) :1091-1099
[2]   AI-ENABLED FUTURE WIRELESS NETWORKS Challenges, Opportunities, and Open Issues [J].
Elsayed, Medhat ;
Erol-Kantarci, Melike .
IEEE VEHICULAR TECHNOLOGY MAGAZINE, 2019, 14 (03) :70-77
[3]   Optimization of energy exchange in microgrid networks: a coalition formation approach [J].
Essayeh, Chaimaa ;
Raiss El Fenni, Mohammed ;
Dahmouni, Hamza .
PROTECTION AND CONTROL OF MODERN POWER SYSTEMS, 2019, 4 (01)
[4]  
Feng C., 2019, IEEE T POWER SYSTEMS
[5]  
Hochreiter S., 1997, Neural Computation, V9, P1735
[6]   Dynamic Residential Demand Response and Distributed Generation Management in Smart Microgrid with Hierarchical Agents [J].
Jiang, Bingnan ;
Fei, Yunsi .
PROCEEDINGS OF INTERNATIONAL CONFERENCE ON SMART GRID AND CLEAN ENERGY TECHNOLOGIES (ICSGCE 2011), 2011, 12
[7]   MACHINE LEARNING PARADIGMS FOR NEXT-GENERATION WIRELESS NETWORKS [J].
Jiang, Chunxiao ;
Zhang, Haijun ;
Ren, Yong ;
Han, Zhu ;
Chen, Kwang-Cheng ;
Hanzo, Lajos .
IEEE WIRELESS COMMUNICATIONS, 2017, 24 (02) :98-105
[8]   Coalition formation strategies for cooperative operation of multiple microgrids [J].
Lahon, Rinalini ;
Gupta, Chandra P. ;
Fernandez, Eugene .
IET GENERATION TRANSMISSION & DISTRIBUTION, 2019, 13 (16) :3661-3672
[9]   Coalitional game theory based local power exchange algorithm for networked microgrids [J].
Mei, Jie ;
Chen, Chen ;
Wang, Jianhui ;
Kirtley, James L. .
APPLIED ENERGY, 2019, 239 :133-141
[10]   Learning Automata as a Utility for Power Management in Smart Grids [J].
Misra, Sudip ;
Krishna, P. Venkata ;
Saritha, V. ;
Obaidat, Mohammad S. .
IEEE COMMUNICATIONS MAGAZINE, 2013, 51 (01) :98-104