Renewable Energy Maximization for Pelagic Islands Network of Microgrids Through Battery Swapping Using Deep Reinforcement Learning

被引:10
作者
Amin, M. Asim [1 ,2 ]
Suleman, Ahmad [2 ]
Waseem, Muhammad [3 ]
Iqbal, Taosif [4 ]
Aziz, Saddam [3 ]
Faiz, Muhammad Talib [3 ]
Zulfiqar, Lubaid [2 ]
Saleh, Ahmed Mohammed [5 ]
机构
[1] Univ Genoa, Dept Elect Elect Telecommun Engn & Naval Architect, I-16145 Genoa, Italy
[2] Rapid Volt PVT Ltd, Rajanpur 33500, Punjab, Pakistan
[3] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
[4] Natl Univ Sci & Technol NUST, Coll Elect & Mech Engn, Elect Engn Dept, Islamabad Islamabad460, Pakistan
[5] Univ Aden, Elect Engn Dept, Aden, Yemen
关键词
Deep reinforcement learning; pelagic island; microgrids; EMS; renewable energy; MANAGEMENT; SYSTEM; STORAGE;
D O I
10.1109/ACCESS.2023.3302895
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The study proposes an energy management system of pelagic islands network microgrids (PINMGs) based on reinforcement learning (RL) under the effect of environmental factors. Furthermore, the day-ahead standard scheduling proposes an energy-sharing framework across islands by presenting a novel method to optimize the use of renewable energy (RE). Energy sharing across islands is critical for powering isolated islands that need electricity owing to a lack of renewable energy supplies to fulfill local demand. A two-stage cooperative multi-agent deep RL solution based on deep Q-learning (DQN) with central RL and island agents (IA) spread over several islands has been presented to tackle this difficulty. Because of its in-depth learning potential, deep RL-based systems effectively train and optimize their behaviors across several epochs compared to other machine learning or traditional methods. As a result, the centralized RL-based problem of scheduling charge battery sharing from resource-rich islands (SI) to load island networks (LIN) was addressed utilizing dueling DQN. Furthermore, due to its precise tracking, the case study compared the accuracy of various DQN approaches and further scheduling based on the dueling DQN. The need for LIN is also stochastic because of variable demand and charging patterns. Hence, the simulation results, including energy scheduling through the ship, are confirmed by optimizing RE consumption via sharing across several islands, and the effectiveness of the proposed method is validated by state and action perturbation to guarantee robustness.
引用
收藏
页码:86196 / 86213
页数:18
相关论文
共 50 条
[41]   Technologies and Practical Implementations of Air-conditioner Based Demand Response [J].
Waseem, Muhammad ;
Lin, Zhenzhi ;
Ding, Yi ;
Wen, Fushuan ;
Liu, Shengyuan ;
Palu, Ivo .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2021, 9 (06) :1395-1413
[42]   Optimal GWCSO-based home appliances scheduling for demand response considering end-users comfort [J].
Waseem, Muhammad ;
Lin, Zhenzhi ;
Liu, Shengyuan ;
Sajjad, Intisar Ali ;
Aziz, Tarique .
ELECTRIC POWER SYSTEMS RESEARCH, 2020, 187
[43]   Two-Stage Cooperative Intelligent Home Energy Management System for Optimal Scheduling [J].
Wei, Xuan ;
Amin, M. Asim ;
Xu, Yinliang ;
Jing, Tao ;
Yi, Zhongkai ;
Wang, Xiaoming ;
Xie, Yuguang ;
Li, Duanchao ;
Wang, Shenghe ;
Zhai, Yue .
IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2022, 58 (04) :5423-5437
[44]   Microgrid development in China: A method for renewable energy and energy storage capacity configuration in a megawatt-level isolated microgrid. [J].
Xie, Hu ;
Zheng, Shu ;
Ni, Ming .
IEEE Electrification Magazine, 2017, 5 (02) :28-35
[45]   Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle [J].
Xiong, Rui ;
Cao, Jiayi ;
Yu, Quanqing .
APPLIED ENERGY, 2018, 211 :538-548
[46]  
Yang Z., 2022, PROTOCOL
[47]   Transportable Energy Storage for More Resilient Distribution Systems With Multiple Microgrids [J].
Yao, Shuhan ;
Wang, Peng ;
Zhao, Tianyang .
IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (03) :3331-3341
[48]   Data-driven cooperative trading framework for a risk-constrained wind integrated power system considering market uncertainties [J].
Zhang, Rongquan ;
Li, Gangqiang ;
Bu, Siqi ;
Aziz, Saddam ;
Qureshi, Rizwan .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 144
[49]   Joint Coordinated Beamforming and Power Splitting Ratio Optimization in MU-MISO SWIPT-Enabled HetNets: A Multi-Agent DDQN-Based Approach [J].
Zhang, Ruichen ;
Xiong, Ke ;
Lu, Yang ;
Gao, Bo ;
Fan, Pingyi ;
Ben Letaief, Khaled .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (02) :677-693
[50]  
Zhi Li, 2021, 2021 6th International Conference on Power and Renewable Energy (ICPRE), P350, DOI 10.1109/ICPRE52634.2021.9635582