Renewable Energy Maximization for Pelagic Islands Network of Microgrids Through Battery Swapping Using Deep Reinforcement Learning

被引:10
作者
Amin, M. Asim [1 ,2 ]
Suleman, Ahmad [2 ]
Waseem, Muhammad [3 ]
Iqbal, Taosif [4 ]
Aziz, Saddam [3 ]
Faiz, Muhammad Talib [3 ]
Zulfiqar, Lubaid [2 ]
Saleh, Ahmed Mohammed [5 ]
机构
[1] Univ Genoa, Dept Elect Elect Telecommun Engn & Naval Architect, I-16145 Genoa, Italy
[2] Rapid Volt PVT Ltd, Rajanpur 33500, Punjab, Pakistan
[3] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
[4] Natl Univ Sci & Technol NUST, Coll Elect & Mech Engn, Elect Engn Dept, Islamabad Islamabad460, Pakistan
[5] Univ Aden, Elect Engn Dept, Aden, Yemen
关键词
Deep reinforcement learning; pelagic island; microgrids; EMS; renewable energy; MANAGEMENT; SYSTEM; STORAGE;
D O I
10.1109/ACCESS.2023.3302895
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The study proposes an energy management system of pelagic islands network microgrids (PINMGs) based on reinforcement learning (RL) under the effect of environmental factors. Furthermore, the day-ahead standard scheduling proposes an energy-sharing framework across islands by presenting a novel method to optimize the use of renewable energy (RE). Energy sharing across islands is critical for powering isolated islands that need electricity owing to a lack of renewable energy supplies to fulfill local demand. A two-stage cooperative multi-agent deep RL solution based on deep Q-learning (DQN) with central RL and island agents (IA) spread over several islands has been presented to tackle this difficulty. Because of its in-depth learning potential, deep RL-based systems effectively train and optimize their behaviors across several epochs compared to other machine learning or traditional methods. As a result, the centralized RL-based problem of scheduling charge battery sharing from resource-rich islands (SI) to load island networks (LIN) was addressed utilizing dueling DQN. Furthermore, due to its precise tracking, the case study compared the accuracy of various DQN approaches and further scheduling based on the dueling DQN. The need for LIN is also stochastic because of variable demand and charging patterns. Hence, the simulation results, including energy scheduling through the ship, are confirmed by optimizing RE consumption via sharing across several islands, and the effectiveness of the proposed method is validated by state and action perturbation to guarantee robustness.
引用
收藏
页码:86196 / 86213
页数:18
相关论文
共 50 条
[31]   Including Smart Loads for Optimal Demand Response in Integrated Energy Management Systems for Isolated Microgrids [J].
Solanki, Bharatkumar V. ;
Raghurajan, Akash ;
Bhattacharya, Kankar ;
Canizares, Claudio A. .
IEEE TRANSACTIONS ON SMART GRID, 2017, 8 (04) :1739-1748
[32]   Day-Ahead Energy Management for Pelagic Island Microgrid Groups Considering Non-Integer-Hour Energy Transmission [J].
Sui, Quan ;
Wei, Fanrong ;
Wu, Chuantao ;
Lin, Xiangning ;
Li, Zhengtian .
IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (06) :5249-5259
[33]   Smart Scheduling of EVs Through Intelligent Home Energy Management Using Deep Reinforcement Learning [J].
Suleman, Ahmad ;
Amin, M. Asim ;
Fatima, Mahnoor ;
Asad, Bilal ;
Menghwar, Mohan ;
Hashmi, Muhammad Adnan .
2022 17TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES (ICET'22), 2022, :18-24
[34]   Energy Management of Grid Interconnected Multi-Microgrids Based on P2P Energy Exchange: A Data Driven Approach [J].
Thirugnanam, Kannan ;
El Moursi, Mohamed Shawky ;
Khadkikar, Vinod ;
Zeineldin, Hatem H. ;
Al Hosani, Mohamed .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2021, 36 (02) :1546-1562
[35]  
United Nations, 2022, GOAL 7
[36]   Solar irradiance forecasting based on direct explainable neural network [J].
Wang, Huaizhi ;
Cai, Ren ;
Zhou, Bin ;
Aziz, Saddam ;
Qin, Bin ;
Voropai, Nikolai ;
Gan, Lingxiao ;
Barakhtenko, Evgeny .
ENERGY CONVERSION AND MANAGEMENT, 2020, 226
[37]   Intelligent Voltage Control Method in Active Distribution Networks Based on Averaged Weighted Double Deep Q-network Algorithm [J].
Wang, Yangyang ;
Mao, Meiqin ;
Chang, Liuchen ;
Hatziargyriou, Nikos D. D. .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2023, 11 (01) :132-143
[38]   Coordinated Energy Management of Networked Microgrids in Distribution Systems [J].
Wang, Zhaoyu ;
Chen, Bokan ;
Wang, Jianhui ;
Begovic, Miroslav M. ;
Chen, Chen .
IEEE TRANSACTIONS ON SMART GRID, 2015, 6 (01) :45-53
[39]   Fuzzy compromised solution-based novel home appliances scheduling and demand response with optimal dispatch of distributed energy resources [J].
Waseem, Muhammad ;
Lin, Zhenzhi ;
Liu, Shengyuan ;
Zhang, Zhi ;
Aziz, Tarique ;
Khan, Danish .
APPLIED ENERGY, 2021, 290
[40]   Electrical Demand and its Flexibility in Different Energy Sectors [J].
Waseem, Muhammad ;
Sajjad, Intisar Ali ;
Haroon, Shaikh Saaqib ;
Amin, Salman ;
Farooq, Haroon ;
Martirano, Luigi ;
Napoli, Roberto .
ELECTRIC POWER COMPONENTS AND SYSTEMS, 2020, 48 (12-13) :1339-1361