Renewable Energy Maximization for Pelagic Islands Network of Microgrids Through Battery Swapping Using Deep Reinforcement Learning

被引:7
作者
Amin, M. Asim [1 ,2 ]
Suleman, Ahmad [2 ]
Waseem, Muhammad [3 ]
Iqbal, Taosif [4 ]
Aziz, Saddam [3 ]
Faiz, Muhammad Talib [3 ]
Zulfiqar, Lubaid [2 ]
Saleh, Ahmed Mohammed [5 ]
机构
[1] Univ Genoa, Dept Elect Elect Telecommun Engn & Naval Architect, I-16145 Genoa, Italy
[2] Rapid Volt PVT Ltd, Rajanpur 33500, Punjab, Pakistan
[3] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
[4] Natl Univ Sci & Technol NUST, Coll Elect & Mech Engn, Elect Engn Dept, Islamabad Islamabad460, Pakistan
[5] Univ Aden, Elect Engn Dept, Aden, Yemen
来源
IEEE ACCESS | 2023年 / 11卷
关键词
Deep reinforcement learning; pelagic island; microgrids; EMS; renewable energy; MANAGEMENT; SYSTEM; STORAGE;
D O I
10.1109/ACCESS.2023.3302895
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The study proposes an energy management system of pelagic islands network microgrids (PINMGs) based on reinforcement learning (RL) under the effect of environmental factors. Furthermore, the day-ahead standard scheduling proposes an energy-sharing framework across islands by presenting a novel method to optimize the use of renewable energy (RE). Energy sharing across islands is critical for powering isolated islands that need electricity owing to a lack of renewable energy supplies to fulfill local demand. A two-stage cooperative multi-agent deep RL solution based on deep Q-learning (DQN) with central RL and island agents (IA) spread over several islands has been presented to tackle this difficulty. Because of its in-depth learning potential, deep RL-based systems effectively train and optimize their behaviors across several epochs compared to other machine learning or traditional methods. As a result, the centralized RL-based problem of scheduling charge battery sharing from resource-rich islands (SI) to load island networks (LIN) was addressed utilizing dueling DQN. Furthermore, due to its precise tracking, the case study compared the accuracy of various DQN approaches and further scheduling based on the dueling DQN. The need for LIN is also stochastic because of variable demand and charging patterns. Hence, the simulation results, including energy scheduling through the ship, are confirmed by optimizing RE consumption via sharing across several islands, and the effectiveness of the proposed method is validated by state and action perturbation to guarantee robustness.
引用
收藏
页码:86196 / 86213
页数:18
相关论文
共 50 条
  • [31] Including Smart Loads for Optimal Demand Response in Integrated Energy Management Systems for Isolated Microgrids
    Solanki, Bharatkumar V.
    Raghurajan, Akash
    Bhattacharya, Kankar
    Canizares, Claudio A.
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2017, 8 (04) : 1739 - 1748
  • [32] Day-Ahead Energy Management for Pelagic Island Microgrid Groups Considering Non-Integer-Hour Energy Transmission
    Sui, Quan
    Wei, Fanrong
    Wu, Chuantao
    Lin, Xiangning
    Li, Zhengtian
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (06) : 5249 - 5259
  • [33] Smart Scheduling of EVs Through Intelligent Home Energy Management Using Deep Reinforcement Learning
    Suleman, Ahmad
    Amin, M. Asim
    Fatima, Mahnoor
    Asad, Bilal
    Menghwar, Mohan
    Hashmi, Muhammad Adnan
    [J]. 2022 17TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES (ICET'22), 2022, : 18 - 24
  • [34] Energy Management of Grid Interconnected Multi-Microgrids Based on P2P Energy Exchange: A Data Driven Approach
    Thirugnanam, Kannan
    El Moursi, Mohamed Shawky
    Khadkikar, Vinod
    Zeineldin, Hatem H.
    Al Hosani, Mohamed
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2021, 36 (02) : 1546 - 1562
  • [35] United Nations, 2022, GOAL 7
  • [36] Solar irradiance forecasting based on direct explainable neural network
    Wang, Huaizhi
    Cai, Ren
    Zhou, Bin
    Aziz, Saddam
    Qin, Bin
    Voropai, Nikolai
    Gan, Lingxiao
    Barakhtenko, Evgeny
    [J]. ENERGY CONVERSION AND MANAGEMENT, 2020, 226
  • [37] Intelligent Voltage Control Method in Active Distribution Networks Based on Averaged Weighted Double Deep Q-network Algorithm
    Wang, Yangyang
    Mao, Meiqin
    Chang, Liuchen
    Hatziargyriou, Nikos D. D.
    [J]. JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2023, 11 (01) : 132 - 143
  • [38] Coordinated Energy Management of Networked Microgrids in Distribution Systems
    Wang, Zhaoyu
    Chen, Bokan
    Wang, Jianhui
    Begovic, Miroslav M.
    Chen, Chen
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2015, 6 (01) : 45 - 53
  • [39] Fuzzy compromised solution-based novel home appliances scheduling and demand response with optimal dispatch of distributed energy resources
    Waseem, Muhammad
    Lin, Zhenzhi
    Liu, Shengyuan
    Zhang, Zhi
    Aziz, Tarique
    Khan, Danish
    [J]. APPLIED ENERGY, 2021, 290
  • [40] Electrical Demand and its Flexibility in Different Energy Sectors
    Waseem, Muhammad
    Sajjad, Intisar Ali
    Haroon, Shaikh Saaqib
    Amin, Salman
    Farooq, Haroon
    Martirano, Luigi
    Napoli, Roberto
    [J]. ELECTRIC POWER COMPONENTS AND SYSTEMS, 2020, 48 (12-13) : 1339 - 1361