Renewable Energy Maximization for Pelagic Islands Network of Microgrids Through Battery Swapping Using Deep Reinforcement Learning

被引:7
作者
Amin, M. Asim [1 ,2 ]
Suleman, Ahmad [2 ]
Waseem, Muhammad [3 ]
Iqbal, Taosif [4 ]
Aziz, Saddam [3 ]
Faiz, Muhammad Talib [3 ]
Zulfiqar, Lubaid [2 ]
Saleh, Ahmed Mohammed [5 ]
机构
[1] Univ Genoa, Dept Elect Elect Telecommun Engn & Naval Architect, I-16145 Genoa, Italy
[2] Rapid Volt PVT Ltd, Rajanpur 33500, Punjab, Pakistan
[3] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hong Kong, Peoples R China
[4] Natl Univ Sci & Technol NUST, Coll Elect & Mech Engn, Elect Engn Dept, Islamabad Islamabad460, Pakistan
[5] Univ Aden, Elect Engn Dept, Aden, Yemen
来源
IEEE ACCESS | 2023年 / 11卷
关键词
Deep reinforcement learning; pelagic island; microgrids; EMS; renewable energy; MANAGEMENT; SYSTEM; STORAGE;
D O I
10.1109/ACCESS.2023.3302895
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The study proposes an energy management system of pelagic islands network microgrids (PINMGs) based on reinforcement learning (RL) under the effect of environmental factors. Furthermore, the day-ahead standard scheduling proposes an energy-sharing framework across islands by presenting a novel method to optimize the use of renewable energy (RE). Energy sharing across islands is critical for powering isolated islands that need electricity owing to a lack of renewable energy supplies to fulfill local demand. A two-stage cooperative multi-agent deep RL solution based on deep Q-learning (DQN) with central RL and island agents (IA) spread over several islands has been presented to tackle this difficulty. Because of its in-depth learning potential, deep RL-based systems effectively train and optimize their behaviors across several epochs compared to other machine learning or traditional methods. As a result, the centralized RL-based problem of scheduling charge battery sharing from resource-rich islands (SI) to load island networks (LIN) was addressed utilizing dueling DQN. Furthermore, due to its precise tracking, the case study compared the accuracy of various DQN approaches and further scheduling based on the dueling DQN. The need for LIN is also stochastic because of variable demand and charging patterns. Hence, the simulation results, including energy scheduling through the ship, are confirmed by optimizing RE consumption via sharing across several islands, and the effectiveness of the proposed method is validated by state and action perturbation to guarantee robustness.
引用
收藏
页码:86196 / 86213
页数:18
相关论文
共 50 条
  • [41] Technologies and Practical Implementations of Air-conditioner Based Demand Response
    Waseem, Muhammad
    Lin, Zhenzhi
    Ding, Yi
    Wen, Fushuan
    Liu, Shengyuan
    Palu, Ivo
    [J]. JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2021, 9 (06) : 1395 - 1413
  • [42] Optimal GWCSO-based home appliances scheduling for demand response considering end-users comfort
    Waseem, Muhammad
    Lin, Zhenzhi
    Liu, Shengyuan
    Sajjad, Intisar Ali
    Aziz, Tarique
    [J]. ELECTRIC POWER SYSTEMS RESEARCH, 2020, 187 (187)
  • [43] Two-Stage Cooperative Intelligent Home Energy Management System for Optimal Scheduling
    Wei, Xuan
    Amin, M. Asim
    Xu, Yinliang
    Jing, Tao
    Yi, Zhongkai
    Wang, Xiaoming
    Xie, Yuguang
    Li, Duanchao
    Wang, Shenghe
    Zhai, Yue
    [J]. IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2022, 58 (04) : 5423 - 5437
  • [44] Xie H, 2017, IEEE ELECTRIF MAG, V5, P28, DOI 10.1109/MELE.2017.2685818
  • [45] Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle
    Xiong, Rui
    Cao, Jiayi
    Yu, Quanqing
    [J]. APPLIED ENERGY, 2018, 211 : 538 - 548
  • [46] Yang Z., 2022, PROTOCOL
  • [47] Transportable Energy Storage for More Resilient Distribution Systems With Multiple Microgrids
    Yao, Shuhan
    Wang, Peng
    Zhao, Tianyang
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (03) : 3331 - 3341
  • [48] Data-driven cooperative trading framework for a risk-constrained wind integrated power system considering market uncertainties
    Zhang, Rongquan
    Li, Gangqiang
    Bu, Siqi
    Aziz, Saddam
    Qureshi, Rizwan
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 144
  • [49] Joint Coordinated Beamforming and Power Splitting Ratio Optimization in MU-MISO SWIPT-Enabled HetNets: A Multi-Agent DDQN-Based Approach
    Zhang, Ruichen
    Xiong, Ke
    Lu, Yang
    Gao, Bo
    Fan, Pingyi
    Ben Letaief, Khaled
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (02) : 677 - 693
  • [50] Zhi Li, 2021, 2021 6th International Conference on Power and Renewable Energy (ICPRE), P350, DOI 10.1109/ICPRE52634.2021.9635582