The study proposes an energy management system of pelagic islands network microgrids (PINMGs) based on reinforcement learning (RL) under the effect of environmental factors. Furthermore, the day-ahead standard scheduling proposes an energy-sharing framework across islands by presenting a novel method to optimize the use of renewable energy (RE). Energy sharing across islands is critical for powering isolated islands that need electricity owing to a lack of renewable energy supplies to fulfill local demand. A two-stage cooperative multi-agent deep RL solution based on deep Q-learning (DQN) with central RL and island agents (IA) spread over several islands has been presented to tackle this difficulty. Because of its in-depth learning potential, deep RL-based systems effectively train and optimize their behaviors across several epochs compared to other machine learning or traditional methods. As a result, the centralized RL-based problem of scheduling charge battery sharing from resource-rich islands (SI) to load island networks (LIN) was addressed utilizing dueling DQN. Furthermore, due to its precise tracking, the case study compared the accuracy of various DQN approaches and further scheduling based on the dueling DQN. The need for LIN is also stochastic because of variable demand and charging patterns. Hence, the simulation results, including energy scheduling through the ship, are confirmed by optimizing RE consumption via sharing across several islands, and the effectiveness of the proposed method is validated by state and action perturbation to guarantee robustness.
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Wei, Xuan
Amin, M. Asim
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Amin, M. Asim
Xu, Yinliang
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Xu, Yinliang
Jing, Tao
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Jing, Tao
Yi, Zhongkai
论文数: 0引用数: 0
h-index: 0
机构:
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Yi, Zhongkai
Wang, Xiaoming
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Elect Power Res Inst, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Wang, Xiaoming
Xie, Yuguang
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Xie, Yuguang
Li, Duanchao
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Li, Duanchao
Wang, Shenghe
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Wang, Shenghe
Zhai, Yue
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Elect Power Res Inst, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
机构:
Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Zhang, Ruichen
Xiong, Ke
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Xiong, Ke
Lu, Yang
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Lu, Yang
Gao, Bo
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Gao, Bo
Fan, Pingyi
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Fan, Pingyi
Ben Letaief, Khaled
论文数: 0引用数: 0
h-index: 0
机构:
Hong Kong Univ Sci & Technol HKUST, Dept Elect & Comp Engn, Hong Kong, Peoples R China
Peng Cheng Lab, Shenzhen 518055, Guangdong, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Wei, Xuan
Amin, M. Asim
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Amin, M. Asim
Xu, Yinliang
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Xu, Yinliang
Jing, Tao
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Jing, Tao
Yi, Zhongkai
论文数: 0引用数: 0
h-index: 0
机构:
Alibaba DAMO Acad, Decis Intelligent Lab, Beijing 100020, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Yi, Zhongkai
Wang, Xiaoming
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Elect Power Res Inst, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Wang, Xiaoming
Xie, Yuguang
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Xie, Yuguang
Li, Duanchao
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Li, Duanchao
Wang, Shenghe
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
Wang, Shenghe
Zhai, Yue
论文数: 0引用数: 0
h-index: 0
机构:
State Grid Anhui Elect Power Co Ltd, Elect Power Res Inst, Hefei 230051, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
机构:
Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Zhang, Ruichen
Xiong, Ke
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Xiong, Ke
Lu, Yang
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Lu, Yang
Gao, Bo
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Beijing Jiaotong Univ, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Gao, Bo
Fan, Pingyi
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
Fan, Pingyi
Ben Letaief, Khaled
论文数: 0引用数: 0
h-index: 0
机构:
Hong Kong Univ Sci & Technol HKUST, Dept Elect & Comp Engn, Hong Kong, Peoples R China
Peng Cheng Lab, Shenzhen 518055, Guangdong, Peoples R ChinaBeijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China