Joint NTP-MAPPO and SDN for Energy Trading Among Multi-Base-Station Microgrids

被引:0
作者
Yan, Ming [1 ,2 ]
Guo, Wenhao [1 ,2 ]
Zheng, Hanbo [1 ,3 ]
Qin, Tuanfa [2 ,4 ]
机构
[1] Guangxi Univ, Sch Elect Engn, Nanning 530004, Peoples R China
[2] Guangxi Univ, Guangxi Key Lab Multimedia Commun & Network Techno, Nanning 530004, Peoples R China
[3] Guangxi Univ, Key Lab Power Syst Optimizat & Energy Technol, Nanning 530004, Peoples R China
[4] Guangxi Univ, Sch Comp Elect & Informat Network Technol, Nanning 530004, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 10期
关键词
Base stations; 5G mobile communication; Renewable energy sources; Microgrids; Optimization; Energy storage; Photovoltaic systems; Base station; energy trading; microgrid; multiagent proximal policy optimization (MAPPO); software-defined networking (SDN); 5G;
D O I
10.1109/JIOT.2024.3364649
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Base station networks are a crucial component of fifth-generation communication systems. Faced with increasing traffic demands and energy consumption, connecting base stations to microgrids is essential for optimizing resource management within green base station networks and reducing their energy consumption and environmental impact. In this situation, existing methods for renewable energy base station resource management lack flexibility and intelligent optimization for energy trading involving multiple base stations. Therefore, this article proposes an energy trading method based on software-defined networking (SDN) and the nonlinear tangent perturbation-multiagent proximal policy optimization (NTP-MAPPO) algorithm that improves the economic efficiency and renewable energy utilization rate of multi-base-station microgrids. Specifically, we propose a reference scenario for energy trading within a multi-base-station microgrid based on SDN, and then model it using game theory to account for energy sharing among different base station microgrids. We express this model as a Markov decision process and solve it using the improved NTP-MAPPO algorithm, which offers an enhanced exploratory performance. Numerical analysis is subsequently used to validate the effectiveness of the proposed method.
引用
收藏
页码:18568 / 18579
页数:12
相关论文
共 33 条
[1]   Massive metamaterial system-loaded MIMO antenna array for 5G base stations [J].
Al-Bawri, Samir Salem ;
Islam, Mohammad Tariqul ;
Islam, Md Shabiul ;
Singh, Mandeep Jit ;
Alsaif, Haitham .
SCIENTIFIC REPORTS, 2022, 12 (01)
[2]   A peer-to-peer energy trading for a clustered microgrid-Game theoretical approach [J].
Ali, Liaqat ;
Muyeen, S. M. ;
Bizhani, Hamed ;
Ghosh, Arindam .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2021, 133
[3]   Renewable-Energy-Powered Cellular Base-Stations in Kuwait's Rural Areas [J].
Baidas, Mohammed W. ;
Almusailem, Mastoura F. ;
Kamel, Rashad M. ;
Alanzi, Sultan Sh. .
ENERGIES, 2022, 15 (07)
[4]   Energy management in residential microgrid using model predictive control-based reinforcement learning and Shapley value [J].
Cai, Wenqi ;
Kordabad, Arash Bahari ;
Gros, Sebastien .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
[5]   Renewable Energy Bidding Strategies Using Multiagent Q-Learning in Double-Sided Auctions [J].
Chiu, Wei-Yu ;
Hu, Chan-Wei ;
Chiu, Kun-Yen .
IEEE SYSTEMS JOURNAL, 2022, 16 (01) :985-996
[6]   Intelligent energy storage management trade-off system applied to Deep Learning predictions [J].
Cordeiro-Costas, Moises ;
Villanueva, Daniel ;
Eguia-Oller, Pablo ;
Granada-Alvarez, Enrique .
JOURNAL OF ENERGY STORAGE, 2023, 61
[7]   Carbon emissions and mitigation potentials of 5G base station in China [J].
Ding, Yangxue ;
Duan, Huabo ;
Xie, Minghui ;
Mao, Ruichang ;
Wang, JiaJia ;
Zhang, Wenbo .
RESOURCES CONSERVATION AND RECYCLING, 2022, 182
[8]   Decentralized Renewable Resource Redistribution and Optimization for Beyond 5G Small Cell Base Stations: A Machine Learning Approach [J].
Gorla, Praveen ;
Saif, Mohammad ;
Chamola, Vinay ;
Sikdar, Biplab ;
Guizani, Mohsen .
IEEE SYSTEMS JOURNAL, 2023, 17 (01) :988-999
[9]   Joint Optimization of Handover Control and Power Allocation Based on Multi-Agent Deep Reinforcement Learning [J].
Guo, Delin ;
Tang, Lan ;
Zhang, Xinggan ;
Liang, Ying-Chang .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) :13124-13138
[10]   Characterization and optimization of energy sharing performances in energy-sharing communities in Sweden, Canada and Germany [J].
Huang, Pei ;
Han, Mengjie ;
Zhang, Xingxing ;
Hussain, Syed Asad ;
Bhagat, Rohit Jayprakash ;
Kumar, Deepu Hogarehalli .
APPLIED ENERGY, 2022, 326