Deep Reinforcement Learning-Based Method for Joint Optimization of Mobile Energy Storage Systems and Power Grid with High Renewable Energy Sources

被引:8
|
作者
Ding, Yongkang [1 ]
Chen, Xinjiang [1 ]
Wang, Jianxiao [2 ]
机构
[1] Peking Univ, Dept Ind Engn & Management, Beijing 100871, Peoples R China
[2] Peking Univ, Natl Engn Lab Big Data Anal & Applicat, Beijing 100871, Peoples R China
来源
BATTERIES-BASEL | 2023年 / 9卷 / 04期
基金
中国国家自然科学基金;
关键词
renewable energy; battery energy storage system; machine learning; deep reinforcement learning; data-driven optimization; cost minimization; TRANSPORTATION; MANAGEMENT;
D O I
10.3390/batteries9040219
中图分类号
O646 [电化学、电解、磁化学];
学科分类号
081704 ;
摘要
The joint optimization of power systems, mobile energy storage systems (MESSs), and renewable energy involves complex constraints and numerous decision variables, and it is difficult to achieve optimization quickly through the use of commercial solvers, such as Gurobi and Cplex. To address this challenge, we present an effective joint optimization approach for MESSs and power grids that consider various renewable energy sources, including wind power (WP), photovoltaic (PV) power, and hydropower. The integration of MESSs could alleviate congestion, minimize renewable energy waste, fulfill unexpected energy demands, and lower the operational costs for power networks. To model the entire system, a mixed-integer programming (MIP) model was proposed that considered both the MESSs and the power grid, with the goal of minimizing costs. Furthermore, this research proposed a highly efficient deep reinforcement learning (DRL)-based method to optimize route selection and charging/discharging operations. The efficacy of the proposed method was demonstrated through many numerical simulations.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Reinforcement learning-based optimization for power scheduling in a renewable energy connected grid
    Ebrie, Awol Seid
    Kim, Young Jin
    RENEWABLE ENERGY, 2024, 230
  • [2] Operation strategy optimization of combined cooling, heating, and power systems with energy storage and renewable energy based on deep reinforcement learning
    Ruan, Yingjun
    Liang, Zhenyu
    Qian, Fanyue
    Meng, Hua
    Gao, Yuan
    JOURNAL OF BUILDING ENGINEERING, 2023, 65
  • [3] A Deep Learning-Based Approach to Optimize Power Systems with Hybrid Renewable Energy Sources
    Dhandapani, Lakshmi
    Shinde, Sagar Bhilaji
    Wadhwa, Lalitkumar
    Hariramakrishnan, Perumal
    Padmaja, Suragani Mohini
    Gurusamy, Meena Devi
    Venkatarao, Malini Kalale
    Razia, Shaik
    ELECTRIC POWER COMPONENTS AND SYSTEMS, 2023, 51 (16) : 1740 - 1755
  • [4] Deep Reinforcement Learning-Based Distribution Network Planning Method Considering Renewable Energy
    Ma, Liang
    Si, Chenyi
    Wang, Ke
    Luo, Jinshan
    Jiang, Shigong
    Song, Yi
    ENERGIES, 2025, 18 (05)
  • [5] Deep-Learning-Based Joint Optimization of Renewable Energy Storage and Routing in Vehicular Energy Network
    Fu, Tingting
    Wang, Chaoyu
    Cheng, Nan
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07): : 6229 - 6241
  • [6] Distributed Reinforcement Learning Framework for Autonomous Optimization of Grid-Scale Energy Storage Systems in Renewable Energy Integration
    Nuvvula, Ramakrishna S. S.
    Kumar, Polamarasetty P.
    Ahammed, Syed Riyaz
    Hushein, R.
    Reddy, R. Siva Subramanyam
    Babu, Bachina Harish
    Ali, Ahmed
    12TH INTERNATIONAL CONFERENCE ON SMART GRID, ICSMARTGRID 2024, 2024, : 290 - 297
  • [7] Deep learning-based correlation analysis for probabilistic power flow considering renewable energy and energy storage
    Xia, Xiaotian
    Xiao, Liye
    Ye, Hua
    FRONTIERS IN ENERGY RESEARCH, 2024, 12
  • [8] Deep reinforcement learning-based strategy for maximizing returns from renewable energy and energy storage systems in multi-electricity markets
    Cardo-Miota, Javier
    Beltran, Hector
    Perez, Emilio
    Khadem, Shafi
    Bahloul, Mohamed
    APPLIED ENERGY, 2025, 388
  • [9] Optimization of the Operation and Maintenance of renewable energy systems by Deep Reinforcement Learning
    Pinciroli, Luca
    Baraldi, Piero
    Ballabio, Guido
    Compare, Michele
    Zio, Enrico
    RENEWABLE ENERGY, 2022, 183 : 752 - 763
  • [10] Frequency stability of the Israeli power grid with high penetration of renewable sources and energy storage systems
    Ben Yosef, Gefen
    Navon, Aviad
    Poliak, Olga
    Etzion, Naomi
    Gal, Nurit
    Belikov, Juri
    Levron, Yoash
    ENERGY REPORTS, 2021, 7 (07) : 6148 - 6161