Deep Reinforcement Learning for Scenario-Based Robust Economic Dispatch Strategy in Internet of Energy

被引:34
作者
Fang, Dawei [1 ]
Guan, Xin [1 ]
Hu, Benran [2 ]
Peng, Yu [2 ]
Chen, Min [3 ,4 ]
Hwang, Kai [5 ,6 ]
机构
[1] Heilongjiang Univ, Sch Data Sci & Technol, Harbin 150080, Peoples R China
[2] State Grid Heilongjiang Elect Power Co Ltd, Harbin 150080, Peoples R China
[3] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
[4] Shenzhen Inst Artificial Intelligence & Robot Soc, Res Ctr Smart Cloud & IoT Comp, Shenzhen 518172, Peoples R China
[5] Chinese Univ Hong Kong, Sch Data Sci, Shenzhen 518172, Peoples R China
[6] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen 518172, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2021年 / 8卷 / 12期
关键词
Deep reinforcement learning; Internet of Energy; robust economic dispatch strategy; scene data generation; virtual power plant;
D O I
10.1109/JIOT.2020.3040294
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Currently, the integration of distributed energy generators through virtual power plants in the Internet of Energy is a mainstream method. The complex structure of virtual power plants and the characteristics of distributed energy make it difficult to solve the economic dispatch problems of virtual power plants. In addition, the load of a virtual power plant is unstable and uncertain and thus requires a robust economic dispatch strategy. Because the selection of the set of uncertain conditions is conservative, the traditional robust economic dispatch strategies cannot effectively reduce the cost of virtual power plants. In addition, the traditional methods for solving robust strategies cannot directly solve nonlinear and nonconvex problems. In this article, we propose a scenario-based robust economic dispatch strategy for virtual power plants, aiming to reduce the operational costs of virtual power plants. First, to reduce the conservatism of the strategy, scenario-based data augmentation is adopted for data generation. Through a generative adversarial network, a large amount of scene data are generated to extend the set of uncertain conditions. The scene data cannot only reduce the conservatism but also can be used in the determination of robust strategies. Second, deep reinforcement learning is adopted for historical data training, directly solving nonlinear and nonconvex problems to obtain a robust economic dispatch strategy. As experiments show, with the accurate generation of scene data, the proposed economic dispatch strategy is robust and effectively reduces the cost of virtual power plants.
引用
收藏
页码:9654 / 9663
页数:10
相关论文
共 50 条
  • [41] Trading Strategy in a Local Energy Market, a Deep Reinforcement Learning Approach
    Jogunola, Olamide
    Tsado, Yakubu
    Adebisi, Bamidele
    Nawaz, Raheel
    2021 IEEE ELECTRICAL POWER AND ENERGY CONFERENCE (EPEC), 2021, : 347 - 352
  • [42] Multi-agent deep reinforcement learning strategy for distributed energy
    Xi, Lei
    Sun, Mengmeng
    Zhou, Huan
    Xu, Yanchun
    Wu, Junnan
    Li, Yanying
    MEASUREMENT, 2021, 185
  • [43] A Novel Energy Management Strategy Integrating Deep Reinforcement Learning and Rule Based on Condition Identification
    Chang, Chengcheng
    Zhao, Wanzhong
    Wang, Chunyan
    Song, Yingdong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (02) : 1674 - 1688
  • [44] Energy Management Strategy in 12-Volt Electrical System Based on Deep Reinforcement Learning
    Tan, Omer
    Jerouschek, Daniel
    Kennel, Ralph
    Taskiran, Ahmet
    VEHICLES, 2022, 4 (02): : 621 - 638
  • [45] A Data-Driven Energy Management Strategy Based on Deep Reinforcement Learning for Microgrid Systems
    Gang Bao
    Rui Xu
    Cognitive Computation, 2023, 15 : 739 - 750
  • [46] Optimal operation strategy of microgrid based on deep reinforcement learning
    Zhao P.
    Wu J.
    Wang Y.
    Zhang H.
    Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2022, 42 (11): : 9 - 16
  • [47] Intercept Strategy for Maneuvering Target Based on Deep Reinforcement Learning
    Wang, Xu
    Cai, Yuanli
    Fang, Yizhong
    Deng, Yifan
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 3547 - 3552
  • [48] Ensemble Strategy Based on Deep Reinforcement Learning for Portfolio Optimization
    Su, Xiao
    Zhou, Yalan
    He, Shanshan
    Li, Xiangxia
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT IV, KSEM 2023, 2023, 14120 : 242 - 249
  • [49] Deep Reinforcement Learning Based Data-Driven Mapping Mechanism of Digital Twin for Internet of Energy
    Xu, Siyu
    Guan, Xin
    Peng, Yu
    Liu, Yang
    Cui, Chen
    Chen, Hongyang
    Ohtsuki, Tomoaki
    Han, Zhu
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (04): : 3876 - 3890
  • [50] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Chunhua Zheng
    Wei Li
    Weimin Li
    Kun Xu
    Lei Peng
    Suk Won Cha
    International Journal of Precision Engineering and Manufacturing-Green Technology, 2022, 9 : 885 - 897