Deep Reinforcement Learning for Scenario-Based Robust Economic Dispatch Strategy in Internet of Energy

被引:34
作者
Fang, Dawei [1 ]
Guan, Xin [1 ]
Hu, Benran [2 ]
Peng, Yu [2 ]
Chen, Min [3 ,4 ]
Hwang, Kai [5 ,6 ]
机构
[1] Heilongjiang Univ, Sch Data Sci & Technol, Harbin 150080, Peoples R China
[2] State Grid Heilongjiang Elect Power Co Ltd, Harbin 150080, Peoples R China
[3] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
[4] Shenzhen Inst Artificial Intelligence & Robot Soc, Res Ctr Smart Cloud & IoT Comp, Shenzhen 518172, Peoples R China
[5] Chinese Univ Hong Kong, Sch Data Sci, Shenzhen 518172, Peoples R China
[6] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen 518172, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2021年 / 8卷 / 12期
关键词
Deep reinforcement learning; Internet of Energy; robust economic dispatch strategy; scene data generation; virtual power plant;
D O I
10.1109/JIOT.2020.3040294
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Currently, the integration of distributed energy generators through virtual power plants in the Internet of Energy is a mainstream method. The complex structure of virtual power plants and the characteristics of distributed energy make it difficult to solve the economic dispatch problems of virtual power plants. In addition, the load of a virtual power plant is unstable and uncertain and thus requires a robust economic dispatch strategy. Because the selection of the set of uncertain conditions is conservative, the traditional robust economic dispatch strategies cannot effectively reduce the cost of virtual power plants. In addition, the traditional methods for solving robust strategies cannot directly solve nonlinear and nonconvex problems. In this article, we propose a scenario-based robust economic dispatch strategy for virtual power plants, aiming to reduce the operational costs of virtual power plants. First, to reduce the conservatism of the strategy, scenario-based data augmentation is adopted for data generation. Through a generative adversarial network, a large amount of scene data are generated to extend the set of uncertain conditions. The scene data cannot only reduce the conservatism but also can be used in the determination of robust strategies. Second, deep reinforcement learning is adopted for historical data training, directly solving nonlinear and nonconvex problems to obtain a robust economic dispatch strategy. As experiments show, with the accurate generation of scene data, the proposed economic dispatch strategy is robust and effectively reduces the cost of virtual power plants.
引用
收藏
页码:9654 / 9663
页数:10
相关论文
共 50 条
  • [31] Real-time Economic Dispatch of Thermal-Wind-Battery Hybrid Systems based on Deep Reinforcement Learning
    Yuan, Ran
    Wang, Bo
    Sun, Yeqi
    2021 INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SOCIAL INTELLIGENCE (ICCSI), 2021,
  • [32] Indirect Multi-Energy Transactions of Energy Internet With Deep Reinforcement Learning Approach
    Yang, Lingxiao
    Sun, Qiuye
    Zhang, Ning
    Li, Yushuai
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (05) : 4067 - 4077
  • [33] A robust control-theory-based exploration strategy in deep reinforcement learning for virtual network embedding
    Dandachi, Ghina
    Cerf, Sophie
    Hadjadj-Aoul, Yassine
    Outtagarts, Abdelkader
    Rutten, Eric
    COMPUTER NETWORKS, 2022, 218
  • [34] Optimal energy management strategies for energy Internet via deep reinforcement learning approach
    Hua, Haochen
    Qin, Yuchao
    Hao, Chuantong
    Cao, Junwei
    APPLIED ENERGY, 2019, 239 (598-609) : 598 - 609
  • [35] An improved energy management strategy for hybrid electric powered aircraft based on deep reinforcement learning
    He, Liaolei
    Chen, Fang
    Tian, Peidong
    Gou, Huaxing
    AEROSPACE SCIENCE AND TECHNOLOGY, 2024, 149
  • [36] A Deep Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Buses
    Zheng, Chunhua
    Li, Wei
    Li, Weimin
    Xu, Kun
    Peng, Lei
    Cha, Suk Won
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY, 2022, 9 (03) : 885 - 897
  • [37] An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning
    Han, Baohui
    Hu, Mingjie
    Lv, Shilin
    Bao, Zhejing
    Lu, Lingxia
    Yu, Miao
    2023 6TH INTERNATIONAL CONFERENCE ON RENEWABLE ENERGY AND POWER ENGINEERING, REPE 2023, 2023, : 407 - 412
  • [38] A comparative study of deep reinforcement learning based energy management strategy for hybrid electric vehicle
    Wang, Zexing
    He, Hongwen
    Peng, Jiankun
    Chen, Weiqi
    Wu, Changcheng
    Fan, Yi
    Zhou, Jiaxuan
    ENERGY CONVERSION AND MANAGEMENT, 2023, 293
  • [39] A Data-Driven Energy Management Strategy Based on Deep Reinforcement Learning for Microgrid Systems
    Bao, Gang
    Xu, Rui
    COGNITIVE COMPUTATION, 2023, 15 (02) : 739 - 750
  • [40] Indoor energy-saving strategy optimization based on deep reinforcement learning and DDPG algorithm
    Wan, Yan
    Zhai, Yujia
    Cui, Can
    Song, Dexuan
    COMPUTING, 2025, 107 (01)