Joint optimization of energy trading and consensus mechanism in blockchain-empowered smart grids: a reinforcement learning approach

被引:2
作者
Wang, Ruohan [1 ]
Chen, Yunlong [1 ]
Li, Entang [2 ]
Che, Lixuan [3 ]
Xin, Hongwei [2 ]
Li, Jing [1 ]
Zhang, Xueyao [2 ]
机构
[1] State Grid Shandong Elect Power Co, Mkt Serv Ctr, Metrol Ctr, Jinan, Shandong, Peoples R China
[2] Shandong Luruan Digital Technol Co Ltd, Jinan, Shandong, Peoples R China
[3] Lixuan Che Weifang Vocat Coll, Weifang, Shandong, Peoples R China
来源
JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS | 2023年 / 12卷 / 01期
关键词
Blockchain; Smart grid; Edge computing; Resource allocation; Energy trading; RENEWABLE ENERGY; NETWORKS; COST;
D O I
10.1186/s13677-023-00498-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Under the trend of green development, the traditional fossil fuel and centralized energy management models are no longer applicable, and distributed energy systems that can efficiently utilize clean energy have become the key to research in the energy field nowadays. However, there are still many problems in distributed energy trading systems, such as user privacy protection and mutual trust in trading, how to ensure the high quality and reliability of energy services, and how to motivate energy suppliers to participate in trading. To solve these problems, this paper proposes a blockchain-based smart grid system that enables efficient energy trading and consensus optimization, enabling electricity consumers to obtain high-quality, reliable energy services and electricity suppliers to receive rich rewards, and motivating all parties to actively participate in trading to maintain the balance of the system. We propose a reputation value assessment algorithm to evaluate the reputation of electricity suppliers to ensure that electricity consumers receive quality energy services. To minimize the cost, maximize the benefit for the electricity suppliers and optimize the system, we present an algorithm based on reinforcement learning DDPG to determine the power supplier, power generation capacity, and consensus mechanism between nodes to obtain power trading rights in each round. Simulation results show that the proposed energy trading scheme has good performance in terms of rewards.
引用
收藏
页数:12
相关论文
共 44 条
[1]   Peer to Peer Distributed Energy Trading in Smart Grids: A Survey [J].
Abdella, Juhar ;
Shuaib, Khaled .
ENERGIES, 2018, 11 (06)
[2]   Peer to Peer Energy Trading with Electric Vehicles [J].
Alvaro-Hermana, R. ;
Fraile-Ardanuy, Jesus ;
Zufiria, Pedro J. ;
Knapen, Luk ;
Janssens, Davy .
IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2016, 8 (03) :33-44
[3]  
Bayram IS, 2014, 2014 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), P258, DOI 10.1109/GlobalSIP.2014.7032118
[4]   A Distributed Energy Trading Authentication Mechanism Based on a Consortium Blockchain [J].
Che, Zheng ;
Wang, Yu ;
Zhao, Juanjuan ;
Qiang, Yan ;
Ma, Yue ;
Liu, Jihua .
ENERGIES, 2019, 12 (15)
[5]  
[陈国平 Chen Guoping], 2017, [中国电机工程学报, Proceedings of the Chinese Society of Electrical Engineering], V37, P20
[6]  
Chong PHJ, 2018, 3 INT C SMARTGIFT 20, V245
[7]   Resource Pricing and Allocation in MEC Enabled Blockchain Systems: An A3C Deep Reinforcement Learning Approach [J].
Du, Jianbo ;
Cheng, Wenjie ;
Lu, Guangyue ;
Cao, Haotong ;
Chu, Xiaoli ;
Zhang, Zhicai ;
Wang, Junxuan .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (01) :33-44
[8]   MEC-Assisted Immersive VR Video Streaming Over Terahertz Wireless Networks: A Deep Reinforcement Learning Approach [J].
Du, Jianbo ;
Yu, F. Richard ;
Lu, Guangyue ;
Wang, Junxuan ;
Jiang, Jing ;
Chu, Xiaoli .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) :9517-9529
[9]   BTRES: Beta-based Trust and Reputation Evaluation System for wireless sensor networks [J].
Fang, Weidong ;
Zhang, Chuanlei ;
Shi, Zhidong ;
Zhao, Qing ;
Shan, Lianhai .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2016, 59 :88-94
[10]   Min-Max Cost Optimization for Efficient Hierarchical Federated Learning in Wireless Edge Networks [J].
Feng, Jie ;
Liu, Lei ;
Pei, Qingqi ;
Li, Keqin .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (11) :2687-2700