An explainable deep reinforcement learning algorithm for the parameter configuration and adjustment in the consortium blockchain

被引:4
作者
Zhai, Zhonghao [1 ]
Shen, Subin [2 ]
Mao, Yanqin [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Natl Engn Res Ctr Commun & Networking, Nanjing 210003, Jiangsu, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Sch Comp Sci, Nanjing 210003, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Blockchain; Consortium blockchain; Parameter configuration; Decision support; Optimization; Deep reinforcement learning;
D O I
10.1016/j.engappai.2023.107606
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, consortium blockchains have attracted considerable interest from the business communities and academia. To satisfy specific application requirements, appropriately configuring or adjusting the parameters is essential but challenging for developers when building the consortium blockchain. In this paper, the parameter configuration and adjustment for the consortium blockchain is transformed as a multi-objective optimization problem, and a novel explainable deep reinforcement learning (DRL) algorithm is proposed to solve the problem. On considering that existing DRL algorithms cannot be directly used in the consortium blockchain as they suffer from lacking of explainability, a causal model for configuring and adjusting the consortium blockchain's parameters is proposed and integrated into the DRL algorithm. The causal model can be used to derive causal explanations of the DRL algorithm to increase its trustworthiness. Furthermore, the causal model-based DRL (C-DRL) algorithm can perform causal inference before taking action to eliminate unreasonable exploration and improve the DRL algorithm's performance. The experimental results demonstrate the proposed algorithm provides the consortium blockchain with adaptive parameter configuration and adjustment to achieve sustainable high performance and security. Furthermore, the proposed algorithm increases the convergence speed of the vanilla algorithm by 49.3% and is more trustworthy than the vanilla DRL algorithm.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Intelligent Adjustment for Power System Operation Mode Based on Deep Reinforcement Learning
    Hu, Wei
    Mi, Ning
    Wu, Shuang
    Zhang, Huiling
    Hu, Zhewen
    Zhang, Lei
    IENERGY, 2024, 3 (04): : 252 - 260
  • [22] A deep reinforcement learning assisted adaptive genetic algorithm for flexible job shop scheduling
    Ma, Jian
    Gao, Weinan
    Tong, Weitian
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 149
  • [23] A Blockchain-Based Scheme for Secure Data Offloading in Healthcare With Deep Reinforcement Learning
    He, Qiang
    Feng, Zheng
    Fang, Hui
    Wang, Xingwei
    Zhao, Liang
    Yao, Yudong
    Yu, Keping
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (01) : 65 - 80
  • [24] Deep reinforcement learning approach for computation offloading in blockchain-enabled communications systems
    Tanweer Alam
    Arif Ullah
    Mohamed Benaida
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 9959 - 9972
  • [25] A Blockchain-Enabled Demand Management and Control Framework Driven by Deep Reinforcement Learning
    Ma, Rui
    Yi, Zhehan
    Xiang, Yingmeng
    Shi, Di
    Xu, Chunlei
    Wu, Haiwei
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2023, 70 (01) : 430 - 440
  • [26] Deep reinforcement learning approach for computation offloading in blockchain-enabled communications systems
    Alam, Tanweer
    Ullah, Arif
    Benaida, Mohamed
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 14 (8) : 9959 - 9972
  • [27] A Novel Deep Reinforcement Learning Based Framework for Gait Adjustment
    Li, Ang
    Chen, Jianping
    Fu, Qiming
    Wu, Hongjie
    Wang, Yunzhe
    Lu, You
    MATHEMATICS, 2023, 11 (01)
  • [28] Deep Reinforcement Learning with Dual Targeting Algorithm
    Kodama, Naoki
    Harada, Taku
    Miyazaki, Kazuteru
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [29] Deep Reinforcement Learning-Based Optimal Parameter Design of Power Converters
    Bui, Van-Hai
    Chang, Fangyuan
    Su, Wencong
    Wang, Mengqi
    Murphey, Yi Lu
    Da Silva, Felipe Leno
    Huang, Can
    Xue, Lingxiao
    Glatt, Ruben
    2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 25 - 29
  • [30] Prioritized Environment Configuration for Drone Control with Deep Reinforcement Learning
    Jang, Sooyoung
    Choi, Changbeom
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2022, 12