An explainable deep reinforcement learning algorithm for the parameter configuration and adjustment in the consortium blockchain

被引:4
|
作者
Zhai, Zhonghao [1 ]
Shen, Subin [2 ]
Mao, Yanqin [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Natl Engn Res Ctr Commun & Networking, Nanjing 210003, Jiangsu, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Sch Comp Sci, Nanjing 210003, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Blockchain; Consortium blockchain; Parameter configuration; Decision support; Optimization; Deep reinforcement learning;
D O I
10.1016/j.engappai.2023.107606
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, consortium blockchains have attracted considerable interest from the business communities and academia. To satisfy specific application requirements, appropriately configuring or adjusting the parameters is essential but challenging for developers when building the consortium blockchain. In this paper, the parameter configuration and adjustment for the consortium blockchain is transformed as a multi-objective optimization problem, and a novel explainable deep reinforcement learning (DRL) algorithm is proposed to solve the problem. On considering that existing DRL algorithms cannot be directly used in the consortium blockchain as they suffer from lacking of explainability, a causal model for configuring and adjusting the consortium blockchain's parameters is proposed and integrated into the DRL algorithm. The causal model can be used to derive causal explanations of the DRL algorithm to increase its trustworthiness. Furthermore, the causal model-based DRL (C-DRL) algorithm can perform causal inference before taking action to eliminate unreasonable exploration and improve the DRL algorithm's performance. The experimental results demonstrate the proposed algorithm provides the consortium blockchain with adaptive parameter configuration and adjustment to achieve sustainable high performance and security. Furthermore, the proposed algorithm increases the convergence speed of the vanilla algorithm by 49.3% and is more trustworthy than the vanilla DRL algorithm.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] An Optimization Framework Based on Deep Reinforcement Learning Approaches for Prism Blockchain
    Gadiraju, Divija Swetha
    Lalitha, V.
    Aggarwal, Vaneet
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (04) : 2451 - 2461
  • [2] Prism blockchain enabled Internet of Things with deep reinforcement learning
    Gadiraju, Divija Swetha
    Aggarwal, Vaneet
    BLOCKCHAIN-RESEARCH AND APPLICATIONS, 2024, 5 (03):
  • [3] Explainable Deep Reinforcement Learning: State of the Art and Challenges
    Vouros, George A.
    ACM COMPUTING SURVEYS, 2023, 55 (05)
  • [4] Blockchain-based crowdsourced deep reinforcement learning as a service
    Alagha, Ahmed
    Otrok, Hadi
    Singh, Shakti
    Mizouni, Rabeb
    Bentahar, Jamal
    INFORMATION SCIENCES, 2024, 679
  • [5] Deep Reinforcement Learning for Resource Allocation in Blockchain-based Federated Learning
    Dai, Yueyue
    Yang, Huijiong
    Yang, Huiran
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 179 - 184
  • [6] A Hierarchy of Deep Reinforcement Learning Agents for Decision Making in Blockchain Nodes
    Abu Mallouh, Arafat
    Abuzaghleh, Omar
    Qawaqneh, Zakariya
    IEEE EUROCON 2021 - 19TH INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES, 2021, : 197 - 202
  • [7] Deep Reinforcement Learning for Resource Management in Blockchain-Enabled Federated Learning Network
    Hieu, Nguyen Quang
    Tran, The Anh
    Nguyen, Cong Luong
    Niyato, Dusit
    Kim, Dong In
    Elmroth, Erik
    IEEE Networking Letters, 2022, 4 (03): : 137 - 141
  • [8] Deep reinforcement learning for blockchain in industrial IoT: A survey
    Wu, Yulei
    Wang, Zehua
    Ma, Yuxiang
    Leung, Victor C. M.
    COMPUTER NETWORKS, 2021, 191
  • [9] FedRLChain: Secure Federated Deep Reinforcement Learning With Blockchain
    Chowdhury, Sujit
    Mukherjee, Arnab
    Halder, Raju
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (06) : 3865 - 3878
  • [10] Deep reinforcement learning assisted edge-terminal collaborative offloading algorithm of blockchain computing tasks for energy Internet
    Xu, Siya
    Liao, Boxian
    Yang, Chao
    Guo, Shaoyong
    Hu, Bo
    Zhao, Jinghong
    Jin, Lei
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2021, 131