An explainable deep reinforcement learning algorithm for the parameter configuration and adjustment in the consortium blockchain

被引:4
作者
Zhai, Zhonghao [1 ]
Shen, Subin [2 ]
Mao, Yanqin [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Natl Engn Res Ctr Commun & Networking, Nanjing 210003, Jiangsu, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Sch Comp Sci, Nanjing 210003, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Blockchain; Consortium blockchain; Parameter configuration; Decision support; Optimization; Deep reinforcement learning;
D O I
10.1016/j.engappai.2023.107606
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, consortium blockchains have attracted considerable interest from the business communities and academia. To satisfy specific application requirements, appropriately configuring or adjusting the parameters is essential but challenging for developers when building the consortium blockchain. In this paper, the parameter configuration and adjustment for the consortium blockchain is transformed as a multi-objective optimization problem, and a novel explainable deep reinforcement learning (DRL) algorithm is proposed to solve the problem. On considering that existing DRL algorithms cannot be directly used in the consortium blockchain as they suffer from lacking of explainability, a causal model for configuring and adjusting the consortium blockchain's parameters is proposed and integrated into the DRL algorithm. The causal model can be used to derive causal explanations of the DRL algorithm to increase its trustworthiness. Furthermore, the causal model-based DRL (C-DRL) algorithm can perform causal inference before taking action to eliminate unreasonable exploration and improve the DRL algorithm's performance. The experimental results demonstrate the proposed algorithm provides the consortium blockchain with adaptive parameter configuration and adjustment to achieve sustainable high performance and security. Furthermore, the proposed algorithm increases the convergence speed of the vanilla algorithm by 49.3% and is more trustworthy than the vanilla DRL algorithm.
引用
收藏
页数:15
相关论文
共 50 条
[31]   Blockchain-Assisted Demonstration Cloning for Multiagent Deep Reinforcement Learning [J].
Alagha, Ahmed ;
Bentahar, Jamal ;
Otrok, Hadi ;
Singh, Shakti ;
Mizouni, Rabeb .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (05) :7710-7723
[32]   Explainable, Deep Reinforcement Learning-Based Decision Making for Operations and Maintenance [J].
Spangler, Ryan M. ;
Raeisinezhad, Mahsa ;
Cole, Daniel G. .
NUCLEAR TECHNOLOGY, 2024, 210 (12) :2331-2345
[33]   Advancements in Deep Reinforcement Learning and Inverse Reinforcement Learning for Robotic Manipulation: Toward Trustworthy, Interpretable, and Explainable Artificial Intelligence [J].
Ozalp, Recep ;
Ucar, Aysegul ;
Guzelis, Cuneyt .
IEEE ACCESS, 2024, 12 :51840-51858
[34]   A Deep Reinforcement Learning Approach for Competitive Task Assignment in Enterprise Blockchain [J].
Volpe, Gaetano ;
Mangini, Agostino Marcello ;
Fanti, Maria Pia .
IEEE ACCESS, 2023, 11 :48236-48247
[35]   Adaptive Compute Offloading Algorithm for Metasystem Based on Deep Reinforcement Learning [J].
Wang, Chunxin ;
Wang, Wensheng ;
Li, Wenjing ;
Liu, Zhu ;
Zhu, Jinhong ;
Zhang, Nan .
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (13)
[36]   Computation offloading in blockchain-enabled MCS systems: A scalable deep reinforcement learning approach [J].
Chen, Zheyi ;
Zhang, Junjie ;
Huang, Zhiqin ;
Wang, Pengfei ;
Yu, Zhengxin ;
Miao, Wang .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 153 :301-311
[37]   Permissioned Blockchain and Deep Reinforcement Learning Enabled Security and Energy Efficient Healthcare Internet of Things [J].
Liu, Long ;
Li, Zhichao .
IEEE ACCESS, 2022, 10 :53640-53651
[38]   Secure Task Offloading in Blockchain-Enabled Mobile Edge Computing With Deep Reinforcement Learning [J].
Samy, Ahmed ;
Elgendy, Ibrahim A. ;
Yu, Haining ;
Zhang, Weizhe ;
Zhang, Hongli .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04) :4872-4887
[39]   Online Deep Reinforcement Learning for Computation Offloading in Blockchain-Empowered Mobile Edge Computing [J].
Qiu, Xiaoyu ;
Liu, Luobin ;
Chen, Wuhui ;
Hong, Zicong ;
Zheng, Zibin .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (08) :8050-8062
[40]   Deep Reinforcement Learning for Optimal Resource Allocation in Blockchain-based IoV Secure Systems [J].
Xiao, Hongzhi ;
Qiu, Chen ;
Yang, Qinglin ;
Huang, Huakun ;
Wang, Junbo ;
Su, Chunhua .
2020 16TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2020), 2020, :137-144