Proximal policy optimization-based committee selection algorithm in blockchain-enabled mobile edge computing systems

被引:9
作者
Wu, Wenjun [1 ]
Sun, Dehao [1 ]
Jin, Kaiqi [1 ]
Sun, Yang [1 ]
Si, Pengbo [1 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Blockchains; Task analysis; Servers; Resource management; Industrial Internet of Things; Consensus algorithm; Real-time systems; blockchain; mobile edge computing; deep reinforcement learning; consensus mechanism; INTERNET; NETWORKS;
D O I
10.23919/JCC.2022.06.005
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
To cope with the low latency requirements and security issues of the emerging applications such as Internet of Vehicles (IoV) and Industrial Internet of Things (IIoT), the blockchain-enabled Mobile Edge Computing (MEC) system has received extensive attention. However, blockchain is a computing and communication intensive technology due to the complex consensus mechanisms. To facilitate the implementation of blockchain in the MEC system, this paper adopts the committee-based Practical Byzantine Fault Tolerance (PBFT) consensus algorithm and focuses on the committee selection problem. Vehicles and IIoT devices generate the transactions which are records of the application tasks. Base Stations (BSs) with MEC servers, which serve the transactions according to the wireless channel quality and the available computing resources, are blockchain nodes and candidates for committee members. The income of transaction service fees, the penalty of service delay, the decentralization of the blockchain and the communication complexity of the consensus process constitute the performance index. The committee selection problem is modeled as a Markov decision process, and the Proximal Policy Optimization (PPO) algorithm is adopted in the solution. Simulation results show that the proposed PPO-based committee selection algorithm can adapt to the system design requirements with different emphases and outperforms other comparison methods.
引用
收藏
页码:50 / 65
页数:16
相关论文
共 34 条
[1]  
3GPP, 3GPP TS 38.104 V15.0.0, NR
[2]  
3rd Generation Partnership Project
[3]  
Technical Specification Group Radio Access Network, 2019, 38901 3GPP TR
[4]  
Abraham I., 2016, ABS161202916 CORR
[5]  
Bano S, 2017, ArXiv:1711.03936
[6]  
Bin C., J BEI JING U POSTS T, V43, P140
[7]  
Biryukov A., 2017, Rep. 2017/671
[8]   Practical byzantine fault tolerance and proactive recovery [J].
Castro, M ;
Liskov, B .
ACM TRANSACTIONS ON COMPUTER SYSTEMS, 2002, 20 (04) :398-461
[9]   Cooperative Computation Offloading and Resource Allocation for Blockchain-Enabled Mobile-Edge Computing: A Deep Reinforcement Learning Approach [J].
Feng, Jie ;
Yu, F. Richard ;
Pei, Qingqi ;
Chu, Xiaoli ;
Du, Jianbo ;
Zhu, Li .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) :6214-6228
[10]  
Ferdous M.S., 2020, Blockchain consensus algorithms: A survey