DRL-Based V2V Computation Offloading for Blockchain-Enabled Vehicular Networks

被引:72
作者
Shi, Jinming [1 ]
Du, Jun [1 ]
Shen, Yuan [1 ]
Wang, Jian [1 ]
Yuan, Jian [1 ]
Han, Zhu [2 ,3 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
[3] Kyung Hee Univ, Dept Comp Sci & Engn, Seoul 446701, South Korea
基金
中国国家自然科学基金;
关键词
Vehicular edge computing (VEC); computation offloading; blockchain; deep reinforcement learning (DRL); DEFINED INDUSTRIAL INTERNET; RESOURCE-ALLOCATION; EDGE; SYSTEMS; THINGS; OPTIMIZATION; DESIGN;
D O I
10.1109/TMC.2022.3153346
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular edge computing (VEC) is an effective method to increase the computing capability of vehicles, where vehicles share their idle computing resources with each other. However, due to the high mobility of vehicles, it is challenging to design an optimal task allocation policy that adapts to the dynamic vehicular environment. Further, vehicular computation offloading often occurs between unfamiliar vehicles, how to motivate vehicles to share their computing resources while guaranteeing the reliability of resource allocation in task offloading is one main challenge. In this paper, we propose a blockchain-enabled VEC framework to ensure the reliability and efficiency of vehicle-to-vehicle (V2V) task offloading. Specifically, we develop a deep reinforcement learning (DRL)-based computation offloading scheme for the smart contract of blockchain, where task vehicles can offload part of computation-intensive tasks to neighboring vehicles. To ensure the security and reliability in task offloading, we evaluate the reliability of vehicles in resource allocation by blockchain. Moreover, we propose an enhanced consensus algorithm based on practical Byzantine fault tolerance (PBFT), and design a consensus nodes selection algorithm to improve the efficiency of consensus and motivate base stations to improve reliability in task allocation. Simulation results validate the effectiveness of our proposed scheme for blockchain-enabled VEC.
引用
收藏
页码:3882 / 3897
页数:16
相关论文
共 42 条
[1]   Practical byzantine fault tolerance and proactive recovery [J].
Castro, M ;
Liskov, B .
ACM TRANSACTIONS ON COMPUTER SYSTEMS, 2002, 20 (04) :398-461
[2]   Timeliness-Aware Incentive Mechanism for Vehicular Crowdsourcing in Smart Cities [J].
Chen, Xianhao ;
Zhang, Lan ;
Pang, Yawei ;
Lin, Bin ;
Fang, Yuguang .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (09) :3373-3387
[3]  
Clement Allen, 2009, P NSDI, P153
[4]   Deep Reinforcement Learning and Permissioned Blockchain for Content Caching in Vehicular Edge Computing and Networks [J].
Dai, Yueyue ;
Xu, Du ;
Zhang, Ke ;
Maharjan, Sabita ;
Zhang, Yan .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (04) :4312-4324
[5]   Machine Learning for 6G Wireless Networks: Carrying Forward Enhanced Bandwidth, Massive Access, and Ultrareliable/Low-Latency Service [J].
Du, Jun ;
Jiang, Chunxiao ;
Wang, Jian ;
Ren, Yong ;
Debbah, Merouane .
IEEE VEHICULAR TECHNOLOGY MAGAZINE, 2020, 15 (04) :122-134
[6]   Auction Design and Analysis for SDN-Based Traffic Offloading in Hybrid Satellite-Terrestrial Networks [J].
Du, Jun ;
Jiang, Chunxiao ;
Zhang, Haijun ;
Ren, Yong ;
Guizani, Mohsen .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (10) :2202-2217
[7]   Contract Design for Traffic Offloading and Resource Allocation in Heterogeneous Ultra-Dense Networks [J].
Du, Jun ;
Gelenbe, Erol ;
Jiang, Chunxiao ;
Zhang, Haijun ;
Ren, Yong .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2017, 35 (11) :2457-2467
[8]   Joint Optimization of Radio and Computational Resources Allocation in Blockchain-Enabled Mobile Edge Computing Systems [J].
Feng, Jie ;
Yu, F. Richard ;
Pei, Qingqi ;
Du, Jianbo ;
Zhu, Li .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (06) :4321-4334
[9]   Cooperative Computation Offloading and Resource Allocation for Blockchain-Enabled Mobile-Edge Computing: A Deep Reinforcement Learning Approach [J].
Feng, Jie ;
Yu, F. Richard ;
Pei, Qingqi ;
Chu, Xiaoli ;
Du, Jianbo ;
Zhu, Li .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) :6214-6228
[10]   AVE: Autonomous Vehicular Edge Computing Framework with ACO-Based Scheduling [J].
Feng, Jingyun ;
Liu, Zhi ;
Wu, Celimuge ;
Ji, Yusheng .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2017, 66 (12) :10660-10675