RADiT: Resource Allocation in Digital Twin-Driven UAV-Aided Internet of Vehicle Networks

被引:27
作者
Hazarika, Bishmita [1 ]
Singh, Keshav [1 ]
Li, Chih-Peng [1 ]
Schmeink, Anke [2 ]
Tsang, Kim Fung [3 ]
机构
[1] Natl Sun Yat Sen Univ, Inst Commun Engn, Kaohsiung 804, Taiwan
[2] Rhein Westfal TH Aachen, Chair Informat Theory & Data Analyt, D-52062 Aachen, Germany
[3] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
关键词
Internet of Vehicles (IoV); deep reinforcement learning (DRL); digital twin (DT); mobile edge computing (MEC); unmanned aerial vehicles (UAVs); resource allocation; vehicle-to-vehicle (V2V); vehicle-to-roadside-unit (V2I); soft actor-critic (SAC); MEC; OPTIMIZATION; MANAGEMENT; ALGORITHM;
D O I
10.1109/JSAC.2023.3310048
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Digital twin (DT) has emerged as a promising technology for improving resource allocation decisions in Internet of Vehicles (IoV) networks. In this paper, we consider an IoV network where mobile edge computing (MEC) servers are deployed at the roadside units (RSUs). The IoV network provides ubiquitous connections even in areas uncovered by RSUs with the assistance of unmanned aerial vehicles (UAVs) which can act as a relay between RSUs and task vehicles. A virtual representation of the IoV network is established in the aerial network as DT which captures the dynamics of the entities of the physical network in real-time in order to perform efficient resource allocation for delay-intolerant tasks. We investigate an intelligent delay-sensitive task offloading scheme for the dynamic vehicular environment which provides computation resources via local execution, vehicle-to-vehicle (V2V), and vehicle-to-roadside-unit (V2I) offloading modes based on the energy consumption of the system. Moreover, we also propose a multi-network deep reinforcement learning (DRL)-based resource allocation algorithm (RADiT) in the DT-assisted network for maximizing the utility of the IoV network while optimizing the task offloading strategy. Further, we compare the performance of the proposed algorithm with and without the presence of V2V computation mode. RADiT is further evaluated by comparing it with another benchmark DRL algorithm called soft actor-critic (SAC) and a non-DRL approach called greedy. Finally, simulations are performed to demonstrate that the utility of the proposed RADiT algorithm is higher under every condition compared to its respective conditions in SAC and greedy approach. Consequently, the proposed framework jointly improves energy efficiency and reduces the overall delay of the network. The proposed algorithm with UAV relay further increases the efficiency of the network by increasing the task completion rate.
引用
收藏
页码:3369 / 3385
页数:17
相关论文
共 58 条
[1]   Multi-Agent DRL-Based Hungarian Algorithm (MADRLHA) for Task Offloading in Multi-Access Edge Computing Internet of Vehicles (IoVs) [J].
Alam, Md Zahangir ;
Jamalipour, Abbas .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) :7641-7652
[2]  
Brockman G, 2016, Arxiv, DOI [arXiv:1606.01540, DOI 10.48550/ARXIV.1606.01540]
[3]   Resource Allocation for URLLC-Oriented Two-Way UAV Relaying [J].
Cai, Yeming ;
Jiang, Xu ;
Liu, Mingqian ;
Zhao, Nan ;
Chen, Yunfei ;
Wang, Xianbin .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (03) :3344-3349
[4]   SNR Prediction with ANN for UAV Applications in IoT Networks Based on Measurements [J].
Cardoso, Caio M. M. ;
Barros, Fabricio J. B. ;
Carvalho, Joel A. R. ;
Machado, Artur A. ;
Cruz, Hugo A. O. ;
de Alcantara Neto, Miercio C. ;
Araujo, Jasmine P. L. .
SENSORS, 2022, 22 (14)
[5]  
Chen WW, 2020, IEEE INFOCOM SER, P228, DOI [10.1109/infocom41043.2020.9155397, 10.1109/INFOCOM41043.2020.9155397]
[6]  
Chen X., 2020, P IEEE VTC SPRING MA, P1
[7]   Decentralized computation offloading for multi-user mobile edge computing: a deep reinforcement learning approach [J].
Chen, Zhao ;
Wang, Xiaodong .
EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2020, 2020 (01)
[8]   Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks [J].
Dai, Yueyue ;
Zhang, Ke ;
Maharjan, Sabita ;
Zhang, Yan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) :4968-4977
[9]   Edge Intelligence-Based Ultra-Reliable and Low-Latency Communications for Digital Twin-Enabled Metaverse [J].
Dang Van Huynh ;
Khosravirad, Saeed R. ;
Masaracchia, Antonino ;
Dobre, Octavia A. ;
Duong, Trung Q. .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (08) :1733-1737
[10]   MOTO: Mobility-Aware Online Task Offloading With Adaptive Load Balancing in Small-Cell MEC [J].
Duan, Sijing ;
Lyu, Feng ;
Wu, Huaqing ;
Chen, Wenxiong ;
Lu, Huali ;
Dong, Zhe ;
Shen, Xuemin .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (01) :645-659