Digital Twin-Aided Vehicular Edge Network: A Large-Scale Model Optimization by Quantum-DRL

被引:3
作者
Paul, Anal [1 ]
Singh, Keshav [1 ]
Li, Chih-Peng [1 ]
Dobre, Octavia A. [2 ]
Duong, Trung Q. [2 ,3 ,4 ]
机构
[1] Natl Sun Yat Sen Univ, Inst Commun Engn, Kaohsiung 80424, Taiwan
[2] Mem Univ, Fac Engn & Appl Sci, St John, NF A1C 5S7, Canada
[3] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, North Ireland
[4] Kyung Hee Univ, Dept Elect Engn, Yongin 17104, South Korea
关键词
Task analysis; Computational modeling; Quantum computing; Optimization; Ultra reliable low latency communication; Edge computing; Data models; Vehicular edge computing; task offloading; ultra-reliable low-latency communication; quantum deep reinforcement learning; large model framework; long short-term memory networks; digital twin; and multi-agent systems;
D O I
10.1109/TVT.2024.3410897
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents an innovative large model framework for optimizing the task offloading efficiency in vehicular edge networks, with a focus on ultra-reliable low-latency communication. We introduce a comprehensive model that integrates quantum computing with a deep reinforcement learning (DRL) model, supported by long short-term memory (LSTM) networks and a digital twin framework. This integration is designed to address the complexities of distributed vehicular edge computing networks, targeting efficient latency, energy, and quality-of-service management. Our model utilizes the parallel processing capabilities of quantum computing to enhance the DRL algorithm, effectively handling high-dimensional decision spaces. LSTM networks provide predictive insights into future network states in a digital twin framework and ensure real-time synchronization and adaptive strategy optimization. We employ a multi-agent framework, encompassing vehicles, unmanned aerial vehicles, and base stations, each utilizing a Nash equilibrium-based strategy for optimal decision-making, supplemented by incentive and penalty functions for reward optimization. Simulation results demonstrate notable improvements in task offloading efficiency, highlighting the model's efficacy over conventional DRL models.
引用
收藏
页码:2156 / 2173
页数:18
相关论文
共 33 条
  • [1] 3GPP, 2018, Tech. Report (TR) 38.901
  • [2] A Survey on Mobility of Edge Computing Networks in IoT: State-of-the-Art, Architectures, and Challenges
    Abkenar, Forough Shirin
    Ramezani, Parisa
    Iranmanesh, Saeid
    Murali, Sarumathi
    Chulerttiyawong, Donpiti
    Wan, Xinyu
    Jamalipour, Abbas
    Raad, Raad
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2022, 24 (04): : 2329 - 2365
  • [3] RWP plus : A New Random Waypoint Model for High-Speed Mobility
    Ammar, Hussein A.
    Adve, Raviraj
    Shahbazpanahi, Shahram
    Boudreau, Gary
    Srinivas, Kothapalli Venkata
    [J]. IEEE COMMUNICATIONS LETTERS, 2021, 25 (11) : 3748 - 3752
  • [4] Quantum Deep Reinforcement Learning for Dynamic Resource Allocation in Mobile Edge Computing-Based IoT Systems
    Ansere, James Adu
    Gyamfi, Eric
    Sharma, Vishal
    Shin, Hyundong
    Dobre, Octavia A.
    Duong, Trung Q.
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 6221 - 6233
  • [5] Traffic Prediction-Assisted Federated Deep Reinforcement Learning for Service Migration in Digital Twins-Enabled MEC Networks
    Chen, Xiangyi
    Han, Guangjie
    Bi, Yuanguo
    Yuan, Zimeng
    Marina, Mahesh K.
    Liu, Yufei
    Zhao, Hai
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (10) : 3212 - 3229
  • [6] Quantum Language Model With Entanglement Embedding for Question Answering
    Chen, Yiwei
    Pan, Yu
    Dong, Daoyi
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (06) : 3467 - 3478
  • [7] DriveLLM: Charting the Path Toward Full Autonomous Driving With Large Language Models
    Cui, Yaodong
    Huang, Shucheng
    Zhong, Jiaming
    Liu, Zhenan
    Wang, Yutong
    Sun, Chen
    Li, Bai
    Wang, Xiao
    Khajepour, Amir
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 1450 - 1464
  • [8] Joint Task Offloading and Resource Allocation for Multi-Access Edge Computing Assisted by Parked and Moving Vehicles
    Fan, Wenhao
    Liu, Jie
    Hua, Mingyu
    Wu, Fan
    Liu, Yuan'an
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) : 5314 - 5330
  • [9] Precoder Feedback Schemes for Robust Interference Alignment With Bounded CSI Uncertainty
    Garg, Navneet
    Jagannadtanr, Aditya K.
    Sharma, Govind
    Ratnarajah, Tharmalingam
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2020, 6 : 407 - 425
  • [10] UAV-Enabled Mobile Edge Computing for Resource Allocation Using Cooperative Evolutionary Computation
    Goudarzi, Shidrokh
    Soleymani, Seyed Ahmad
    Wang, Wenwu
    Xiao, Pei
    [J]. IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (05) : 5134 - 5147