Quantum Deep Reinforcement Learning for Dynamic Resource Allocation in Mobile Edge Computing-Based IoT Systems

被引:9
作者
Ansere, James Adu [1 ]
Gyamfi, Eric [2 ]
Sharma, Vishal [3 ]
Shin, Hyundong [4 ]
Dobre, Octavia A. [5 ]
Duong, Trung Q. [3 ,6 ,7 ]
机构
[1] Sunyani Tech Univ, Dept Elect & Elect Engn, Sunyani, Ghana
[2] Univ Coll Dublin, Sch Comp Sci, Dublin D04 V1W8 4, Ireland
[3] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[4] Kyung Hee Univ, Dept Elect & Informat Convergence Engn, Yongin 17104, Gyeonggi Do, South Korea
[5] Mem Univ, Fac Engn & Appl Sci, St John, NF AIC 5S7, Canada
[6] Mem Univ Newfoundland, Fac Engn & Appl Sci, St John, NF A1C 5S7, Canada
[7] Kyung Hee Univ, Dept Elect Engn, Yongin 17104, Gyeonggi Do, South Korea
关键词
Quantum computing; Task analysis; Internet of Things; Heuristic algorithms; Resource management; Dynamic scheduling; Computational efficiency; quantum reinforcement learning; computation offloading; Grover's algorithm; the Internet of Things; INTERNET; THINGS;
D O I
10.1109/TWC.2023.3330868
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper exploits a quantum-empowered machine learning algorithm to enhance computation learning speed. We leverage quantum phenomena such as superposition and entanglement to work on large-scale multi-dimensional data represented by quantum states. Under stochastic behaviors and quantum uncertainty, we examine the offloading problem to maximize the computational task processing efficiency, considering the computation latency, energy consumption, and quantum network adaptability. From the Markov decision process, the paper proposes a novel quantum-empowered deep reinforcement learning (Qe-DRL) approach, combining quantum computing theory and machine learning to achieve exploration and exploitation trade-off via quantum parallelism significantly. Furthermore, we develop a modified Grover's algorithm with exponential convergence speed to provide a searching strategy for transition quantum states probabilities. Simulation results establish the effectiveness of the proposed Qe-DRL algorithm and its superior computational learning speed. Our proposed Qe-DRL algorithm outperforms other benchmarks in terms of energy efficiency performance.
引用
收藏
页码:6221 / 6233
页数:13
相关论文
共 41 条
  • [1] Optimal Computation Resource Allocation in Energy-Efficient Edge IoT Systems With Deep Reinforcement Learning
    Ansere, James Adu
    Gyamfi, Eric
    Li, Yijiu
    Shin, Hyundong
    Dobre, Octavia A.
    Hoang, Trang
    Duong, Trung Q.
    [J]. IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (04): : 2130 - 2142
  • [2] Dynamic Resource Optimization for Energy-Efficient 6G-IoT Ecosystems
    Ansere, James Adu
    Kamal, Mohsin
    Khan, Izaz Ahmad
    Aman, Muhammad Naveed
    [J]. SENSORS, 2023, 23 (10)
  • [3] Optimal Resource Allocation in Energy-Efficient Internet-of-Things Networks With Imperfect CSI
    Ansere, James Adu
    Han, Guangjie
    Liu, Li
    Peng, Yan
    Kamal, Mohsin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (06) : 5401 - 5411
  • [4] Bonaccorso G., 2018, MACHINE LEARNING ALG
  • [5] Resource Allocation and Computation Offloading for Wireless Powered Mobile Edge Computing
    Chen, Jun
    Chang, Zheng
    Guo, Wenlong
    Guo, Xijuan
    [J]. SENSORS, 2022, 22 (16)
  • [6] Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey
    Chen, Wuhui
    Qiu, Xiaoyu
    Cai, Ting
    Dai, Hong-Ning
    Zheng, Zibin
    Zhang, Yan
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2021, 23 (03): : 1659 - 1692
  • [7] Energy-Efficient Task Offloading and Resource Allocation via Deep Reinforcement Learning for Augmented Reality in Mobile Edge Networks
    Chen, Xing
    Liu, Guizhong
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (13) : 10843 - 10856
  • [8] A Survey on Learning-Based Approaches for Modeling and Classification of Human-Machine Dialog Systems
    Cui, Fuwei
    Cui, Qian
    Song, Yongduan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (04) : 1418 - 1432
  • [9] New Single-Preparation Methods for Unsupervised Quantum Machine Learning Problems
    Deville Y.
    Deville A.
    [J]. Deville, Yannick (yannick.deville@irap.omp.eu), 1600, Institute of Electrical and Electronics Engineers Inc. (02):
  • [10] Quantum-Inspired Machine Learning for 6G: Fundamentals, Security, Resource Allocations, Challenges, and Future Research Directions
    Duong, Trung Q.
    Ansere, James Adu
    Narottama, Bhaskara
    Sharma, Vishal
    Dobre, Octavia A.
    Shin, Hyundong
    [J]. IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2022, 3 : 375 - 387