Quantum Deep Reinforcement Learning for Dynamic Resource Allocation in Mobile Edge Computing-Based IoT Systems

被引:9
|
作者
Ansere, James Adu [1 ]
Gyamfi, Eric [2 ]
Sharma, Vishal [3 ]
Shin, Hyundong [4 ]
Dobre, Octavia A. [5 ]
Duong, Trung Q. [3 ,6 ,7 ]
机构
[1] Sunyani Tech Univ, Dept Elect & Elect Engn, Sunyani, Ghana
[2] Univ Coll Dublin, Sch Comp Sci, Dublin D04 V1W8 4, Ireland
[3] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[4] Kyung Hee Univ, Dept Elect & Informat Convergence Engn, Yongin 17104, Gyeonggi Do, South Korea
[5] Mem Univ, Fac Engn & Appl Sci, St John, NF AIC 5S7, Canada
[6] Mem Univ Newfoundland, Fac Engn & Appl Sci, St John, NF A1C 5S7, Canada
[7] Kyung Hee Univ, Dept Elect Engn, Yongin 17104, Gyeonggi Do, South Korea
关键词
Quantum computing; Task analysis; Internet of Things; Heuristic algorithms; Resource management; Dynamic scheduling; Computational efficiency; quantum reinforcement learning; computation offloading; Grover's algorithm; the Internet of Things; INTERNET; THINGS;
D O I
10.1109/TWC.2023.3330868
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper exploits a quantum-empowered machine learning algorithm to enhance computation learning speed. We leverage quantum phenomena such as superposition and entanglement to work on large-scale multi-dimensional data represented by quantum states. Under stochastic behaviors and quantum uncertainty, we examine the offloading problem to maximize the computational task processing efficiency, considering the computation latency, energy consumption, and quantum network adaptability. From the Markov decision process, the paper proposes a novel quantum-empowered deep reinforcement learning (Qe-DRL) approach, combining quantum computing theory and machine learning to achieve exploration and exploitation trade-off via quantum parallelism significantly. Furthermore, we develop a modified Grover's algorithm with exponential convergence speed to provide a searching strategy for transition quantum states probabilities. Simulation results establish the effectiveness of the proposed Qe-DRL algorithm and its superior computational learning speed. Our proposed Qe-DRL algorithm outperforms other benchmarks in terms of energy efficiency performance.
引用
收藏
页码:6221 / 6233
页数:13
相关论文
共 50 条
  • [31] Deep Reinforcement Learning for IoT Network Dynamic Clustering in Edge Computing
    Liu, Qingzhi
    Cheng, Long
    Ozcelebi, Tanir
    Murphy, John
    Lukkien, Johan
    2019 19TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2019, : 600 - 603
  • [32] Latency-Aware Resource Allocation for Mobile Edge Generation and Computing via Deep Reinforcement Learning
    Wu, Yinyu
    Zhang, Xuhui
    Ren, Jinke
    Xing, Huijun
    Shen, Yanyan
    Cui, Shuguang
    IEEE Networking Letters, 2024, 6 (04): : 237 - 241
  • [33] Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things
    Chen, Ying
    Liu, Zhiyong
    Zhang, Yongchao
    Wu, Yuan
    Chen, Xin
    Zhao, Lian
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) : 4925 - 4934
  • [34] Offloading and Resource Allocation With General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Yan, Jia
    Bi, Suzhi
    Zhang, Ying-Jun Angela
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (08) : 5404 - 5419
  • [35] Deep reinforcement learning-based computation offloading and resource allocation in security-aware mobile edge computing
    Ke, H. C.
    Wang, H.
    Zhao, H. W.
    Sun, W. J.
    WIRELESS NETWORKS, 2021, 27 (05) : 3357 - 3373
  • [36] Deep reinforcement learning-based computation offloading and resource allocation in security-aware mobile edge computing
    H. C. Ke
    H. Wang
    H. W. Zhao
    W. J. Sun
    Wireless Networks, 2021, 27 : 3357 - 3373
  • [37] Task Offloading and Resource Allocation Strategy Based on Deep Learning for Mobile Edge Computing
    Yu, Zijia
    Xu, Xu
    Zhou, Wei
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [38] Joint Service Migration and Resource Allocation in Edge IoT System Based on Deep Reinforcement Learning
    Liu, Fangzheng
    Yu, Hao
    Huang, Jiwei
    Taleb, Tarik
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (07) : 11341 - 11352
  • [39] Dynamic and intelligent edge server placement based on deep reinforcement learning in mobile edge computing
    Jiang, Xiaohan
    Hou, Peng
    Zhu, Hongbin
    Li, Bo
    Wang, Zongshan
    Ding, Hongwei
    AD HOC NETWORKS, 2023, 145
  • [40] Computation Offloading and Resource Allocation in Mobile Edge Computing via Reinforcement Learning
    Wang, Danfeng
    Zhao, Jian
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,