Computing Assistance From the Sky: Decentralized Computation Efficiency Optimization for Air-Ground Integrated MEC Networks

被引:7
作者
Lin, Wensheng [1 ]
Ma, Hui [1 ]
Li, Lixin [1 ]
Han, Zhu [2 ,3 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710129, Shaanxi, Peoples R China
[2] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
[3] Kyung Hee Univ, Dept Comp Sci & Engn, Seoul 446701, South Korea
基金
中国国家自然科学基金;
关键词
Resource management; Task analysis; Servers; Markov processes; Games; Autonomous aerial vehicles; Delays; Multi-access edge computing; computation efficiency; multi-agent deep reinforcement learning; cooperative deep deterministic policy gradient; resource allocation;
D O I
10.1109/LWC.2022.3205503
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This letter proposes a multi-agent deep reinforcement learning (MADRL) framework for resource allocation in air-ground integrated multi-access edge computing (MEC) networks, where unmanned aerial vehicles (UAVs) provide computing services in addition to ground-computing access points (GCAPs). For maximizing the computation efficiency, the resource allocation problem is formulated as the mixed-integer programming problems. Then, we develop a cooperative deep deterministic policy gradient (CODDPG) algorithm to solve the problem via an observable Markov game. The simulation results demonstrate that the proposed algorithm outperforms centralized reinforcement learning in terms of the computation efficiency.
引用
收藏
页码:2420 / 2424
页数:5
相关论文
共 10 条
  • [1] Air-Ground Integrated Mobile Edge Networks: Architecture, Challenges, and Opportunities
    Cheng, Nan
    Xu, Wenchao
    Shi, Weisen
    Zhou, Yi
    Lu, Ning
    Zhou, Haibo
    Shen, Xuemin
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2018, 56 (08) : 26 - 32
  • [2] Deep-Learning-Based Joint Resource Scheduling Algorithms for Hybrid MEC Networks
    Jiang, Feibo
    Wang, Kezhi
    Dong, Li
    Pan, Cunhua
    Xu, Wei
    Yang, Kun
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) : 6252 - 6265
  • [3] Resource Allocation for NOMA-MEC Systems in Ultra-Dense Networks: A Learning Aided Mean-Field Game Approach
    Li, Lixin
    Cheng, Qianqian
    Tang, Xiao
    Bai, Tong
    Chen, Wei
    Ding, Zhiguo
    Han, Zhu
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (03) : 1487 - 1500
  • [4] A Survey of Multi-Access Edge Computing in 5G and Beyond: Fundamentals, Technology Integration, and State-of-the-Art
    Quoc-Viet Pham
    Fang, Fang
    Vu Nguyen Ha
    Piran, Md Jalil
    Le, Mai
    Le, Long Bao
    Hwang, Won-Joo
    Ding, Zhiguo
    [J]. IEEE ACCESS, 2020, 8 (08): : 116974 - 117017
  • [5] Mobile-Edge Computing in the Sky: Energy Optimization for Air-Ground Integrated Networks
    Shang, Bodong
    Liu, Lingjia
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (08) : 7443 - 7456
  • [6] Large-Scale Traffic Signal Control Using a Novel Multiagent Reinforcement Learning
    Wang, Xiaoqiang
    Ke, Liangjun
    Qiao, Zhimin
    Chai, Xinghua
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (01) : 174 - 187
  • [7] Energy Efficient Resource Allocation in UAV-Enabled Mobile Edge Computing Networks
    Yang, Zhaohui
    Pan, Cunhua
    Wang, Kezhi
    Shikh-Bahaei, Mohammad
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (09) : 4576 - 4589
  • [8] Computation-Efficient Offloading and Trajectory Scheduling for Multi-UAV Assisted Mobile Edge Computing
    Zhang, Jiao
    Zhou, Li
    Zhou, Fuhui
    Seet, Boon-Chong
    Zhang, Haijun
    Cai, Zhiping
    Wei, Jibo
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (02) : 2114 - 2125
  • [9] Stochastic Computation Offloading and Trajectory Scheduling for UAV-Assisted Mobile Edge Computing
    Zhang, Jiao
    Zhou, Li
    Tang, Qi
    Ngai, Edith C. -H.
    Hu, Xiping
    Zhao, Haitao
    Wei, Jibo
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02) : 3688 - 3699
  • [10] Chinese immigrant students in Hong Kong: Exploring performance and influences on their civic learning
    Zhu, Jinxin
    Kennedy, Kerry J.
    Mok, Magdalena Mo Ching
    Halse, Christine Margaret
    [J]. PSYCH JOURNAL, 2019, 8 (04) : 465 - 479