Optimal Computation Offloading in Collaborative LEO-IoT Enabled MEC: A Multiagent Deep Reinforcement Learning Approach

被引:48
作者
Lyu, Yifeng [1 ]
Liu, Zhi [2 ]
Fan, Rongfei [3 ]
Zhan, Cheng [4 ]
Hu, Han [1 ]
An, Jianping [3 ]
机构
[1] Beijing Inst Technol, Sch Informat & Electr, Beijing 100081, Peoples R China
[2] Univ Electrocommun, Grad Sch Informat & Engn, Tokyo 1828585, Japan
[3] Beijing Inst Technol, Sch Cyberspace Sci & Technol, Beijing 100081, Peoples R China
[4] Southwest Univ, Sch Comp & Informat Sci, Chongqing 400715, Peoples R China
来源
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING | 2023年 / 7卷 / 02期
基金
中国国家自然科学基金;
关键词
LEO-IoT; mobile-edge computing; data offloading; resource allocation; reinforcement learning; RESOURCE-ALLOCATION; MANAGEMENT; 5G; INTERNET;
D O I
10.1109/TGCN.2022.3186792
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Recently, Low Earth Orbit (LEO) satellite-based Internet of Things (LEO-IoT) becomes attractive for computation offloading in mobile-edge computing (MEC) since it can overcome terrain obstacles, such as in depopulated villages and disaster sites. However, it is extremely hard to allocate bandwidth and power resources jointly with multiple users and satellites. In this paper, we study offloading in collaborative LEO-IoT where satellites forward data from users to the MEC server, with the goal of making offloading fast and energy efficient. To achieve this goal, we first define the data offloading in collaborative LEO-IoT as an optimization problem with resource constraints. Then we formulate the optimization problem as a Partially Observable Markov Decision Processes (POMDP), which differs from the existing Markov Decision Processes (MDP) work for the offloading scenario. We further propose a novel Multi-Agent Information Broadcasting and Judging (MAIBJ) algorithm to allocate resources in a collaborative manner. Finally, extensive experiments are conducted with various configurations and the results show that MAIBJ can shorten at least 33% of transmission latency and save at least 42% of energy consumption compared with several baseline algorithms.
引用
收藏
页码:996 / 1011
页数:16
相关论文
共 42 条
[1]   Handover management in Low Earth Orbit (LEO) satellite networks [J].
Akyildiz, IF ;
Uzunalioglu, H ;
Bender, MD .
MOBILE NETWORKS & APPLICATIONS, 1999, 4 (04) :301-310
[2]   On the Bound of Energy Consumption in Cellular IoT Networks [J].
Al Homssi, Bassel ;
Al-Hourani, Akram ;
Chandrasekharan, Sathyanarayanan ;
Gomez, Karina Mabell ;
Kandeepan, Sithamparanathan .
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2020, 4 (02) :355-364
[3]  
[Anonymous], 2016, PROC 4 INT C LEARN R
[4]   Multi-Satellite Relay Transmission in 5G: Concepts, Techniques, and Challenges [J].
Bai, Lin ;
Zhu, Lina ;
Zhang, Xuejun ;
Zhang, Wei ;
Yu, Quan .
IEEE NETWORK, 2018, 32 (05) :38-44
[5]   Joint Computation Offloading and Radio Resource Allocations in Small-Cell Wireless Cellular Networks [J].
Chen, Hong ;
Zhao, Dongmei ;
Chen, Qianbin ;
Chai, Rong .
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2020, 4 (03) :745-758
[6]   Energy-Optimal Dynamic Computation Offloading for Industrial IoT in Fog Computing [J].
Chen, Siguang ;
Zheng, Yimin ;
Lu, Weifeng ;
Varadarajan, Vijayakumar ;
Wang, Kun .
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2020, 4 (02) :566-576
[7]   Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach [J].
Cheng, Nan ;
Lyu, Feng ;
Quan, Wei ;
Zhou, Conghao ;
He, Hongli ;
Shi, Weisen ;
Shen, Xuemin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (05) :1117-1129
[8]   A Comprehensive Survey on Internet of Things (IoT) Toward 5G Wireless Systems [J].
Chettri, Lalit ;
Bera, Rabindranath .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (01) :16-32
[9]   Latency and Energy Optimization for MEC Enhanced SAT-IoT Networks [J].
Cui, Gaofeng ;
Li, Xiaoyao ;
Xu, Lexi ;
Wang, Weidong .
IEEE ACCESS, 2020, 8 :55915-55926
[10]   Enabling Massive IoT Toward 6G: A Comprehensive Survey [J].
Guo, Fengxian ;
Yu, F. Richard ;
Zhang, Heli ;
Li, Xi ;
Ji, Hong ;
Leung, Victor C. M. .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (15) :11891-11915