Energy-efficient UAV-enabled computation offloading for industrial internet of things: a deep reinforcement learning approach
被引:7
作者:
Shi, Shuo
论文数: 0引用数: 0
h-index: 0
机构:
Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
Peng Cheng Lab, Shenzhen 518055, Peoples R ChinaHarbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
Shi, Shuo
[1
,3
]
Wang, Meng
论文数: 0引用数: 0
h-index: 0
机构:
Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R ChinaHarbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
Wang, Meng
[1
]
Gu, Shushi
论文数: 0引用数: 0
h-index: 0
机构:
Harbin Inst Technol Shenzhen, Sch Elect & Informat Engn, Shenzhen 518055, Peoples R China
Peng Cheng Lab, Shenzhen 518055, Peoples R ChinaHarbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
Gu, Shushi
[2
,3
]
Zheng, Zhong
论文数: 0引用数: 0
h-index: 0
机构:
Int Innovat Inst HIT Huizhou, Huizhou 516000, Guangdong, Peoples R ChinaHarbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
Zheng, Zhong
[4
]
机构:
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[2] Harbin Inst Technol Shenzhen, Sch Elect & Informat Engn, Shenzhen 518055, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[4] Int Innovat Inst HIT Huizhou, Huizhou 516000, Guangdong, Peoples R China
Energy efficiency;
Deep reinforcement learning;
Computation offloading;
Mobile edge computing;
Unmanned aerial vehicles;
EDGE;
WIRELESS;
D O I:
10.1007/s11276-021-02789-7
中图分类号:
TP [自动化技术、计算机技术];
学科分类号:
0812 ;
摘要:
Industrial Internet of Things (IIoT) has been envisioned as a killer application of 5G and beyond. However, due to the shortness of computation ablility and batery capacity, it is challenging for IIoT devices to process latency-sensitive and resource-sensitive tasks. Moblie Edge Computing (MEC), as a promising paradigm for handling tasks with high quality of service (QoS) requirement and for energy-constrained IIoT devices, allows IIoT devices to offload their tasks to MEC servers, which can significantly reduce the task process delay and energy consumptions. However, the deployment of the MEC servers rely heavily on communication infrastructure, which greatly reduce the flexibility. Toward this end, in this paper, we consider multiple Unmanned Aerial Vehicles (UAV) eqqipped with transceivers as aerial MEC servers to provide IIoT devices computation offloading opportunities due to their high controbility. IIoT devices can choose to offload the tasks to UAVs through air-ground links, or to offload the tasks to the remote cloud center through ground cellular network, or to process the tasks locally. We formulate the multi-UAV-Enabled computation offloading problem as a mixed integer non-linear programming (MINLP) problem and prove its NP-hardness. To obtain the energy-efficient and low complexity solution, we propose an intelligent computation offloading algorithm called multi-agent deep Q-learning with stochastic prioritized replay (MDSPR). Numerical results show that the proposed MDSPR converges fast and outperforms the benchmark algorithms, including random method, deep Q-learning method and double deep Q-learning method in terms of energy efficiency and task successful rate.
机构:
China Acad Informat & Commun Technol, East China Inst Telecommun, Shanghai 200001, Peoples R ChinaUCL, Dept Elect & Elect Engn, London WC1E 7JE, England
机构:
Nanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
Lu, Haodong
;
He, Xiaoming
论文数: 0引用数: 0
h-index: 0
机构:
Hohai Univ, Coll Comp & Informat, Nanjing 210003, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
He, Xiaoming
;
Du, Miao
论文数: 0引用数: 0
h-index: 0
机构:
Nanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
Du, Miao
;
Ruan, Xiukai
论文数: 0引用数: 0
h-index: 0
机构:
Wenzhou Univ, Natl Local Joint Engn Lab Digitalized Elect Desig, Wenzhou 325035, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
Ruan, Xiukai
;
Sun, Yanfei
论文数: 0引用数: 0
h-index: 0
机构:
Nanjing Univ Posts & Telecommun, Sch Automat, Nanjing 210003, Peoples R China
Nanjing Univ Posts & Telecommun, Sch Artificial Intelligence, Nanjing 210003, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
Sun, Yanfei
;
Wang, Kun
论文数: 0引用数: 0
h-index: 0
机构:
Univ Calif Los Angeles, Dept Elect & Comp Engn, Los Angeles, CA 90095 USANanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
机构:
China Acad Informat & Commun Technol, East China Inst Telecommun, Shanghai 200001, Peoples R ChinaUCL, Dept Elect & Elect Engn, London WC1E 7JE, England
机构:
Nanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
Lu, Haodong
;
He, Xiaoming
论文数: 0引用数: 0
h-index: 0
机构:
Hohai Univ, Coll Comp & Informat, Nanjing 210003, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
He, Xiaoming
;
Du, Miao
论文数: 0引用数: 0
h-index: 0
机构:
Nanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
Du, Miao
;
Ruan, Xiukai
论文数: 0引用数: 0
h-index: 0
机构:
Wenzhou Univ, Natl Local Joint Engn Lab Digitalized Elect Desig, Wenzhou 325035, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
Ruan, Xiukai
;
Sun, Yanfei
论文数: 0引用数: 0
h-index: 0
机构:
Nanjing Univ Posts & Telecommun, Sch Automat, Nanjing 210003, Peoples R China
Nanjing Univ Posts & Telecommun, Sch Artificial Intelligence, Nanjing 210003, Peoples R ChinaNanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China
Sun, Yanfei
;
Wang, Kun
论文数: 0引用数: 0
h-index: 0
机构:
Univ Calif Los Angeles, Dept Elect & Comp Engn, Los Angeles, CA 90095 USANanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing 210003, Peoples R China