共 38 条
Optimizing task offloading and resource allocation in edge-cloud networks: a DRL approach
被引:33
作者:

Ullah, Ihsan
论文数: 0 引用数: 0
h-index: 0
机构:
Korea Univ Technol & Educ, Adv Technol Res Ctr, Cheonan, South Korea Korea Univ Technol & Educ, Adv Technol Res Ctr, Cheonan, South Korea

Lim, Hyun-Kyo
论文数: 0 引用数: 0
h-index: 0
机构:
Korea Univ Technol & Educ, Dept Comp Sci & Engn, Future Convergence Engn, Cheonan, South Korea Korea Univ Technol & Educ, Adv Technol Res Ctr, Cheonan, South Korea

Seok, Yeong-Jun
论文数: 0 引用数: 0
h-index: 0
机构:
Korea Univ Technol & Educ, Dept Comp Sci & Engn, Future Convergence Engn, Cheonan, South Korea Korea Univ Technol & Educ, Adv Technol Res Ctr, Cheonan, South Korea

Han, Youn-Hee
论文数: 0 引用数: 0
h-index: 0
机构:
Korea Univ Technol & Educ, Dept Comp Sci & Engn, Future Convergence Engn, Cheonan, South Korea Korea Univ Technol & Educ, Adv Technol Res Ctr, Cheonan, South Korea
机构:
[1] Korea Univ Technol & Educ, Adv Technol Res Ctr, Cheonan, South Korea
[2] Korea Univ Technol & Educ, Dept Comp Sci & Engn, Future Convergence Engn, Cheonan, South Korea
来源:
JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS
|
2023年
/
12卷
/
01期
基金:
新加坡国家研究基金会;
关键词:
Edge-cloud computing;
Task offloading;
Resource allocation;
Deep Reinforcement learning;
Markov decision process (MDP);
DEEP;
OPTIMIZATION;
DEVICES;
D O I:
10.1186/s13677-023-00461-3
中图分类号:
TP [自动化技术、计算机技术];
学科分类号:
0812 ;
摘要:
Edge-cloud computing is an emerging approach in which tasks are offloaded from mobile devices to edge or cloud servers. However, Task offloading may result in increased energy consumption and delays, and the decision to offload the task is dependent on various factors such as time-varying radio channels, available computation resources, and the location of devices. As edge-cloud computing is a dynamic and resource-constrained environment, making optimal offloading decisions is a challenging task. This paper aims to optimize offloading and resource allocation to minimize delay and meet computation and communication needs in edge-cloud computing. The problem of optimizing task offloading in the edge-cloud computing environment is a multi-objective problem, for which we employ deep reinforcement learning to find the optimal solution. To accomplish this, we formulate the problem as a Markov decision process and use a Double Deep Q-Network (DDQN) algorithm. Our DDQN-edge-cloud (DDQNEC) scheme dynamically makes offloading decisions by analyzing resource utilization, task constraints, and the current status of the edge-cloud network. Simulation results demonstrate that DDQNEC outperforms heuristic approaches in terms of resource utilization, task offloading, and task rejection.
引用
收藏
页数:15
相关论文
共 38 条
[1]
Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA
[J].
Alfakih, Taha
;
Hassan, Mohammad Mehedi
;
Gumaei, Abdu
;
Savaglio, Claudio
;
Fortino, Giancarlo
.
IEEE ACCESS,
2020, 8
:54074-54084

论文数: 引用数:
h-index:
机构:

论文数: 引用数:
h-index:
机构:

论文数: 引用数:
h-index:
机构:

Savaglio, Claudio
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Calabria, Dept Informat Modeling Elect & Syst, I-87036 Arcavacata Di Rende, Italy King Saud Univ, Coll Comp & Informat Sci, Dept Informat Syst, Riyadh 11543, Saudi Arabia

Fortino, Giancarlo
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Calabria, Dept Informat Modeling Elect & Syst, I-87036 Arcavacata Di Rende, Italy King Saud Univ, Coll Comp & Informat Sci, Dept Informat Syst, Riyadh 11543, Saudi Arabia
[2]
Joint Multi-Task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT
[J].
Chai, Furong
;
Zhang, Qi
;
Yao, Haipeng
;
Xin, Xiangjun
;
Gao, Ran
;
Guizani, Mohsen
.
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY,
2023, 72 (06)
:7783-7795

Chai, Furong
论文数: 0 引用数: 0
h-index: 0
机构:
Beijing Univ Posts & Telecommun BUPT, Sch Elect Engn, Beijing 100876, Peoples R China
BUPT, Beijing Key Lab Space round Interconnect & Converg, Beijing 100876, Peoples R China Beijing Univ Posts & Telecommun BUPT, Sch Elect Engn, Beijing 100876, Peoples R China

Zhang, Qi
论文数: 0 引用数: 0
h-index: 0
机构:
BUPT, Beijing Key Lab Space round Interconnect & Converg, Beijing 100876, Peoples R China
BUPT, Sch Elect Engn, State Key Lab Informat Photon & Opt Commun, Beijing, Peoples R China Beijing Univ Posts & Telecommun BUPT, Sch Elect Engn, Beijing 100876, Peoples R China

Yao, Haipeng
论文数: 0 引用数: 0
h-index: 0
机构:
BUPT, Sch Informat & Commun Engn, Beijing 100876, Peoples R China Beijing Univ Posts & Telecommun BUPT, Sch Elect Engn, Beijing 100876, Peoples R China

Xin, Xiangjun
论文数: 0 引用数: 0
h-index: 0
机构:
BUPT, Beijing Key Lab Space round Interconnect & Converg, Beijing 100876, Peoples R China
BUPT, Sch Elect Engn, State Key Lab Informat Photon & Opt Commun, Beijing, Peoples R China Beijing Univ Posts & Telecommun BUPT, Sch Elect Engn, Beijing 100876, Peoples R China

Gao, Ran
论文数: 0 引用数: 0
h-index: 0
机构:
Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China Beijing Univ Posts & Telecommun BUPT, Sch Elect Engn, Beijing 100876, Peoples R China

论文数: 引用数:
h-index:
机构:
[3]
A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC
[J].
Chen, Juan
;
Xing, Huanlai
;
Xiao, Zhiwen
;
Xu, Lexi
;
Tao, Tao
.
IEEE INTERNET OF THINGS JOURNAL,
2021, 8 (24)
:17508-17524

Chen, Juan
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China

Xing, Huanlai
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China

Xiao, Zhiwen
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China

Xu, Lexi
论文数: 0 引用数: 0
h-index: 0
机构:
China United Network Commun Corp, Res Inst, Beijing 100048, Peoples R China Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China

Tao, Tao
论文数: 0 引用数: 0
h-index: 0
机构:
China United Network Commun Grp Corp, Management Dept, Beijing 100033, Peoples R China Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
[4]
Dynamic Computation Offloading With Energy Harvesting Devices: A Graph-Based Deep Reinforcement Learning Approach
[J].
Chen, Juan
;
Wu, Zongling
.
IEEE COMMUNICATIONS LETTERS,
2021, 25 (09)
:2968-2972

Chen, Juan
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Peoples R China Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Peoples R China

Wu, Zongling
论文数: 0 引用数: 0
h-index: 0
机构:
Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Peoples R China Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Peoples R China
[5]
A novel deep policy gradient action quantization for trusted collaborative computation in intelligent vehicle networks
[J].
Chen, Miaojiang
;
Yi, Meng
;
Huang, Mingfeng
;
Huang, Guosheng
;
Ren, Yingying
;
Liu, Anfeng
.
EXPERT SYSTEMS WITH APPLICATIONS,
2023, 221

Chen, Miaojiang
论文数: 0 引用数: 0
h-index: 0
机构:
Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Yi, Meng
论文数: 0 引用数: 0
h-index: 0
机构:
Southeast Univ, Sch Comp Sci & Engn, Nanjing, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Huang, Mingfeng
论文数: 0 引用数: 0
h-index: 0
机构:
Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Huang, Guosheng
论文数: 0 引用数: 0
h-index: 0
机构:
Hunan First Normal Univ, Sch Comp Sci, Changsha, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Ren, Yingying
论文数: 0 引用数: 0
h-index: 0
机构:
Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

论文数: 引用数:
h-index:
机构:
[6]
GPDS: A multi-agent deep reinforcement learning game for anti-jamming secure computing in MEC network
[J].
Chen, Miaojiang
;
Liu, Wei
;
Zhang, Ning
;
Li, Junling
;
Ren, Yingying
;
Yi, Meng
;
Liu, Anfeng
.
EXPERT SYSTEMS WITH APPLICATIONS,
2022, 210

Chen, Miaojiang
论文数: 0 引用数: 0
h-index: 0
机构:
Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Liu, Wei
论文数: 0 引用数: 0
h-index: 0
机构:
Hunan Univ Chinese Med, Sch Informat, Changsha 410208, Hunan, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Zhang, Ning
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Windsor, Dept Elect & Comp Engn, 401 Sunset, Windsor, ON, Canada Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Li, Junling
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Waterloo, Dept Elect & Comp Engn, 200 Univ Ave, Waterloo, ON, Canada Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Ren, Yingying
论文数: 0 引用数: 0
h-index: 0
机构:
Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Yi, Meng
论文数: 0 引用数: 0
h-index: 0
机构:
Southeast Univ, Schooltemp Comp Sci & Engn, Nanjing, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

论文数: 引用数:
h-index:
机构:
[7]
A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems
[J].
Chen, Miaojiang
;
Liu, Wei
;
Wang, Tian
;
Zhang, Shaobo
;
Liu, Anfeng
.
KNOWLEDGE-BASED SYSTEMS,
2022, 235

Chen, Miaojiang
论文数: 0 引用数: 0
h-index: 0
机构:
Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Liu, Wei
论文数: 0 引用数: 0
h-index: 0
机构:
Hunan Univ Chinese Med, Sch Informat, Changsha 410208, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Wang, Tian
论文数: 0 引用数: 0
h-index: 0
机构:
Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 361021, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

Zhang, Shaobo
论文数: 0 引用数: 0
h-index: 0
机构:
Hunan Univ Sci & Technol, Sch Comp Sci & Engn, Xiangtan 411201, Peoples R China Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China

论文数: 引用数:
h-index:
机构:
[8]
DDPG-based intelligent rechargeable fog computation offloading for IoT
[J].
Chen, Siguang
;
Ge, Xinwei
;
Wang, Qian
;
Miao, Yifeng
;
Ruan, Xiukai
.
WIRELESS NETWORKS,
2022, 28 (07)
:3293-3304

Chen, Siguang
论文数: 0 引用数: 0
h-index: 0
机构:
Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China
Nanjing Univ Posts & Telecommun, Jiangsu Engn Res Ctr Commun & Network Technol, Nanjing, Peoples R China Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China

Ge, Xinwei
论文数: 0 引用数: 0
h-index: 0
机构:
Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China
Nanjing Univ Posts & Telecommun, Jiangsu Engn Res Ctr Commun & Network Technol, Nanjing, Peoples R China Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China

Wang, Qian
论文数: 0 引用数: 0
h-index: 0
机构:
Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China
Nanjing Univ Posts & Telecommun, Jiangsu Engn Res Ctr Commun & Network Technol, Nanjing, Peoples R China Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China

Miao, Yifeng
论文数: 0 引用数: 0
h-index: 0
机构:
Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China
Nanjing Univ Posts & Telecommun, Jiangsu Engn Res Ctr Commun & Network Technol, Nanjing, Peoples R China Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China

Ruan, Xiukai
论文数: 0 引用数: 0
h-index: 0
机构:
Wenzhou Univ, Inst Intelligent Locks, Wenzhou, Peoples R China Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Broadband Wireless Commun & Inter, Nanjing, Peoples R China
[9]
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
[J].
Chen, Xianfu
;
Zhang, Honggang
;
Wu, Celimuge
;
Mao, Shiwen
;
Ji, Yusheng
;
Bennis, Mehdi
.
IEEE INTERNET OF THINGS JOURNAL,
2019, 6 (03)
:4005-4018

Chen, Xianfu
论文数: 0 引用数: 0
h-index: 0
机构:
VTT Tech Res Ctr Finland, Oulu 90570, Finland VTT Tech Res Ctr Finland, Oulu 90570, Finland

Zhang, Honggang
论文数: 0 引用数: 0
h-index: 0
机构:
Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Zhejiang, Peoples R China VTT Tech Res Ctr Finland, Oulu 90570, Finland

Wu, Celimuge
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Electrocommun, Grad Sch Informat & Engn, Tokyo 1828585, Japan VTT Tech Res Ctr Finland, Oulu 90570, Finland

Mao, Shiwen
论文数: 0 引用数: 0
h-index: 0
机构:
Auburn Univ, Dept Elect & Comp Engn, Auburn, AL 36849 USA VTT Tech Res Ctr Finland, Oulu 90570, Finland

Ji, Yusheng
论文数: 0 引用数: 0
h-index: 0
机构:
Natl Inst Informat, Informat Syst Architecture Res Div, Tokyo 1018430, Japan VTT Tech Res Ctr Finland, Oulu 90570, Finland

Bennis, Mehdi
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Oulu, Ctr Wireless Commun, FIN-90570 Oulu, Finland VTT Tech Res Ctr Finland, Oulu 90570, Finland
[10]
Decentralized computation offloading for multi-user mobile edge computing: a deep reinforcement learning approach
[J].
Chen, Zhao
;
Wang, Xiaodong
.
EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING,
2020, 2020 (01)

Chen, Zhao
论文数: 0 引用数: 0
h-index: 0
机构:
Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China

Wang, Xiaodong
论文数: 0 引用数: 0
h-index: 0
机构:
Columbia Univ, Dept Elect Engn, New York, NY 10027 USA Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China