Deep Reinforcement Learning for Dynamic Task Scheduling in Edge-Cloud Environments

被引:0
作者
Rani, D. Mamatha [1 ]
Supreethi, K. P. [2 ]
Jayasingh, Bipin Bihari [3 ]
机构
[1] TGSWRAFPDC W, Bhongir Dept Comp Sci, Bhongir 508126, Telangana, India
[2] Jawaharlal Nehru Technol Univ, Dept Comp Sci & Engn, Hyderabad 500085, Telangana, India
[3] CVR Coll Engn, IT Dept, Hyderabad 501510, Telangana, India
关键词
Task Scheduling; Edge-Cloud Environment; Recurrent Neural Network; Edge Computing; Cloud Computing; Deep Reinforcement Learning; SERVICE PLACEMENT; ENERGY; INTERNET; IOT; SIMULATION; TOOLKIT; SYSTEM; THINGS;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With The advent of the Internet of Things (IoT) and its use cases there is a necessity for improved latency which has led to edgecomputing technologies. IoT applications need a cloud environment and appropriate scheduling based on the underlying requirements of a given workload. Due to the mobility nature of IoT devices and resource constraints and resource heterogeneity, IoT application tasks need more efficient scheduling which is a challenging problem. The existing conventional and deep learning scheduling techniques have limitations such as lack of adaptability, issues with synchronous nature and inability to deal with temporal patterns in the workloads. To address these issues, we proposed a learning-based framework known as the Deep Reinforcement Learning Framework (DRLF). This is designed in such a way that it exploits Deep Reinforcement Learning (DRL) with underlying mechanisms and enhanced deep network architecture based on Recurrent Neural Network (RNN). We also proposed an algorithm named Reinforcement Learning Dynamic Scheduling (RLbDS) which exploits different hyperparameters and DRL-based decision-making for efficient scheduling. Real-time traces of edge-cloud infrastructure are used for empirical study. We implemented our framework by defining new classes for CloudSim and iFogSim simulation frameworks. Our empirical study has revealed that RLbDS out performs many existing scheduling methods.
引用
收藏
页码:837 / 850
页数:14
相关论文
共 44 条
[1]   A Survey on Energy Conserving Mechanisms for the Internet of Things: Wireless Networking Aspects [J].
Abbas, Zeeshan ;
Yoon, Wonyong .
SENSORS, 2015, 15 (10) :24818-24847
[2]  
Achiam J, 2017, PR MACH LEARN RES, V70
[3]   Investigating and Modelling of Task Offloading Latency in Edge-Cloud Environment [J].
Almutairi, Jaber ;
Aldossary, Mohammad .
CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (03) :4143-4160
[4]   A novel approach for IoT tasks offloading in edge-cloud environments [J].
Almutairi, Jaber ;
Aldossary, Mohammad .
JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2021, 10 (01)
[5]  
azure.microsoft, Microsoft Azure Pricing Calculator
[6]   Learn-as-you-go with Megh: Efficient Live Migration of Virtual Machines [J].
Basu, Debabrota ;
Wang, Xiayang ;
Hong, Yang ;
Chen, Haibo ;
Bressan, Stephane .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (08) :1786-1801
[7]   Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers [J].
Beloglazov, Anton ;
Buyya, Rajkumar .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2012, 24 (13) :1397-1420
[8]   QoS-Aware Deployment of IoT Applications Through the Fog [J].
Brogi, Antonio ;
Forti, Stefano .
IEEE INTERNET OF THINGS JOURNAL, 2017, 4 (05) :1185-1192
[9]   Energy efficiency for cloud computing system based on predictive optimization [J].
Bui, Dinh-Mao ;
Yoon, YongIk ;
Huh, Eui-Nam ;
Jun, SungIk ;
Lee, Sungyoung .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2017, 102 :103-114
[10]   Managing latency in edge-cloud environment [J].
Bulej, Lubomir ;
Bures, Tomas ;
Filandr, Adam ;
Hnetynka, Petr ;
Hnetynkova, Iveta ;
Pacovsky, Jan ;
Sandor, Gabor ;
Gerostathopoulos, Ilias .
JOURNAL OF SYSTEMS AND SOFTWARE, 2021, 172 (172)