A Time-Driven Data Placement Strategy for a Scientific Workflow Combining Edge Computing and Cloud Computing

被引:165
作者
Lin, Bing [1 ,2 ,3 ]
Zhu, Fangning [4 ,5 ]
Zhang, Jianshan [1 ,2 ,3 ]
Chen, Jiaqing [4 ,5 ]
Chen, Xing [4 ,5 ]
Xiong, Naixue N. [6 ]
Mauri, Jaime Lloret [7 ]
机构
[1] Fujian Normal Univ, Coll Phys & Energy, Fuzhou 350117, Fujian, Peoples R China
[2] Fujian Prov Collaborat Innovat Ctr Optoelect Semi, Xiamen 361005, Fujian, Peoples R China
[3] Minjiang Univ, Elect Informat & Control, Fujian Univ Engn Res Ctr, Fuzhou 350121, Fujian, Peoples R China
[4] Fuzhou Univ, Coll Math & Comp Sci, Fuzhou 350108, Fujian, Peoples R China
[5] Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou 350108, Fujian, Peoples R China
[6] Tianjin Univ, Tianjin 300072, Peoples R China
[7] Univ Politecn Valencia, Valencia 46022, Spain
基金
国家重点研发计划;
关键词
Cloud computing; data placement; data transmission time; edge computing; scientific workflow; SCHEDULING ALGORITHM; INTERNET; IOT;
D O I
10.1109/TII.2019.2905659
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Compared to traditional distributed computing environments such as grids, cloud computing provides a more cost-effectiveway to deploy scientificworkflows. Each task of a scientific workflow requires several large datasets that are located in different datacenters, resulting in serious data transmission delays. Edge computing reduces the data transmission delays and supports the fixed storing manner for scientific workflow private datasets, but there is a bottleneck in its storage capacity. It is a challenge to combine the advantages of both edge computing and cloud computing to rationalize the data placement of scientific workflow, and optimize the data transmission time across different datacenters. In this study, a self-adaptive discrete particle swarm optimization algorithm with genetic algorithm operators (GA-DPSO) was proposed to optimize the data transmission time when placing data for a scientific workflow. This approach considered the characteristics of data placement combining edge computing and cloud computing. In addition, it considered the factors impacting transmission delay, such as the bandwidth between datacenters, the number of edge datacenters, and the storage capacity of edge datacenters. The crossover and mutation operators of the genetic algorithm were adopted to avoid the premature convergence of traditional particle swarm optimization algo-rithm, which enhanced the diversity of population evolution and effectively reduced the data transmission time. The experimental results show that the data placement strategy based on GA-DPSO can effectively reduce the data transmission time during workflow execution combining edge computing and cloud computing.
引用
收藏
页码:4254 / 4265
页数:12
相关论文
共 31 条
[1]   Workflow-Net Based Service Composition Using Mobile Edge Nodes [J].
Al Ridhawi, Ismaeel ;
Kotb, Yehia ;
Al Ridhawi, Yousif .
IEEE ACCESS, 2017, 5 :23719-23735
[2]  
Bharathi S, 2008, 2008 THIRD WORKSHOP ON WORKFLOWS IN SUPPORT OF LARGE-SCALE SCIENCE (WORKS 2008), P11
[3]  
Chen W., 2019, IEEE NETW
[4]   A Genetic Algorithm Based Data Replica Placement Strategy for Scientific Applications in Clouds [J].
Cui, Lizhen ;
Zhang, Junhua ;
Yue, Lingxi ;
Shi, Yuliang ;
Li, Hui ;
Yuan, Dong .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2018, 11 (04) :727-739
[5]   Combining Edge and Cloud computing for low-power, cost-effective metagenomics analysis [J].
D'Agostino, Daniele ;
Morganti, Lucia ;
Corni, Elena ;
Cesini, Daniele ;
Merelli, Ivan .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 90 :79-85
[6]   A clustering based coscheduling strategy for efficient scientific workflow execution in cloud computing [J].
Deng, Kefeng ;
Ren, Kaijun ;
Song, Junqiang ;
Yuan, Dong ;
Xiang, Yang ;
Chen, Jinjun .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2013, 25 (18) :2523-2539
[7]   The Collaborative System Workflow Management of Industrial Design Based on Hierarchical Colored Petri-Net [J].
Du, Shuxing ;
Wu, Peng ;
Wu, Guoying ;
Yao, Chensong ;
Zhang, Likun .
IEEE ACCESS, 2018, 6 :27383-27391
[8]  
Kennedy J, 1995, 1995 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS PROCEEDINGS, VOLS 1-6, P1942, DOI 10.1109/icnn.1995.488968
[9]   Composition of Resource-Service Chain for Cloud Manufacturing [J].
Li, Haibo ;
Chan, Keith C. C. ;
Liang, Mengxia ;
Luo, Xiangyu .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2016, 12 (01) :211-219
[10]   Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing [J].
Li, He ;
Ota, Kaoru ;
Dong, Mianxiong .
IEEE NETWORK, 2018, 32 (01) :96-101