A Data-Intensive Workflow Scheduling Algorithm for Grid Computing

被引:2
|
作者
Xu, Meng [1 ]
Cui, Lizhen [1 ]
Wang, Haiyang [1 ]
Bi, Yanbing [1 ]
Bian, Ji [1 ]
机构
[1] Shandong Univ, Sch Comp Sci & Technol, Jinan 250100, Peoples R China
来源
FOURTH CHINAGRID ANNUAL CONFERENCE, PROCEEDINGS | 2009年
关键词
Data-intensive; Workflow; Scheduling; Grid computing;
D O I
10.1109/ChinaGrid.2009.30
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The data-intensive workflow in scientific and enterprise grids has gained popularity in recent times. Data-intensive workflow needs to access, process and transfer large datasets that may each be replicated on different data hosts. Because of the large data sets, the execution time is bounded by the cost of data transfer. Minimizing the time of transferring these datasets to the computational resources where the tasks of workflow are executed requires that appropriate computational and data resources be selected. In this paper, we introduce an algorithm MDTT to select the resource set which the task should be mapped. Our experiments show that our algorithm is able to minimize the total makespan of data-intensive workflow and the time of data transferring.
引用
收藏
页码:110 / 115
页数:6
相关论文
共 50 条
  • [1] DISWOP: A Novel Scheduling Algorithm for Data-Intensive Workflow Optimizations
    Yuan, Yuyu
    Liu, Chuanyi
    Cheng, Jie
    Wang, Xiaoliang
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2012, E95D (07): : 1839 - 1846
  • [2] A novel scheduling algorithm for data-intensive workflow in virtualised clouds
    Li F.
    International Journal of Networking and Virtual Organisations, 2019, 20 (03) : 284 - 300
  • [3] Data-intensive workflow management: For clouds and data-intensive and scalable computing environments
    De Oliveira, Daniel C.M.
    Liu, Ji
    Pacitti, Esther
    Synthesis Lectures on Data Management, 2019, 14 (04): : 1 - 179
  • [4] Algorithm of Scheduling for Data-intensive Computing Operations onto GPU Cluster
    Tang X.-C.
    Zhu Z.-Y.
    Mao A.-Q.
    Fu Y.
    Li Z.-H.
    Ruan Jian Xue Bao/Journal of Software, 2022, 33 (12): : 4429 - 4451
  • [5] A Data-Intensive Workflow Scheduling Algorithm for Large-scale Cooperative Work Platform
    Cui, Lizhen
    Xu, Meng
    Wang, Haiyang
    2009 13TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, 2009, : 486 - 491
  • [6] Energy-aware scheduling policy for data-intensive workflow
    Xiao, Peng
    Hu, Zhi-Gang
    Qu, Xi-Long
    Tongxin Xuebao/Journal on Communications, 2015, 36 (01):
  • [7] Data-Intensive Workflow Scheduling in Cloud on Budget and Deadline Constraints
    Xin, Zhang
    Wu, Changze
    Wu, Kaigui
    COLLABORATE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING, COLLABORATECOM 2016, 2017, 201 : 262 - 272
  • [8] Data classification algorithm for data-intensive computing environments
    Chen, Tiedong
    Liu, Shifeng
    Gong, Daqing
    Gao, Honghu
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2017,
  • [9] Data classification algorithm for data-intensive computing environments
    Tiedong Chen
    Shifeng Liu
    Daqing Gong
    Honghu Gao
    EURASIP Journal on Wireless Communications and Networking, 2017
  • [10] Simultaneous scheduling of replication and computation for data-intensive applications on the grid
    Desprez F.
    Vernois A.
    Journal of Grid Computing, 2006, 4 (1) : 19 - 31