Graphical-based data placement algorithm for cloud workflow

被引:0
作者
Zhang, Peng [1 ,2 ,3 ]
Wang, Guiling [1 ]
Han, Yanbo [1 ]
Wang, Jing [1 ]
机构
[1] North China University of Technology
[2] Institute of Computing Technology, Chinese Academy of Sciences
[3] Graduate School of Chinese Academy of Sciences
关键词
Affinity graph; Cloud computing; Data placement; Data transfer; Workflow;
D O I
10.3772/j.issn.1006-6748.2014.02.011
中图分类号
学科分类号
摘要
When workflow task needs several datasets from different locations in cloud, data transfer becomes a challenge. To avoid the unnecessary data transfer, a graphical-based data placement algorithm for cloud workflow is proposed. The algorithm uses affinity graph to group datasets while keeping a polynomial time complexity. By integrating the algorithm, the workflow engine can intelligently select locations in which the data will reside to avoid the unnecessary data transfer during the initial stage and runtime stage. Simulations show that the proposed algorithm can effectively reduce data transfer during the workflow's execution. © Copy Right by Hight Technology Letters Press.
引用
收藏
页码:179 / 186
页数:7
相关论文
共 50 条
  • [41] A novel cloud model based data placement strategy for data-intensive application in clouds
    Zhang, Xinxin
    Hu, Zhigang
    Zheng, Meiguang
    Li, Jia
    Yang, Liu
    COMPUTERS & ELECTRICAL ENGINEERING, 2019, 77 : 445 - 456
  • [42] BDAP: A Big Data Placement Strategy for Cloud-Based Scientific Workflows
    Ebrahimi, Mahdi
    Mohan, Aravind
    Kashlev, Andrey
    Lu, Shiyong
    2015 IEEE FIRST INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (BIGDATASERVICE 2015), 2015, : 105 - 114
  • [43] Optimal Data Placement for Scientific Workflows in Cloud
    Shrivastava, Manish
    JOURNAL OF COMPUTER INFORMATION SYSTEMS, 2024, 64 (04) : 501 - 517
  • [44] A Data Placement Strategy for Data-Intensive Cloud Storage
    Ding, Jie
    Han, Haiyun
    Zhou, Aihua
    PROGRESS IN POWER AND ELECTRICAL ENGINEERING, PTS 1 AND 2, 2012, 354-355 : 896 - 900
  • [45] A data placement strategy for data-intensive applications in cloud
    Zheng P.
    Cui L.-Z.
    Wang H.-Y.
    Xu M.
    Jisuanji Xuebao/Chinese Journal of Computers, 2010, 33 (08): : 1472 - 1480
  • [46] Data Placement for Multi-Tenant Data Federation on the Cloud
    Liu, Ji
    Mo, Lei
    Yang, Sijia
    Zhou, Jingbo
    Ji, Shilei
    Xiong, Haoyi
    Dou, Dejing
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2023, 11 (02) : 1414 - 1429
  • [47] Workflow scheduling using Jaya algorithm in cloud
    Gupta, Swati
    Agarwal, Isha
    Singh, Ravi Shankar
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2019, 31 (17)
  • [48] A Novel Workflow Scheduling Algorithm in Cloud Environment
    Toan Phan Thanh
    Loc Nguyen The
    Cuong Nguyen Doan
    PROCEEDINGS OF 2015 2ND NATIONAL FOUNDATION FOR SCIENCE AND TECHNOLOGY DEVELOPMENT CONFERENCE ON INFORMATION AND COMPUTER SCIENCE NICS 2015, 2015, : 125 - 129
  • [49] A novel hybrid algorithm for workflow scheduling in cloud
    Agarwal I.
    Gupta S.
    Singh R.S.
    International Journal of Cloud Computing, 2023, 12 (06) : 605 - 620
  • [50] An Optimal Engine Component Placement Strategy for Cloud Workflow Service
    Yao, Yan
    Cao, Jian
    Jiang, Yusheng
    Wang, Jie
    2016 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS), 2016, : 380 - 387