Graphical-based data placement algorithm for cloud workflow

被引:0
|
作者
Zhang, Peng [1 ,2 ,3 ]
Wang, Guiling [1 ]
Han, Yanbo [1 ]
Wang, Jing [1 ]
机构
[1] North China University of Technology
[2] Institute of Computing Technology, Chinese Academy of Sciences
[3] Graduate School of Chinese Academy of Sciences
关键词
Affinity graph; Cloud computing; Data placement; Data transfer; Workflow;
D O I
10.3772/j.issn.1006-6748.2014.02.011
中图分类号
学科分类号
摘要
When workflow task needs several datasets from different locations in cloud, data transfer becomes a challenge. To avoid the unnecessary data transfer, a graphical-based data placement algorithm for cloud workflow is proposed. The algorithm uses affinity graph to group datasets while keeping a polynomial time complexity. By integrating the algorithm, the workflow engine can intelligently select locations in which the data will reside to avoid the unnecessary data transfer during the initial stage and runtime stage. Simulations show that the proposed algorithm can effectively reduce data transfer during the workflow's execution. © Copy Right by Hight Technology Letters Press.
引用
收藏
页码:179 / 186
页数:7
相关论文
共 50 条
  • [1] Graphical-based data placement algorithm for cloud workflow
    张鹏
    Wang Guiling
    Han Yanbo
    Wang Jing
    HighTechnologyLetters, 2014, 20 (02) : 179 - 186
  • [2] A data placement strategy for scientific workflow in hybrid cloud
    Liu, Zhanghui
    Xiang, Tao
    Lin, Bing
    Ye, Xinshu
    Wang, Haijiang
    Zhang, Ying
    Chen, Xing
    PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, : 556 - 563
  • [3] A Data Placement Strategy Based on Genetic Algorithm in Cloud Computing Platform
    Guo, Wei
    Wang, Xinjun
    2013 10TH WEB INFORMATION SYSTEM AND APPLICATION CONFERENCE (WISA 2013), 2013, : 369 - 372
  • [4] A data placement strategy based on clustering and consistent hashing algorithm in Cloud Computing
    Li, Qiang
    Wang, Kun
    Wei, Suwei
    Han, Xuefeng
    Xu, Lili
    Gao, Min
    2014 9TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND NETWORKING IN CHINA (CHINACOM), 2014, : 478 - 483
  • [5] Multi-Objective Data Placement for Workflow Management in Cloud Infrastructure Using NSGA-II
    Xu, Xiaolong
    Fu, Shucun
    Li, Weimin
    Dai, Fei
    Gao, Honghao
    Chang, Victor
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2020, 4 (05): : 605 - 615
  • [6] RENDA: Resource and Network Aware Data Placement Algorithm for Periodic Workloads in Cloud
    Thakkar, Hiren Kumar
    Sahoo, Prasan Kumar
    Veeravalli, Bharadwaj
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (12) : 2906 - 2920
  • [7] FCA-based Energy Aware-data Placement Strategy for Intensive Workflow in Cloud Computing.
    Derouiche, Rihab
    Brahmi, Zaki
    Gammoudi, Mohamed Mohsen
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KES 2019), 2019, 159 : 387 - 397
  • [8] Replication and data management-based workflow scheduling algorithm for multi-cloud data centre platform
    Ulabedin, Zain
    Nazir, Babar
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (10) : 10743 - 10772
  • [9] A Group Based Genetic Algorithm Data Replica Placement Strategy For Scientific Workflow
    Liu, Lihui
    Yang, Ying
    Wang, Haibo
    Tan, Zhifei
    Li, Chen
    2017 16TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS 2017), 2017, : 459 - 464
  • [10] A Data Placement Algorithm for Data Intensive Applications in Cloud
    Zhao, Qing
    Xiong, Congcong
    Zhang, Kunyu
    Yue, Yang
    Yang, Jucheng
    INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2016, 9 (02): : 145 - 155