Provenance management in Swift

被引:11
|
作者
Gadelha, Luiz M. R., Jr. [1 ,2 ]
Clifford, Ben [3 ]
Mattoso, Marta [1 ]
Wilde, Michael [3 ,4 ]
Foster, Ian [3 ,4 ]
机构
[1] Univ Fed Rio de Janeiro, Comp & Syst Engn Program, BR-21941 Rio De Janeiro, Brazil
[2] Natl Lab Sci Comp, Petropolis, Brazil
[3] Univ Chicago, Computat Inst, Chicago, IL 60637 USA
[4] Argonne Natl Lab, Div Math & Comp Sci, Argonne, IL 60439 USA
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2011年 / 27卷 / 06期
关键词
Provenance; Parallel scripting languages; Scientific workflows;
D O I
10.1016/j.future.2010.05.003
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The Swift parallel scripting language allows for the specification, execution and analysis of large-scale computations in parallel and distributed environments. It incorporates a data model for recording and querying provenance information. In this article we describe these capabilities and evaluate the interoperability with other systems through the use of the Open Provenance Model. We describe Swift's provenance data model and compare it to the Open Provenance Model. We also describe and evaluate activities performed within the Third Provenance Challenge, which consisted of implementing a specific scientific workflow, capturing and recording provenance information of its execution, performing provenance queries, and exchanging provenance information with other systems. Finally, we propose improvements to both the Open Provenance Model and Swift's provenance system. (C) 2011 Published by Elsevier B.V.
引用
收藏
页码:775 / 780
页数:6
相关论文
共 50 条
  • [1] Provenance Management in BioSciences
    Ram, Sudha
    Liu, Jun
    ADVANCES IN CONCEPTUAL MODELING: APPLICATIONS AND CHALLENGES, 2010, 6413 : 54 - 64
  • [2] UniProv - Provenance Management for UNICORE Workflows in HPC Environments
    Giesler, Andre
    Czekala, Myriam
    Hagemeier, Bjoern
    PROVENANCE AND ANNOTATION OF DATA AND PROCESSES, IPAW 2018, 2018, 11017 : 188 - 191
  • [3] Towards a Taxonomy of Provenance in Scientific Workflow Management Systems
    Serra da Cruz, Sergio Manuel
    Campos, Maria Luiza M.
    Mattoso, Marta
    2009 IEEE CONGRESS ON SERVICES (SERVICES-1 2009), VOLS 1 AND 2, 2009, : 259 - +
  • [4] Provenance management for data quality assessment
    Zheng, Hua
    Zhu, Qinghua
    Wu, Kewen
    Journal of Software, 2012, 7 (08) : 1905 - 1910
  • [5] Cloud infrastructure provenance collection and management to reproduce scientific workflows execution
    Hasham, Khawar
    Munir, Kamran
    McClatchey, Richard
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 86 : 799 - 820
  • [6] The Perm Provenance Management System in Action
    Glavic, Boris
    Alonso, Gustavo
    ACM SIGMOD/PODS 2009 CONFERENCE, 2009, : 1055 - 1057
  • [7] Implicit Provenance Gathering through Configuration Management
    Neves, Vitor C.
    Braganholo, Vanessa
    Murta, Leonardo
    2013 5TH INTERNATIONAL WORKSHOP ON SOFTWARE ENGINEERING FOR COMPUTATIONAL SCIENCE AND ENGINEERING (SE-CSE), 2013, : 92 - 95
  • [8] Challenges of Provenance in Scientific Workflow Management Systems
    Alam, Khairul
    Roy, Banani
    2022 IEEE/ACM WORKSHOP ON WORKFLOWS IN SUPPORT OF LARGE-SCALE SCIENCE, WORKS, 2022, : 10 - 18
  • [9] Woodland period ceramic provenance and the exchange of Swift Creek Complicated Stamped vessels in the southeastern United States
    Wallis, Neill J.
    Boulanger, Matthew T.
    Ferguson, Jeffrey R.
    Glascock, Michael D.
    JOURNAL OF ARCHAEOLOGICAL SCIENCE, 2010, 37 (10) : 2598 - 2611
  • [10] Applying content management to automated provenance capture
    Schuchardt, Karen L.
    Gibson, Tara
    Stepban, Eric
    Chin, George, Jr.
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2008, 20 (05) : 541 - 554