Provenance management in Swift

被引:11
作者
Gadelha, Luiz M. R., Jr. [1 ,2 ]
Clifford, Ben [3 ]
Mattoso, Marta [1 ]
Wilde, Michael [3 ,4 ]
Foster, Ian [3 ,4 ]
机构
[1] Univ Fed Rio de Janeiro, Comp & Syst Engn Program, BR-21941 Rio De Janeiro, Brazil
[2] Natl Lab Sci Comp, Petropolis, Brazil
[3] Univ Chicago, Computat Inst, Chicago, IL 60637 USA
[4] Argonne Natl Lab, Div Math & Comp Sci, Argonne, IL 60439 USA
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2011年 / 27卷 / 06期
关键词
Provenance; Parallel scripting languages; Scientific workflows;
D O I
10.1016/j.future.2010.05.003
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The Swift parallel scripting language allows for the specification, execution and analysis of large-scale computations in parallel and distributed environments. It incorporates a data model for recording and querying provenance information. In this article we describe these capabilities and evaluate the interoperability with other systems through the use of the Open Provenance Model. We describe Swift's provenance data model and compare it to the Open Provenance Model. We also describe and evaluate activities performed within the Third Provenance Challenge, which consisted of implementing a specific scientific workflow, capturing and recording provenance information of its execution, performing provenance queries, and exchanging provenance information with other systems. Finally, we propose improvements to both the Open Provenance Model and Swift's provenance system. (C) 2011 Published by Elsevier B.V.
引用
收藏
页码:775 / 780
页数:6
相关论文
共 26 条
[1]  
[Anonymous], PROPOSAL HANDLING CO
[2]  
[Anonymous], P SERV 07 IEEE C JUL
[3]  
[Anonymous], 1995, LECT NOTES COMPUTER, DOI DOI 10.1007/3-540-60153-8_34
[4]  
[Anonymous], 2007, WORKFLOWS E SCI
[5]  
CAO B, 2009, P IEEE C SERV, P348
[6]  
CLIFFORD B, 2009, ANLMCSTM311
[7]  
CLIFFORD B, 2009, PROVENANCE WORKING N
[8]   Tracking provenance in a virtual data grid [J].
Clifford, Ben ;
Foster, Ian ;
Voeckler, Jens-S. ;
Wilder, Michael ;
Zhao, Yong .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2008, 20 (05) :565-575
[9]  
CZAJKOWSKI K, 1998, LNCS, V1459, P62
[10]   Workflows and e-Science: An overview of workflow system features and capabilities [J].
Deelman, Ewa ;
Gannon, Dennis ;
Shields, Matthew ;
Taylor, Ian .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2009, 25 (05) :528-540