Provenance management in Swift

被引:11
作者
Gadelha, Luiz M. R., Jr. [1 ,2 ]
Clifford, Ben [3 ]
Mattoso, Marta [1 ]
Wilde, Michael [3 ,4 ]
Foster, Ian [3 ,4 ]
机构
[1] Univ Fed Rio de Janeiro, Comp & Syst Engn Program, BR-21941 Rio De Janeiro, Brazil
[2] Natl Lab Sci Comp, Petropolis, Brazil
[3] Univ Chicago, Computat Inst, Chicago, IL 60637 USA
[4] Argonne Natl Lab, Div Math & Comp Sci, Argonne, IL 60439 USA
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2011年 / 27卷 / 06期
关键词
Provenance; Parallel scripting languages; Scientific workflows;
D O I
10.1016/j.future.2010.05.003
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The Swift parallel scripting language allows for the specification, execution and analysis of large-scale computations in parallel and distributed environments. It incorporates a data model for recording and querying provenance information. In this article we describe these capabilities and evaluate the interoperability with other systems through the use of the Open Provenance Model. We describe Swift's provenance data model and compare it to the Open Provenance Model. We also describe and evaluate activities performed within the Third Provenance Challenge, which consisted of implementing a specific scientific workflow, capturing and recording provenance information of its execution, performing provenance queries, and exchanging provenance information with other systems. Finally, we propose improvements to both the Open Provenance Model and Swift's provenance system. (C) 2011 Published by Elsevier B.V.
引用
收藏
页码:775 / 780
页数:6
相关论文
共 50 条
[21]   A collaborative semantic-based provenance management platform for reproducibility [J].
Samuel S. ;
König-Ries B. .
PeerJ Computer Science, 2022, 8
[22]   Standard Provenance Reporting and Scientific Software Management in Virtual Laboratories [J].
Wise, C. ;
Car, N. J. ;
Fraser, R. ;
Squire, G. .
21ST INTERNATIONAL CONGRESS ON MODELLING AND SIMULATION (MODSIM2015), 2015, :634-640
[23]   A collaborative semantic-based provenance management platform for reproducibility [J].
Samuel, Sheeba ;
Koenig-Ries, Birgitta .
PEERJ COMPUTER SCIENCE, 2022, 8
[24]   Scientific Workflow Provenance Management: System Requirements and a Reference Architecture [J].
Kashliev, Andre .
GRID, CLOUD, AND CLUSTER COMPUTING; QUANTUM TECHNOLOGIES; AND MODELING, SIMULATION AND VISUALIZATION METHODS, GCC 2024, ICEQT 2024, MSV 2024, 2025, 2257 :18-26
[25]   The Application of Cloud Computing to the Creation of Image Mosaics and Management of Their Provenance [J].
Berriman, G. Bruce ;
Deelman, Ewa ;
Groth, Paul ;
Juve, Gideon .
SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY, 2010, 7740
[26]   Product lifecycle management with provenance management and virtual models: an industrial use-case study [J].
Morshedzadeh, Iman ;
Oscarsson, Jan ;
Ng, Amos ;
Jeusfeld, Manfred ;
Sillanpaa, Janne .
51ST CIRP CONFERENCE ON MANUFACTURING SYSTEMS, 2018, 72 :1190-1195
[27]   A survey of provenance in scientific workflow [J].
Lin, Songhai ;
Xiao, Hong ;
Jiang, Wenchao ;
Li, Dafeng ;
Liang, Jiaben ;
Li, Zelin .
JOURNAL OF HIGH SPEED NETWORKS, 2023, 29 (02) :129-145
[28]   Karma2: Provenance management for data-driven workflows [J].
Simmhan, Yogesh L. ;
Plale, Beth ;
Gannon, Dennis .
INTERNATIONAL JOURNAL OF WEB SERVICES RESEARCH, 2008, 5 (02) :1-22
[29]   ProML: A Decentralised Platform for Provenance Management of Machine Learning Software Systems [J].
Nguyen Khoi Tran ;
Sabir, Bushra ;
Babar, Muhammad Ali ;
Cui, Nini ;
Abolhasan, Mehran ;
Lipman, Justin .
SOFTWARE ARCHITECTURE, ECSA 2022, 2022, 13444 :49-65
[30]   Provenance Analysis: Towards Quality Provenance [J].
Cheah, You-Wei ;
Plale, Beth .
2012 IEEE 8TH INTERNATIONAL CONFERENCE ON E-SCIENCE (E-SCIENCE), 2012,