Provenance management in Swift

被引:11
作者
Gadelha, Luiz M. R., Jr. [1 ,2 ]
Clifford, Ben [3 ]
Mattoso, Marta [1 ]
Wilde, Michael [3 ,4 ]
Foster, Ian [3 ,4 ]
机构
[1] Univ Fed Rio de Janeiro, Comp & Syst Engn Program, BR-21941 Rio De Janeiro, Brazil
[2] Natl Lab Sci Comp, Petropolis, Brazil
[3] Univ Chicago, Computat Inst, Chicago, IL 60637 USA
[4] Argonne Natl Lab, Div Math & Comp Sci, Argonne, IL 60439 USA
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2011年 / 27卷 / 06期
关键词
Provenance; Parallel scripting languages; Scientific workflows;
D O I
10.1016/j.future.2010.05.003
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The Swift parallel scripting language allows for the specification, execution and analysis of large-scale computations in parallel and distributed environments. It incorporates a data model for recording and querying provenance information. In this article we describe these capabilities and evaluate the interoperability with other systems through the use of the Open Provenance Model. We describe Swift's provenance data model and compare it to the Open Provenance Model. We also describe and evaluate activities performed within the Third Provenance Challenge, which consisted of implementing a specific scientific workflow, capturing and recording provenance information of its execution, performing provenance queries, and exchanging provenance information with other systems. Finally, we propose improvements to both the Open Provenance Model and Swift's provenance system. (C) 2011 Published by Elsevier B.V.
引用
收藏
页码:775 / 780
页数:6
相关论文
共 50 条
[31]   Improving privacy in health care with an ontology-based provenance management system [J].
Can, Ozgu ;
Yilmazer, Dilek .
EXPERT SYSTEMS, 2020, 37 (01)
[32]   Provenance and title risks in the art industry: mitigating these risks in museum management and curatorship [J].
Shindell, Lawrence M. .
MUSEUM MANAGEMENT AND CURATORSHIP, 2016, 31 (05) :406-417
[33]   Trustworthy Provenance Framework for Document Workflow Provenance [J].
Rupasinghe, P. L. ;
Weerasena, H. H. ;
Murray, I. .
2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL TECHNIQUES IN INFORMATION AND COMMUNICATION TECHNOLOGIES (ICCTICT), 2016,
[34]   A recontextualization of provenance: Records in Contexts and the principle of provenance [J].
Stephano, Anouk .
ARCHIVAL SCIENCE, 2024, 24 (04) :783-800
[35]   A Strategy for Provenance Gathering in Distributed Scientific Workflows [J].
Marinho, Anderson ;
Werner, Claudia ;
Serra da Cruz, Sergio Manuel ;
Mattoso, Marta ;
Braganholo, Vanessa ;
Murta, Leonardo .
2009 IEEE CONGRESS ON SERVICES (SERVICES-1 2009), VOLS 1 AND 2, 2009, :344-+
[36]   NeuroProv: Provenance data visualisation for neuroimaging analyses [J].
Arshad, Bilal ;
Munir, Kamran ;
McClatchey, Richard ;
Shamdasani, Jetendr ;
Khan, Zaheer .
JOURNAL OF COMPUTER LANGUAGES, 2019, 52 :72-87
[37]   Atomicity and provenance support for pipelined scientific workflows [J].
Wang, Liqiang ;
Lu, Shiyong ;
Fei, Xubo ;
Chebotko, Artem ;
Bryant, H. Victoria ;
Ram, Jeffrey L. .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2009, 25 (05) :568-576
[38]   FAIR data pipeline: provenance-driven data management for traceable scientific workflows [J].
Mitchell, Sonia Natalie ;
Lahiff, Andrew ;
Cummings, Nathan ;
Hollocombe, Jonathan ;
Boskamp, Bram ;
Field, Ryan ;
Reddyhoff, Dennis ;
Zarebski, Kristian ;
Wilson, Antony ;
Viola, Bruno ;
Burke, Martin ;
Archibald, Blair ;
Bessell, Paul ;
Blackwell, Richard ;
Boden, Lisa A. A. ;
Brett, Alys ;
Brett, Sam ;
Dundas, Ruth ;
Enright, Jessica ;
Gonzalez-Beltran, Alejandra N. N. ;
Harris, Claire ;
Hinder, Ian ;
Hughes, Christopher David ;
Knight, Martin ;
Mano, Vino ;
McMonagle, Ciaran ;
Mellor, Dominic ;
Mohr, Sibylle ;
Marion, Glenn ;
Matthews, Louise ;
McKendrick, Iain J. J. ;
Pooley, Christopher Mark ;
Porphyre, Thibaud ;
Reeves, Aaron ;
Townsend, Edward ;
Turner, Robert ;
Walton, Jeremy ;
Reeve, Richard .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2022, 380 (2233)
[39]   Modelling Provenance Collection Points and Their Impact on Provenance Graphs [J].
Gammack, David ;
Scott, Steve ;
Chapman, Adriane P. .
Provenance and Annotation of Data and Processes, IPAW 2016, 2016, 9672 :146-157
[40]   Digital provenance [J].
Bak, Greg .
ARCHIVAL SCIENCE, 2024, 24 (04) :847-869