Rucio: Scientific Data Management

被引：98

作者：

Barisits M. ^{[1
]}

Beermann T. ^{[2
]}

Berghaus F. ^{[3
]}

Bockelman B. ^{[4
]}

Bogado J. ^{[5
]}

Cameron D. ^{[6
]}

Christidis D. ^{[7
]}

Ciangottini D. ^{[8
]}

Dimitrov G. ^{[1
]}

Elsing M. ^{[1
]}

Garonne V. ^{[6
]}

di Girolamo A. ^{[1
]}

Goossens L. ^{[1
]}

Guan W. ^{[9
]}

Guenther J. ^{[1
]}

Javurek T. ^{[1
]}

Kuhn D. ^{[10
]}

Lassnig M. ^{[1
]}

Lopez F. ^{[5
]}

Magini N. ^{[11
]}

Molfetas A. ^{[1
]}

Nairz A. ^{[1
]}

Ould-Saada F. ^{[6
]}

Prenner S. ^{[10
]}

Serfon C. ^{[10
]}

Stewart G. ^{[1
]}

Vaandering E. ^{[12
]}

Vasileva P. ^{[1
]}

Vigne R. ^{[13
]}

Wegner T. ^{[1
]}

机构：

[1] CERN, Meyrin

[2] University of Wuppertal, Wuppertal

[3] University of Victoria, Victoria

[4] Morgridge Institute, Madison, WI

[5] Universidad Nacional de La Plata, La Plata

[6] University of Oslo, Oslo

[7] University of Texas at Arlington, Arlington, TX

[8] INFN, Perugia

[9] University of Wisconsin-Madison, Madison, WI

[10] University of Innsbruck, Innsbruck

[11] Iowa State University, Ames, IA

[12] Fermi National Accelerator Laboratory, Batavia, IL

[13] University of Vienna, Vienna

来源：

Computing and Software for Big Science | 2019年 / 3卷 / 1期

关键词：

Data access; Data management; Data organization; Distributed computing; Exascale;

D O I：

10.1007/s41781-019-0026-3

中图分类号：

学科分类号：

摘要：

Rucio is an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The data can be distributed across heterogeneous data centers at widely distributed locations. Rucio was originally developed to meet the requirements of the high-energy physics experiment ATLAS, and now is continuously extended to support the LHC experiments and other diverse scientific communities. In this article, we detail the fundamental concepts of Rucio, describe the architecture along with implementation details, and report operational experience from production usage. © 2019, The Author(s).

引用

共 81 条

[11]

Overview of ATLAS PanDA workload management, J Phys Conf Ser, 331, (2011)

[12]

Multilevel workflow system in the ATLAS Experiment, J Phys Conf Ser, 608, (2015)

[13]

Elsing M., Goossens L., Nairz A., The ATLAS Tier-0: overview and operational experience, J Phys Conf Ser, 219, (2010)

[14]

Vazquez W.P., The ATLAS data acquisition system in LHC run-2, J Phys Conf Ser, 898, 3, (2017)

[15]

Leggett C., Baines J., Bold T., AthenaMT: upgrading the ATLAS software framework for the many-core world with multi-threading, J Phys Conf Ser, 898, 4, (2017)

[16]

Beck K., Et al., Manifesto for Agile Software Development. Agile Alliance, (2001)

[17]

Peters A.J., Sindrilaru E.A., Adde G., EOS as the present and future solution for data storage at CERN, J Phys Conf Ser, 664, (2015)

[18]

(2018)

[19]

Xrootd., (2018)

[20]

Corso E., Cozzini S., Donno F., Et al., StoRM: An SRM implementation for LHC analysis farms, Proceedings of International Computing in High Energy Physics, (2006)

← 1 2 3 4 5 6 7 8 9 →