Rucio: Scientific Data Management

被引:80
作者
Barisits M. [1 ]
Beermann T. [2 ]
Berghaus F. [3 ]
Bockelman B. [4 ]
Bogado J. [5 ]
Cameron D. [6 ]
Christidis D. [7 ]
Ciangottini D. [8 ]
Dimitrov G. [1 ]
Elsing M. [1 ]
Garonne V. [6 ]
di Girolamo A. [1 ]
Goossens L. [1 ]
Guan W. [9 ]
Guenther J. [1 ]
Javurek T. [1 ]
Kuhn D. [10 ]
Lassnig M. [1 ]
Lopez F. [5 ]
Magini N. [11 ]
Molfetas A. [1 ]
Nairz A. [1 ]
Ould-Saada F. [6 ]
Prenner S. [10 ]
Serfon C. [10 ]
Stewart G. [1 ]
Vaandering E. [12 ]
Vasileva P. [1 ]
Vigne R. [13 ]
Wegner T. [1 ]
机构
[1] CERN, Meyrin
[2] University of Wuppertal, Wuppertal
[3] University of Victoria, Victoria
[4] Morgridge Institute, Madison, WI
[5] Universidad Nacional de La Plata, La Plata
[6] University of Oslo, Oslo
[7] University of Texas at Arlington, Arlington, TX
[8] INFN, Perugia
[9] University of Wisconsin-Madison, Madison, WI
[10] University of Innsbruck, Innsbruck
[11] Iowa State University, Ames, IA
[12] Fermi National Accelerator Laboratory, Batavia, IL
[13] University of Vienna, Vienna
关键词
Data access; Data management; Data organization; Distributed computing; Exascale;
D O I
10.1007/s41781-019-0026-3
中图分类号
学科分类号
摘要
Rucio is an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The data can be distributed across heterogeneous data centers at widely distributed locations. Rucio was originally developed to meet the requirements of the high-energy physics experiment ATLAS, and now is continuously extended to support the LHC experiments and other diverse scientific communities. In this article, we detail the fundamental concepts of Rucio, describe the architecture along with implementation details, and report operational experience from production usage. © 2019, The Author(s).
引用
收藏
相关论文
共 81 条
  • [1] The ATLAS experiment at the CERN large hadron collider, JINST, 3, (2008)
  • [2] About the ATLAS Experiment, (2018)
  • [3] Evans L., Bryant P., LHC machine, JINST, 3, (2008)
  • [4] (2018)
  • [5] Managing ATLAS data on a petabyte-scale with DQ2, J Phys Conf Ser, 119, (2008)
  • [6] Combined measurement of the Higgs boson mass in pp collisions at s =7 and 8 TeV with the ATLAS and CMS experiments, Phys Rev Lett, 114, (2015)
  • [7] Summary of the ATLAS experiment’s sensitivity to supersymmetry after LHC Run 1—interpreted in the phenomenological MSSM, JHEP, 1510, (2015)
  • [8] Search for TeV-scale gravity signatures in high-mass final states with leptons and jets with the ATLAS detector at s=13 TeV, Phys Lett B, 760, pp. 520-537, (2016)
  • [9] Constraints on mediator-based dark matter and scalar dark energy models using √s = 13 TeV pp collisions at the LHC with the ATLAS detector, ATLAS Conf, (2018)
  • [10] Filipi A., ATLAS distributed computing experience and performance during the LHC run-2, J Phys Conf Ser, 5, (2017)