Rucio: Scientific Data Management

被引:80
作者
Barisits M. [1 ]
Beermann T. [2 ]
Berghaus F. [3 ]
Bockelman B. [4 ]
Bogado J. [5 ]
Cameron D. [6 ]
Christidis D. [7 ]
Ciangottini D. [8 ]
Dimitrov G. [1 ]
Elsing M. [1 ]
Garonne V. [6 ]
di Girolamo A. [1 ]
Goossens L. [1 ]
Guan W. [9 ]
Guenther J. [1 ]
Javurek T. [1 ]
Kuhn D. [10 ]
Lassnig M. [1 ]
Lopez F. [5 ]
Magini N. [11 ]
Molfetas A. [1 ]
Nairz A. [1 ]
Ould-Saada F. [6 ]
Prenner S. [10 ]
Serfon C. [10 ]
Stewart G. [1 ]
Vaandering E. [12 ]
Vasileva P. [1 ]
Vigne R. [13 ]
Wegner T. [1 ]
机构
[1] CERN, Meyrin
[2] University of Wuppertal, Wuppertal
[3] University of Victoria, Victoria
[4] Morgridge Institute, Madison, WI
[5] Universidad Nacional de La Plata, La Plata
[6] University of Oslo, Oslo
[7] University of Texas at Arlington, Arlington, TX
[8] INFN, Perugia
[9] University of Wisconsin-Madison, Madison, WI
[10] University of Innsbruck, Innsbruck
[11] Iowa State University, Ames, IA
[12] Fermi National Accelerator Laboratory, Batavia, IL
[13] University of Vienna, Vienna
关键词
Data access; Data management; Data organization; Distributed computing; Exascale;
D O I
10.1007/s41781-019-0026-3
中图分类号
学科分类号
摘要
Rucio is an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The data can be distributed across heterogeneous data centers at widely distributed locations. Rucio was originally developed to meet the requirements of the high-energy physics experiment ATLAS, and now is continuously extended to support the LHC experiments and other diverse scientific communities. In this article, we detail the fundamental concepts of Rucio, describe the architecture along with implementation details, and report operational experience from production usage. © 2019, The Author(s).
引用
收藏
相关论文
共 81 条
  • [51] Elastic N.V., (2018)
  • [52] Elastic N.V., Kibana., (2018)
  • [53] Fluentd, (2018)
  • [54] Redis, (2018)
  • [55] Elastic N.V., Logstash, (2018)
  • [56] (2018)
  • [57] (2018)
  • [58] Aimar A., Corman A.A., Andrade P., Et al., Unified monitoring architecture for IT and grid services, J Phys Conf Ser, 898, 9, (2017)
  • [59] (2018)
  • [60] Anisenkov A., Belov S., Di Girolamo A., Gayazov S., Klimentov A., Oleynik D., Senchenko A., AGIS: The ATLAS Grid Information System, J Phys Conf Ser, 396, (2012)