The ATLAS EventIndex: architecture, design choices, deployment and first operation experience

被引:15
作者
Barberis, D. [1 ,2 ]
Cardenas Zarate, S. E. [3 ]
Cranshaw, J. [4 ]
Favareto, A. [1 ,2 ]
Fernandez Casani, A. [5 ,6 ]
Gallas, E. J. [7 ]
Glasman, C. [8 ]
Gonzalez de la Hoz, S. [5 ,6 ]
Hrivnac, J. [9 ,10 ]
Malon, D. [4 ]
Prokoshin, F. [3 ]
Salt Cairols, J. [5 ,6 ]
Sanchez, J. [5 ,6 ]
Toebbicke, R. [11 ]
Yuan, R. [9 ,10 ]
机构
[1] Univ Genoa, Genoa, Italy
[2] Ist Nazl Fis Nucl, I-16146 Genoa, Italy
[3] Univ Tecn Federico Santa Maria, Valparaiso, Chile
[4] Argonne Natl Lab, Argonne, IL 60439 USA
[5] Univ Valencia, Inst Fis Corpuscular IFIC, Valencia, Spain
[6] CSIC, Valencia, Spain
[7] Univ Oxford, Oxford, England
[8] Univ Autonoma Madrid, Madrid, Spain
[9] Univ Paris 11, LAL, Orsay, France
[10] CNRS IN2P3, Orsay, France
[11] CERN, Geneva, Switzerland
来源
21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9 | 2015年 / 664卷
关键词
D O I
10.1088/1742-6596/664/4/042003
中图分类号
O57 [原子核物理学、高能物理学];
学科分类号
070202 ;
摘要
The EventIndex is the complete catalogue of all ATLAS events, keeping the references to all files that contain a given event in any processing stage. It replaces the TAG database, which had been in use during LHC Run 1. For each event it contains its identifiers, the trigger pattern and the GUIDs of the files containing it. Major use cases are event picking, feeding the Event Service used on some production sites, and technical checks of the completion and consistency of processing campaigns. The system design is highly modular so that its components (data collection system, storage system based on Hadoop, query web service and interfaces to other ATLAS systems) could be developed separately and in parallel during LS1. The EventIndex is in operation for the start of LHC Run 2. This paper describes the high-level system architecture, the technical design choices and the deployment process and issues. The performance of the data collection and storage systems, as well as the query services, are also reported.
引用
收藏
页数:8
相关论文
共 12 条
[1]   The ATLAS Experiment at the CERN Large Hadron Collider [J].
Aad, G. ;
Abat, E. ;
Abdallah, J. ;
Abdelalim, A. A. ;
Abdesselam, A. ;
Abdinov, O. ;
Abi, B. A. ;
Abolins, M. ;
Abramowicz, H. ;
Acerbi, E. ;
Acharya, B. S. ;
Achenbach, R. ;
Ackers, M. ;
Adams, D. L. ;
Adamyan, F. ;
Addy, T. N. ;
Aderholz, M. ;
Adorisio, C. ;
Adragna, P. ;
Aharrouche, M. ;
Ahlen, S. P. ;
Ahles, F. ;
Ahmad, A. ;
Ahmed, H. ;
Aielli, G. ;
Akesson, P. F. ;
Akesson, T. P. A. ;
Alam, S. M. ;
Albert, J. ;
Albrand, S. ;
Aleksa, M. ;
Aleksandrov, I. N. ;
Aleppo, M. ;
Alessandria, F. ;
Alexa, C. ;
Alexander, G. ;
Alexopoulos, T. ;
Alimonti, G. ;
Aliyev, M. ;
Allport, P. P. ;
Allwood-Spiers, S. E. ;
Aloisio, A. ;
Alonso, J. ;
Alves, R. ;
Alviggi, M. G. ;
Amako, K. ;
Amaral, P. ;
Amaral, S. P. ;
Ambrosini, G. ;
Ambrosio, G. .
JOURNAL OF INSTRUMENTATION, 2008, 3
[2]   The future of event-level information repositories, indexing, and selection in ATLAS [J].
Barberis, D. ;
Cranshaw, J. ;
Dimitrov, G. ;
Doherty, T. ;
Gallas, E. J. ;
Hrivnac, J. ;
Malon, D. ;
Nairz, A. ;
Nowak, M. ;
Quilty, D. ;
Sorokoletov, R. ;
Van Gemmeren, P. ;
Zhang, Q. .
20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
[3]   The ATLAS Event Index: an event catalogue for experiments collecting large amounts of data [J].
Barberis, D. ;
Cranshaw, J. ;
Dimitrov, G. ;
Favareto, A. ;
Fernandez Casani, A. ;
Gonzalez de la Hoz, S. ;
Hrivnac, J. ;
Malon, D. ;
Nowak, M. ;
Salt Cairols, J. ;
Sanchez, J. ;
Sorokoletov, R. ;
Zhang, Q. .
20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
[4]  
Barberis D, 2012, CERN REPORT
[5]   A new petabyte-scale data derivation framework for ATLAS [J].
Catmore, James ;
Cranshaw, Jack ;
Gillam, Thomas ;
Gramstad, Eirik ;
Laycock, Paul ;
Ozturk, Nurcan ;
Stewart, Graeme Andrew .
21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
[6]   Conditions and configuration metadata for the ATLAS experiment [J].
Gallas, E. J. ;
Albrand, S. ;
Fulachier, J. ;
Lambert, F. ;
Pachal, K. E. ;
Tseng, J. C. L. ;
Zhang, Q. .
INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS 2012 (CHEP2012), PTS 1-6, 2012, 396
[7]   Rucio - The next generation of large scale distributed system for ATLAS Data Management [J].
Garonne, V. ;
Vigne, R. ;
Stewart, G. ;
Barisits, M. ;
Beermann, T. ;
Lassnig, M. ;
Serfon, C. ;
Goossens, L. ;
Nairz, A. .
20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
[8]  
Hrivnac J, 2015, J PHYS C SER
[9]  
Lopienski S., 2008, J PHYS C SER, V119, DOI DOI 10.1088/1742-6596/119/5/052025
[10]  
Prokoshin F, 2015, J PHYS C SER