PARALLEL PROCESSING OF LARGE DATA SETS IN PARTICLE PHYSICS

被引:0
|
作者
Rotaru, Marina [1 ]
Ciubancan, Mihai [1 ]
Stoicea, Gabriel [1 ]
机构
[1] Horia Hulubei Natl Inst Phys & Nucl Engn, Reactorului 30,POB MG6, RO-077125 Magurele, Romania
来源
ROMANIAN JOURNAL OF PHYSICS | 2016年 / 61卷 / 1-2期
关键词
particle physics; PROOF; protocols; data analysis;
D O I
暂无
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The analysis of the LHC data aims to minimize the vast amounts of data and the number of observables used. After slimming and skimming the data, the remaining terabytes of ROOT files hold a selection of the events and a fiat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF has an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF-Lite, PROOF Cluster or PROOF on Demand tools. In this paper we compared performance of different methods of file access (NFS, XROOTD, RFIO). The tests were done on Bucharest ATLAS Analysis Facility.
引用
收藏
页码:245 / 252
页数:8
相关论文
共 50 条
  • [21] The Birth of Particle Physics In Spain
    Víctor Navarro-Brotóns
    Jorge Velasco González
    José Doménech Torres
    Minerva, 2005, 43 : 183 - 196
  • [22] Prospects of elementary particle physics
    Kazakov, D., I
    PHYSICS-USPEKHI, 2019, 62 (04) : 364 - 377
  • [23] Machine Learning in Particle Physics
    Purohit, Milind, V
    BIG DATA ANALYTICS IN ASTRONOMY, SCIENCE, AND ENGINEERING, BDA 2023, 2024, 14516 : 128 - 138
  • [24] A Note on Blind Techniques for New Physics Searches in Particle Physics
    Chekanov, Sergei V.
    PARTICLES, 2024, 7 (03) : 647 - 652
  • [25] Validation of large data sets, an essential prerequisite for data analysis: An analytical survey of the Bone Marrow Donors Worldwide
    Schipper, RF
    Oudshoorn, M
    DAmaro, J
    vanderZanden, HGM
    deLange, P
    Bakker, JT
    Bakker, J
    vanRood, JJ
    TISSUE ANTIGENS, 1996, 47 (03): : 169 - 178
  • [26] ParNCL and ParGAL: Data-parallel tools for postprocessing of large-scale Earth science data
    Jacob, Robert
    Krishna, Jayesh
    Xu, Xiabing
    Tautges, Tim
    Grindeanu, Iulian
    Latham, Rob
    Peterson, Kara
    Bochev, Pavel
    Haley, Mary
    Brown, David
    Brownrigg, Richard
    Shea, Dennis
    Huang, Wei
    Middleton, Don
    2013 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, 2013, 18 : 1245 - 1254
  • [27] Automating image processing for scientific data analysis of a large image database
    Chien, SA
    Mortensen, HB
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1996, 18 (08) : 854 - 859
  • [28] Search for computational workflow synergies in reproducible research data analyses in particle physics and life sciences
    Simko, Tibor
    Cranmer, Kyle
    Crusoe, Michael R.
    Heinrich, Lukas
    Khodak, Anton
    Kousidis, Dinos
    Rodriguez, Diego
    2018 IEEE 14TH INTERNATIONAL CONFERENCE ON E-SCIENCE (E-SCIENCE 2018), 2018, : 403 - 404
  • [29] Particle Physics - Logical and Philosophical Comment
    Rubashkin, Valery
    VOPROSY FILOSOFII, 2015, (05) : 45 - 57
  • [30] Astro-Particle Physics at INFN
    Cremonesi, Oliviero
    UNIVERSE, 2021, 7 (07)