PARALLEL PROCESSING OF LARGE DATA SETS IN PARTICLE PHYSICS

被引：0
|
作者：
Rotaru, Marina [1 ]
Ciubancan, Mihai [1 ]
Stoicea, Gabriel [1 ]
机构：
[1] Horia Hulubei Natl Inst Phys & Nucl Engn, Reactorului 30,POB MG6, RO-077125 Magurele, Romania
来源：
ROMANIAN JOURNAL OF PHYSICS | 2016年 / 61卷 / 1-2期
关键词：
particle physics; PROOF; protocols; data analysis;
D O I：
暂无
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
The analysis of the LHC data aims to minimize the vast amounts of data and the number of observables used. After slimming and skimming the data, the remaining terabytes of ROOT files hold a selection of the events and a fiat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF has an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF-Lite, PROOF Cluster or PROOF on Demand tools. In this paper we compared performance of different methods of file access (NFS, XROOTD, RFIO). The tests were done on Bucharest ATLAS Analysis Facility.
引用
收藏
页码：245 / 252
页数：8
相关论文
共 50 条
  • [1] DEALING WITH LARGE DATA SETS
    GRAEFE, JF
    WOOD, RW
    NEUROTOXICOLOGY AND TERATOLOGY, 1990, 12 (05) : 449 - 454
  • [2] Query-driven visualization of large data sets
    Stockinger, K
    Shalf, J
    Wu, KS
    Bethel, EW
    IEEE VISUALIZATION 2005, PROCEEDINGS, 2005, : 167 - 174
  • [3] A prototype framework for parallel visualization of large flow data
    Liu, Zhanping
    ADVANCES IN ENGINEERING SOFTWARE, 2019, 130 : 14 - 23
  • [4] Particle physics with neutrons
    Dubbers, D
    PHYSICA B, 1997, 234 : 1 - 7
  • [5] The Multiverse and Particle Physics
    Donoghue, John F.
    ANNUAL REVIEW OF NUCLEAR AND PARTICLE SCIENCE, VOL 66, 2016, 66 : 1 - 21
  • [6] The future of particle physics
    Mangano, Michelangelo L.
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2007, 572 (01) : 1 - 7
  • [7] Optimal fast Johnson-Lindenstrauss embeddings for large data sets
    Bamberger, Stefan
    Krahmer, Felix
    SAMPLING THEORY SIGNAL PROCESSING AND DATA ANALYSIS, 2021, 19 (01):
  • [8] Particle Physics and Cosmology Intertwined
    Nath, Pran
    ENTROPY, 2024, 26 (02)
  • [9] CRYSTAL CALORIMETERS IN PARTICLE PHYSICS
    GRATTA, G
    NEWMAN, H
    ZHU, RY
    ANNUAL REVIEW OF NUCLEAR AND PARTICLE SCIENCE, 1994, 44 : 453 - 500
  • [10] Practical statistics for particle physics
    Barlow R.J.
    CERN Yellow Reports: School Proceedings, 2021, 5 : 197 - 245
12345