Scientific Data Management and Application in High Energy Physics

被引：0

作者：

Chen, Gang ^{[1
]}

Chen, Yaodong ^{[1
]}

机构：

[1] Chinese Acad Sci, Inst High Energy Phys IHEP, Beijing, Peoples R China

来源：

BIG SCIENTIFIC DATA MANAGEMENT | 2019年 / 11473卷

基金：

中国国家自然科学基金;

关键词：

Scientific data management; EventDB; EOS; High energy physics; STORAGE-SYSTEM; ARCHITECTURE; GENERATION;

D O I：

10.1007/978-3-030-28061-1_11

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

High energy physics experiments have been producing a large amount of data at PB or EB level, and there will be ambitious experimental programs in the coming decades. The efficiency of data-intensive researches is closely related to how fast data can be accessed and how many computational resources can be used. Changes in computing technology and large increases in data volume require new computing models. This paper will give an overall introduction to scientific data management technologies and applications in high energy physics. The current data management framework and workflow will be investigated at first. These include data acquisition, data transfer, data storage, data processing, data sharing and data preservation. Then some ongoing research and development on data organization, management and access will be introduced. Finally the EventDB, an event-based big scientific data management system will be introduced. The test on more than ten billion physics events shows the query speed is greatly improved than traditional file-base data management system.

引用

页码：92 / 104

页数：13

共 31 条

[1] Akopov Z., 2012, ARXIV PREPRINT ARXIV
[2] Anh-Ky N., 2017, ARXIV PREPRINT ARXIV
[3] [Anonymous], **DATA OBJECT**
[4] Apollinari G., 2017, CERN YELLOW REPORTS
[5] FTS3: New Data Movement Service For WLCG
Ayllon, A. A.
Salichos, M.
Simon, M. K.
Keeble, O.
[J]. 20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
[6] The ATLAS EventIndex: architecture, design choices, deployment and first operation experience
Barberis, D.
Cardenas Zarate, S. E.
Cranshaw, J.
Favareto, A.
Fernandez Casani, A.
Gallas, E. J.
Glasman, C.
Gonzalez de la Hoz, S.
Hrivnac, J.
Malon, D.
Prokoshin, F.
Salt Cairols, J.
Sanchez, J.
Toebbicke, R.
Yuan, R.
[J]. 21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
[7] Baud J.-P., 2004, EVOLUTION LCG 2 DATA
[8] Design and operation of the BES-III distributed computing system
Belov, S.
Suo, B.
Deng, Z. Y.
Korenkov, V.
Li, W. D.
Lin, T.
Ma, Z. T.
Nicholson, C.
Pelevanyuk, I.
Trofimov, V.
Uzhinskiy, A.
Yan, T.
Yan, X. F.
Zhang, X. M.
Zhemchugov, A.
[J]. 4TH INTERNATIONAL YOUNG SCIENTIST CONFERENCE ON COMPUTATIONAL SCIENCE, 2015, 66 : 619 - 624
[9] WLCG service challenges and tiered architecture in the LHC era
Bonacorsi, Daniele
Ferrari, Tiziana
[J]. IFAE 2006: ITALIAN MEETING ON HIGH ENERGY PHYSICS, 2007, : 365 - +
[10] Rivet user manual
Buckley, Andy
Butterworth, Jonathan
Grellscheid, David
Hoeth, Hendrik
Loennblad, Leif
Monk, James
Schulz, Holger
Siegert, Frank
[J]. COMPUTER PHYSICS COMMUNICATIONS, 2013, 184 (12) : 2803 - 2819

← 1 2 3 4 →