An Operator Library System for HEP Events Processing Based on Hbase Coprocessor

被引:0
|
作者
Du, Zirong [1 ]
Hou, Di [2 ]
Qi, Yong [2 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian, Peoples R China
来源
BIG SCIENTIFIC DATA MANAGEMENT | 2019年 / 11473卷
关键词
Scientific big data; High-energy physics; Event analysis; Operator library; Hbase coprocessor;
D O I
10.1007/978-3-030-28061-1_13
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
At present, data generated by high-energy physical devices has reached the PB or EB level as it is constantly updated and running. Therefore, the technical requirements for physical analysis are constantly increasing with the mass of physical events generated by high-energy physical colliders. The physical analysis for high-energy physics events refers to the selection of thousands of meaningful events from massive physical events. The analysis process relies on different attribute parameters and different operators to obtain the final selection criteria. Because the traditional method of high-energy physics events analysis is less efficient and more complex, it is very important to design an efficient and convenient operator library for high-energy physics events processing. This paper proposes a new operator library system based on hbase coprocessor for high-energy physics events processing. It uses storage structure and endpoint coprocessor of the hbase as the framework of the physical analysis operator library, uses protocol buffer to customize the client and server RPC communication and encapsulates the operators in the object-oriented data analysis framework ROOT to hbase coprocessor. In this way, the complexity of the high-energy physics events analysis is reduced and the efficiency of the calculation is improved. In the experiment, we take the zc3900 analysis process as an example and apply it to the 10 nodes experimental cluster. The test results show that the proposed system is more efficient and avoids the complexity of the events processing.
引用
收藏
页码:116 / 124
页数:9
相关论文
empty
未找到相关数据