Performance of R-GMA for monitoring grid jobs for CMS data production

被引:0
|
作者
Byrom, R. [1 ]
Colling, D. [1 ]
Fisher, S. M. [1 ]
Grandi, C. [1 ]
Hobson, P. R. [1 ]
Kyberd, P. [1 ]
MacEvoy, B. [1 ]
Nebrensky, J. J. [1 ]
Traylen, S. [1 ]
机构
[1] Rutherford Appleton Lab, Particle Phys Dept, Chilton, England
来源
2005 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-5 | 2005年
关键词
D O I
暂无
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
High Energy Physics experiments, such as the Compact Muon Solenoid (CMS) at the CERN laboratory in Geneva, have large-scale data processing requirements, with data accumulating at a rate of 1 Gbyte/s. This load comfortably exceeds any previous processing requirements and we believe it may be most efficiently satisfied through Grid computing. Furthermore the production of large quantities of Monte Carlo simulated data provides an ideal test bed for Grid technologies and will drive their development. One important challenge when using the Grid for data analysis is the ability to monitor transparently the large number of jobs that are being executed simultaneously at multiple remote sites. R-GMA is a monitoring and information management service for distributed resources based on the Grid Monitoring Architecture of the Global Grid Forum. We have previously developed a system allowing us to test its performance under a heavy load while using few real Grid resources. We present the latest results on this system running on the LCG 2 Grid test bed using the LCG 2.6.0 middleware release. For a sustained load equivalent to 7 generations of 1000 simultaneous jobs, R-GMA was able to transfer all published messages and store them in a database for 98% of the individual jobs. The failures experienced were at the remote sites, rather than at the archiver's MON box as had been expected.
引用
收藏
页码:860 / 864
页数:5
相关论文
共 20 条
  • [1] Performance of R-GMA based grid job monitoring system for CMS data production
    Byrom, R
    Colling, D
    Fisher, SM
    Grandi, C
    Hobson, PR
    Kyberd, P
    MacEvoy, B
    Nebrensky, JJ
    Tallini, H
    Traylen, S
    2004 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-7, 2004, : 2033 - 2037
  • [2] Scalability tests of R-GMA based grid job monitoring system for CMS Monte Carlo data production.
    Bonacorsi, D
    Colling, D
    Field, L
    Fisher, S
    Grandi, C
    Hobson, PR
    Kyberd, P
    MacEvoy, B
    Nebrensky, JJ
    Tallini, H
    Traylen, S
    2003 IEEE NUCLEAR SCIENCE SYMPOSIUM, CONFERENCE RECORD, VOLS 1-5, 2004, : 1630 - 1632
  • [3] R-GMA: An information integration system for grid monitoring
    Cooke, A
    Gray, AJG
    Ma, LS
    Nutt, W
    Magowan, J
    Oevers, M
    Taylor, P
    Byrom, R
    Field, L
    Hicks, S
    Leake, J
    Soni, M
    Wilson, A
    Cordenonsi, R
    Cornwall, L
    Djaoui, A
    Fisher, S
    Podhorszki, N
    Coghlan, B
    Kenny, S
    O'Callaghan, D
    ON THE MOVE TO MEANINGFUL INTERNET SYSTEMS 2003: COOPIS, DOA, AND ODBASE, 2003, 2888 : 462 - 481
  • [4] Monitoring message passing applications in the grid with GRM and R-GMA
    Podhorszki, N
    Kacsuk, P
    RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 2003, 2840 : 603 - 610
  • [5] The CanonicalProducer: an instrument monitoring component of the Relational Grid Monitoring Architecture (R-GMA)
    Byrom, R
    Coghlan, B
    Cooke, A
    Cordenonsi, R
    Cornwall, L
    Datta, A
    Djaoui, A
    Field, L
    Fisher, S
    Hicks, S
    Kenny, S
    Magowan, J
    Nutt, W
    O'Callaghan, D
    Oevers, M
    Podhorszki, N
    Ryan, J
    Soni, M
    Taylor, P
    Wilson, A
    Zhu, XM
    ISPDC 2004: THIRD INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED COMPUTING/HETEROPAR '04: THIRD INTERNATIONAL WORKSHOP ON ALGORITHMS, MODELS AND TOOLS FOR PARALLEL COMPUTING ON HETEROGENEOUS NETWORKS, PROCEEDINGS, 2004, : 232 - 237
  • [6] Prototype a knowledge discovery infrastructure by implementing Relational Grid Monitoring Architecture (R-GMA) on European Data Grid (EDG)
    Wang, F
    Helian, N
    Guo, Y
    Thompson, S
    Gordon, J
    GRID AND COOPERATIVE COMPUTING, PT 2, 2004, 3033 : 811 - 814
  • [7] Fault tolerance in the R-GMA information and monitoring system
    Byrom, R
    Coghlan, B
    Cooke, A
    Cordenonsi, R
    Cornwall, L
    Craig, M
    Djaoui, A
    Duncan, A
    Fisher, S
    Gray, A
    Hicks, S
    Kenny, S
    Leake, J
    Lyttleton, O
    Magowan, J
    Middleton, R
    Nutt, W
    O'Callaghan, D
    Podhorszki, N
    Taylor, P
    Walk, J
    Wilson, A
    ADVANCES IN GRID COMPUTING - EGC 2005, 2005, 3470 : 751 - 760
  • [8] Scalability tests of R-GMA-based grid job monitoring system for CMS Monte Carlo data production
    Bonacorsi, D
    Colling, D
    Field, L
    Fisher, SM
    Grandi, C
    Hobson, PR
    Kyberd, P
    MacEvoy, B
    Nebrensky, JJ
    Tallini, H
    Traylen, S
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2004, 51 (06) : 3026 - 3029
  • [9] Scalability analysis of three monitoring and information systems: MDS2, R-GMA, and Hawkeye
    Zhang, Xuehai
    Freschl, Jeffrey L.
    Schopf, Jennifer M.
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2007, 67 (08) : 883 - 902
  • [10] A data grid prototype for distributed data production in CMS
    Hafeez, M
    Samar, A
    Stockinger, H
    ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH, 2001, 583 : 241 - 243