Building a scientific data grid with DIGS

被引:2
作者
Beckett, Mark G. [1 ]
Allton, Chris R. [2 ]
Davies, Christine T. H. [3 ]
Davis, Ilan [4 ]
Flynn, Jonathan M. [5 ]
Grant, Eilidh J. [1 ]
Hamilton, Russell S. [4 ]
Irving, Alan C. [6 ]
Kenway, R. D. [1 ]
Ostrowski, Radoslaw H. [1 ]
Perry, James T. [1 ]
Swedlow, Jason R. [7 ]
Trew, Arthur [1 ]
机构
[1] Univ Edinburgh, Sch Phys & Astron, Edinburgh EH9 3JZ, Midlothian, Scotland
[2] Univ Coll Swansea, Dept Phys, Swansea SA2 8PP, W Glam, Wales
[3] Univ Glasgow, Dept Phys & Astron, Glasgow G12 8QQ, Lanark, Scotland
[4] Univ Oxford, Dept Biochem, Oxford OX1 3QU, England
[5] Univ Southampton, Sch Phys & Astron, Southampton SO17 1BJ, Hants, England
[6] Univ Liverpool, Dept Math Sci, Liverpool L69 3BX, Merseyside, England
[7] Univ Dundee, Coll Life Sci, Dundee DD1 5EH, Scotland
来源
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES | 2009年 / 367卷 / 1897期
关键词
scientific data infrastructure; distributed data management; grid; molecular biology; computational particle physics;
D O I
10.1098/rsta.2009.0050
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We provide an insight into the challenge of building and supporting a scientific data infrastructure with reference to our experience working with scientists from computational particle physics and molecular biology. We illustrate how, with modern high-performance computing resources, even small scientific groups can generate huge volumes (petabytes) of valuable scientific data and explain how grid technology can be used to manage, publish, share and curate these data. We describe the DIGS software application, which we have developed to meet the needs of smaller communities and we have highlighted the key elements of its functionality.
引用
收藏
页码:2471 / 2481
页数:11
相关论文
共 13 条
[1]   From gridmap-file to VOMS: managing authorization in a Grid environment [J].
Alfieri, R ;
Cecchini, R ;
Ciaschini, V ;
dell'Agnello, L ;
Frohner, A ;
Lorentey, K ;
Spataro, E .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2005, 21 (04) :549-558
[2]   Physical results from 2+1 flavor domain wall QCD and SU(2) chiral perturbation theory [J].
Allton, C. ;
Antonio, D. J. ;
Aoki, Y. ;
Blum, T. ;
Boyle, P. A. ;
Christ, N. H. ;
Clark, M. A. ;
Cohen, S. D. ;
Dawson, C. ;
Donnellan, M. A. ;
Flynn, J. M. ;
Hart, A. ;
Izubuchi, T. ;
Jung, C. ;
Juttner, A. ;
Kennedy, A. D. ;
Kenway, R. D. ;
Li, M. ;
Li, S. ;
Lin, M. F. ;
Mawhinney, R. D. ;
Maynard, C. M. ;
Ohta, S. ;
Pendleton, B. J. ;
Sachrajda, C. T. ;
Sasaki, S. ;
Scholz, E. E. ;
Soni, A. ;
Tweedie, R. J. ;
Wennekers, J. ;
Yamazaki, T. ;
Zanotti, J. M. .
PHYSICAL REVIEW D, 2008, 78 (11)
[3]  
BOYLE PA, 2004, P 2004 ACM IEEE C SU
[4]  
CODDINGTON P, 2007, P 25 INT S LATT FIEL
[5]  
Donno F., 2008, Journal of Physics: Conference Series, V119, DOI 10.1088/1742-6596/119/6/062028
[6]   The Chroma software system for lattice QCD [J].
Edwards, RG ;
Joó, B .
NUCLEAR PHYSICS B-PROCEEDINGS SUPPLEMENTS, 2005, 140 :832-834
[7]  
Göckeler M, 2006, PHYS REV D, V73, DOI [10.1103/PhysRevD.73.014513, 10.1103/PhysRevD73.014513]
[8]  
GREGORY EB, 2008, HIGH STAT STUDY FLAV
[9]   A bioinformatics search pipeline, RNA2DSearch, identifies RNA localization elements in Drosophila retrotransposons [J].
Hamilton, Russell S. ;
Hartswood, Eve ;
Vendra, Georgia ;
Jones, Cheryl ;
Van De Bor, Veronique ;
Finnegan, David ;
Davis, Ilan .
RNA, 2009, 15 (02) :200-207
[10]   QCDml: First milestones for building an International Lattice Data Grid [J].
Maynard, CM ;
Pleiter, D .
NUCLEAR PHYSICS B-PROCEEDINGS SUPPLEMENTS, 2005, 140 :213-221