Coordinating an operational data distribution network for CMIP6 data

被引:56
作者
Petrie, Ruth [1 ]
Denvil, Sebastien [2 ]
Ames, Sasha [3 ]
Levavasseur, Guillaume [2 ]
Fiore, Sandro [4 ,5 ]
Allen, Chris [6 ]
Antonio, Fabrizio [4 ]
Berger, Katharina [7 ]
Bretonniere, Pierre-Antoine [8 ]
Cinquini, Luca [9 ]
Dart, Eli [10 ]
Dwarakanath, Prashanth [11 ]
Druken, Kelsey [6 ]
Evans, Ben [6 ]
Franchisteguy, Laurent [12 ]
Gardoll, Sebastien [2 ]
Gerbier, Eric [12 ]
Greenslade, Mark [2 ]
Hassell, David [13 ]
Iwi, Alan [1 ]
Juckes, Martin [1 ]
Kindermann, Stephan [7 ]
Lacinski, Lukasz [14 ]
Mirto, Maria [4 ]
Ben Nasser, Atef [2 ]
Nassisi, Paola [4 ]
Nienhouse, Eric [15 ]
Nikonov, Sergey [16 ]
Nuzzo, Alessandra [4 ]
Richards, Clare [6 ]
Ridzwan, Syazwan [6 ]
Rixen, Michel [17 ]
Serradell, Kim [8 ]
Snow, Kate [6 ]
Stephens, Ag [1 ]
Stockhause, Martina [7 ]
Vahlenkamp, Hans [16 ]
Wagner, Rick [14 ]
机构
[1] UK Res & Innovat, Swindon, Wilts, England
[2] CNRS, Inst Pierre Simon Laplace, Paris, France
[3] Lawrence Livermore Natl Lab, Ctr Appl Sci Comp, Livermore, CA 94550 USA
[4] Euro Mediterranean Ctr Climate Change Fdn, Lecce, Italy
[5] Univ Trento, Trento, Italy
[6] Australian Natl Univ, Natl Computat Infrastruct, Canberra, ACT, Australia
[7] German Climate Comp Ctr, Hamburg, Germany
[8] Barcelona Supercomp Ctr, Barcelona, Spain
[9] NASA, Jet Prop Lab, Pasadena, CA USA
[10] Lawrence Berkeley Natl Lab, Energy Sci Network, Berkeley, CA USA
[11] Linkoping Univ, Linkoping, Sweden
[12] Univ Toulouse, Ctr Natl Rech Meteorol, CNRS, Meteo France, Toulouse, France
[13] Natl Ctr Atmospher Sci, Leeds, W Yorkshire, England
[14] Argonne Natl Lab, Chicago, IL USA
[15] Natl Ctr Atmospher Res, POB 3000, Boulder, CO 80307 USA
[16] Geophys Fluid Dynam Lab, Princeton, NJ USA
[17] WHO, Geneva, Switzerland
关键词
INFRASTRUCTURE; SUPPORT;
D O I
10.5194/gmd-14-629-2021
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
The distribution of data contributed to the Coupled Model Intercomparison Project Phase 6 (CMIP6) is via the Earth System Grid Federation (ESGF). The ESGF is a network of internationally distributed sites that together work as a federated data archive. Data records from climate modelling institutes are published to the ESGF and then shared around the world. It is anticipated that CMIP6 will produce approximately 20 PB of data to be published and distributed via the ESGF. In addition to this large volume of data a number of value-added CMIP6 services are required to interact with the ESGF; for example the citation and errata services both interact with the ESGF but are not a core part of its infrastructure. With a number of interacting services and a large volume of data anticipated for CMIP6, the CMIP Data Node Operations Team (CDNOT) was formed. The CDNOT coordinated and implemented a series of CMIP6 preparation data challenges to test all the interacting components in the ESGF CMIP6 software ecosystem. This ensured that when CMIP6 data were released they could be reliably distributed. No. DE-ACO2-05CH11231 and authors at Lawrence Livermore National Laboratory (LLNL) under contract DE-AC52-07NA27344 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan).
引用
收藏
页码:629 / 644
页数:16
相关论文
共 17 条
[1]   Requirements for a global data infrastructure in support of CMIP6 [J].
Balaji, Venkatramani ;
Taylor, Karl E. ;
Juckes, Martin ;
Lawrence, Bryan N. ;
Durack, Paul J. ;
Lautenschlager, Michael ;
Blanton, Chris ;
Cinquini, Luca ;
Denvil, Sebastien ;
Elkingtonl, Mark ;
Guglielmo, Francesca ;
Guilyardi, Eric ;
Hasse, David ;
Kharin, Slava ;
Kindermann, Stefan ;
Nikonov, Sergey ;
Radhakrishnan, Aparna ;
Stockhause, Martina ;
Weigel, Tobias ;
Williams, Dean .
GEOSCIENTIFIC MODEL DEVELOPMENT, 2018, 11 (09) :3659-3680
[2]  
Ben Nasser A., SYNDA SYNCHRONIZED Y
[3]  
Ben Nasser A., ERRATA WEB SERVICE
[4]  
BenNasser A., ES DOC ISSUE CLIENT
[5]   The Earth System Grid Federation: An open infrastructure for access to distributed geospatial data [J].
Cinquini, Luca ;
Crichton, Daniel ;
Mattmann, Chris ;
Harney, John ;
Shipman, Galen ;
Wang, Feiyi ;
Ananthakrishnan, Rachana ;
Miller, Neill ;
Denvil, Sebastian ;
Morgan, Mark ;
Pobre, Zed ;
Bell, Gavin M. ;
Doutriaux, Charles ;
Drach, Robert ;
Williams, Dean ;
Kershaw, Philip ;
Pascoe, Stephen ;
Gonzalez, Estanislao ;
Fiore, Sandro ;
Schweitzer, Roland .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF GRID COMPUTING AND ESCIENCE, 2014, 36 :400-417
[6]   The Science DMZ: A Network Design Pattern for Data-Intensive Science [J].
Dart, Eli ;
Rotman, Lauren ;
Tierney, Brian ;
Hester, Mary ;
Zurawski, Jason .
2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC), 2013,
[7]  
DeLuca C., 2013, EARTH SYST COG COLL, V2013
[8]   Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization [J].
Eyring, Veronika ;
Bony, Sandrine ;
Meehl, Gerald A. ;
Senior, Catherine A. ;
Stevens, Bjorn ;
Stouffer, Ronald J. ;
Taylor, Karl E. .
GEOSCIENTIFIC MODEL DEVELOPMENT, 2016, 9 (05) :1937-1958
[9]   The CMIP6 Data Request (DREQ, version 01.00.31) [J].
Juckes, Martin ;
Taylor, Karl E. ;
Durack, Paul J. ;
Lawrence, Bryan ;
Mizielinski, Matthew S. ;
Pamment, Alison ;
Peterschmitt, Jean-Yves ;
Rixen, Michel ;
Senesi, Stephane .
GEOSCIENTIFIC MODEL DEVELOPMENT, 2020, 13 (01) :201-224
[10]   Documenting numerical experiments in support of the Coupled Model Intercomparison Project Phase 6 (CMIP6) [J].
Pascoe, Charlotte ;
Lawrence, Bryan N. ;
Guilyardi, Eric ;
Juckes, Martin ;
Taylor, Karl E. .
GEOSCIENTIFIC MODEL DEVELOPMENT, 2020, 13 (05) :2149-2167