A canonical model for seasonal climate prediction using Big Data

被引:1
作者
Ramos, M. P. [1 ,2 ]
Tasinaffo, P. M. [1 ]
Cunha, A. M. [1 ]
Silva, D. A. [1 ]
Goncalves, G. S. [1 ]
Dias, L. A., V [1 ]
机构
[1] Brazilian Aeronaut Inst Technol, Comp & Elect Engn Grad Program, Sao Jose Dos Campos, SP, Brazil
[2] Brazilian Inst Space Res, Ctr Weather Forecasting & Climate Studies, Cachoeira Paulista, SP, Brazil
关键词
Big Data; Hadoop; Hive; MapReduce; Seasonal climate prediction; Atmospheric numerical model; PREDICTABILITY;
D O I
10.1186/s40537-022-00580-9
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This article addresses the elaboration of a canonical model, involving methods, techniques, metrics, tools, and Big Data, applied to the knowledge of seasonal climate prediction, aiming at greater dynamics, speed, conciseness, and scalability. The proposed model was hosted in an environment capable of integrating different types of meteorological data and centralizing data stores. The seasonal climate prediction method called M-PRECLIS was designed and developed for practical application. The usability and efficiency of the proposed model was tested through a case study that made use of operational data generated by an atmospheric numerical model of the climate area found in the supercomputing environment of the Center for Weather Forecasting and Climate Studies linked to the Brazilian Institute for Space Research. The seasonal climate prediction uses ensemble members method to work and the main Big Data technologies used for data processing were: Python language, Apache Hadoop, Apache Hive, and the Optimized Row Columnar (ORC) file format. The main contributions of this research are the canonical model, its modules and internal components, the proposed method M-PRECLIS, and its use in a case study. After applying the model to a practical and real experiment, it was possible to analyze the results obtained and verify: the consistency of the model by the output images, the code complexity, the performance, and also to perform the comparison with related works. Thus, it was found that the proposed canonical model, based on the best practices of Big Data, is a viable alternative that can guide new paths to be followed.
引用
收藏
页数:25
相关论文
共 47 条
  • [1] Almgren K., 2015, WEATHER DATA ANAL US
  • [2] [Anonymous], 2013, P 5 INT C INTERNET M
  • [3] [Anonymous], 2014, WORLD J COMPUTER APP
  • [4] Building and Operating a Large-Scale Enterprise Data Analytics Platform
    Bauer, Daniel
    Froese, Florian
    Garces-Erice, Luis
    Giblin, Chris
    Labbi, Abdel
    Nagy, Zoltan A.
    Pardon, Niels
    Rooney, Sean
    Urbanetz, Peter
    Vetsch, Pascal
    Wespi, Andreas
    [J]. BIG DATA RESEARCH, 2021, 23
  • [5] Programming big data analysis: principles and solutions
    Belcastro, Loris
    Cantini, Riccardo
    Marozzo, Fabrizio
    Orsino, Alessio
    Talia, Domenico
    Trunfio, Paolo
    [J]. JOURNAL OF BIG DATA, 2022, 9 (01)
  • [6] Cavalcanti IFA, 2002, J CLIMATE, V15, P2965, DOI 10.1175/1520-0442(2002)015<2965:GCFIAS>2.0.CO
  • [7] 2
  • [8] Cavalcanti IFA, 2009, TEMPO CLIMA BRASIL, P463
  • [9] Chan CS., 2011, PREVISOES CLIMATICAS
  • [10] Comparative skill assessment of consensus and physically based tercile probability seasonal precipitation forecasts for Brazil
    Coelho, Caio A. S.
    [J]. METEOROLOGICAL APPLICATIONS, 2013, 20 (02) : 236 - 245