Management of heterogeneous data in the Red Climatologica UACJ in a NoSQL environment

被引:0
|
作者
Jimenez, Alicia [1 ]
Nieves, Jose [1 ]
Estrada, Fernando [1 ]
Vazquez-Galvez, Felipe A. [1 ]
Hernandez, Israel [1 ]
机构
[1] Univ Autonoma Ciudad Juarez, Dept Ingn & Tecnol, Ciudad Juarez, Chihuahua, Mexico
来源
2019 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC 2019) | 2019年
关键词
NoSQL; MongoDB; linear regression; heterogeneous data; homogenization;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The meteorological data in networks are susceptible to errors and irregularities, one of the reasons is because they are collected by different types of meteorological stations, the possibility of heterogeneous data, so they limit their assimilation to models and interpretation platforms. This paper presents a project that aims to assist the Laboratorio de Climatologia y Calidad del Aire in the analysis of the Red-Clima UACJ, through the creation of a NoSQL environment in which there is a process for the quality assessment of the data, as well as the necessary management for the homogenization and visualization of it. The quality assessment using a series of quality control algorithms can detect possible anomalies in the behavior of the data for later review and modification. For the management it is necessary to create a framework with the objective to homogenize the climatic information contained in MongoDB, providing as a result a dataset in JSON, CSV or XML format.
引用
收藏
页数:6
相关论文
共 26 条
  • [1] Framework for Heterogeneous Data Management: An Application Case in a NoSQL Environment from a Climatological Center
    Jimenez-Galina, Alicia Margarita
    Maldonado-Macias, Aide Aracely
    Olmos-Sanchez, Karla Miroslava
    Hernandez, Israel
    Estrada-Saldana, Fernando
    Vazquez-Galvez, Felipe Adrian
    COMPUTACION Y SISTEMAS, 2024, 28 (01): : 167 - 178
  • [2] A Federated Approach on Heterogeneous NoSQL Data Stores
    Dharmasiri, H. M. L.
    Goonetillake, M. D. J. S.
    2013 INTERNATIONAL CONFERENCE ON ADVANCES IN ICT FOR EMERGING REGIONS (ICTER), 2013, : 234 - 239
  • [3] Survey on NoSQL for management of big data
    Shen, De-Rong
    Yu, Ge
    Wang, Xi-Te
    Nie, Tie-Zheng
    Kou, Yue
    Ruan Jian Xue Bao/Journal of Software, 2013, 24 (08): : 1786 - 1803
  • [4] NoSQL Databases for Big Data Management
    Gaspar, Drazena
    Mabic, Mirela
    CENTRAL EUROPEAN CONFERENCE ON INFORMATION AND INTELLIGENT SYSTEMS (CECIIS 2016), 2016, : 3 - 10
  • [5] NoSQL Systems for Big Data Management
    Gudivada, Venkat N.
    Rao, Dhana
    Raghavan, Vijay V.
    2014 IEEE WORLD CONGRESS ON SERVICES (SERVICES), 2014, : 190 - 197
  • [6] An Improved Integration Solution of Heterogeneous Materials Data Based on NoSQL
    Cao, Min
    Chen, Pan-pan
    COMPUTER SCIENCE AND TECHNOLOGY (CST2016), 2017, : 461 - 474
  • [7] Data Provenance Management for Bioinformatics Workflows using NoSQL Database Systems in a Cloud Computing Environment
    Hondo, Fernanda
    Wercelens, Polyane
    da Silva, Waldeyr
    Castro, Klayton
    Santana, Ingrid
    Walter, Maria Emilia
    Araujo, Aleteia
    Holanda, Maristela
    Lifschitz, Sergio
    2017 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2017, : 1929 - 1934
  • [8] Evaluation of Relational and NoSQL Approaches for Patient Cohort Identification from Heterogeneous Data Sources
    Zeng, Ningzhou
    Zhang, Guo-Qiang
    Li, Xiaojin
    Cui, Licong
    2017 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2017, : 1135 - 1140
  • [9] Data management in cloud environments: NoSQL and NewSQL data stores
    Grolinger K.
    Higashino W.A.
    Tiwari A.
    Capretz M.A.M.
    Journal of Cloud Computing: Advances, Systems and Applications, 2 (1):
  • [10] Enhanced Elearning Application for Data Mining in a NoSQL Distributed Database Management System
    Valentin, Pupezescu
    Mailena-Catalina, Dragomir
    PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON VIRTUAL LEARNING, ICVL 2019, 2019, : 476 - 482