Management of heterogeneous data in the Red Climatologica UACJ in a NoSQL environment

被引:0
|
作者
Jimenez, Alicia [1 ]
Nieves, Jose [1 ]
Estrada, Fernando [1 ]
Vazquez-Galvez, Felipe A. [1 ]
Hernandez, Israel [1 ]
机构
[1] Univ Autonoma Ciudad Juarez, Dept Ingn & Tecnol, Ciudad Juarez, Chihuahua, Mexico
来源
2019 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC 2019) | 2019年
关键词
NoSQL; MongoDB; linear regression; heterogeneous data; homogenization;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The meteorological data in networks are susceptible to errors and irregularities, one of the reasons is because they are collected by different types of meteorological stations, the possibility of heterogeneous data, so they limit their assimilation to models and interpretation platforms. This paper presents a project that aims to assist the Laboratorio de Climatologia y Calidad del Aire in the analysis of the Red-Clima UACJ, through the creation of a NoSQL environment in which there is a process for the quality assessment of the data, as well as the necessary management for the homogenization and visualization of it. The quality assessment using a series of quality control algorithms can detect possible anomalies in the behavior of the data for later review and modification. For the management it is necessary to create a framework with the objective to homogenize the climatic information contained in MongoDB, providing as a result a dataset in JSON, CSV or XML format.
引用
收藏
页数:6
相关论文
共 26 条
  • [21] Research on Heterogeneous Data Integration in the Safety Production and Management of Coal-mining
    Han Xiao-bing
    Tian Feng
    Wu Feng-bo
    FIRST INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS, PROCEEDINGS, 2009, : 87 - 90
  • [22] A NoSQL-SQL Hybrid Organization and Management Approach for Real-Time Geospatial Data: A Case Study of Public Security Video Surveillance
    Wu, Chen
    Zhu, Qing
    Zhang, Yeting
    Du, Zhiqiang
    Ye, Xinyue
    Qin, Han
    Zhou, Yan
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2017, 6 (01)
  • [23] Multi-source Heterogeneous Hakka Culture Heritage Data Management based on MongoDB
    Wu, Qunyong
    Chen, Chongcheng
    Jiang, Ying
    2016 FIFTH INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS (AGRO-GEOINFORMATICS), 2016, : 363 - 368
  • [24] An ontology-based framework for heterogeneous data management and its application for urban flood disasters
    Wu, Zening
    Shen, Yanxia
    Wang, Huiliang
    Wu, Meimei
    EARTH SCIENCE INFORMATICS, 2020, 13 (02) : 377 - 390
  • [25] An ontology-based framework for heterogeneous data management and its application for urban flood disasters
    Zening Wu
    Yanxia Shen
    Huiliang Wang
    Meimei Wu
    Earth Science Informatics, 2020, 13 : 377 - 390
  • [26] MEdit4CEP-SP: A model-driven solution to improve decision-making through user-friendly management and real-time processing of heterogeneous data streams
    Corral-Plaza, David
    Ortiz, Guadalupe
    Medina-Bulo, Inmaculada
    Boubeta-Puig, Juan
    KNOWLEDGE-BASED SYSTEMS, 2021, 213