Management of heterogeneous data in the Red Climatologica UACJ in a NoSQL environment

被引:0
|
作者
Jimenez, Alicia [1 ]
Nieves, Jose [1 ]
Estrada, Fernando [1 ]
Vazquez-Galvez, Felipe A. [1 ]
Hernandez, Israel [1 ]
机构
[1] Univ Autonoma Ciudad Juarez, Dept Ingn & Tecnol, Ciudad Juarez, Chihuahua, Mexico
来源
2019 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC 2019) | 2019年
关键词
NoSQL; MongoDB; linear regression; heterogeneous data; homogenization;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The meteorological data in networks are susceptible to errors and irregularities, one of the reasons is because they are collected by different types of meteorological stations, the possibility of heterogeneous data, so they limit their assimilation to models and interpretation platforms. This paper presents a project that aims to assist the Laboratorio de Climatologia y Calidad del Aire in the analysis of the Red-Clima UACJ, through the creation of a NoSQL environment in which there is a process for the quality assessment of the data, as well as the necessary management for the homogenization and visualization of it. The quality assessment using a series of quality control algorithms can detect possible anomalies in the behavior of the data for later review and modification. For the management it is necessary to create a framework with the objective to homogenize the climatic information contained in MongoDB, providing as a result a dataset in JSON, CSV or XML format.
引用
收藏
页数:6
相关论文
共 26 条
  • [11] Big Data and Knowledge Management: How to Implement Conceptual Models in NoSQL Systems?
    Abdelhedi, Fatma
    Brahim, Amal Ait
    Atigui, Faten
    Zurfluh, Gilles
    PROCEEDINGS OF THE 8TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE DISCOVERY, KNOWLEDGE ENGINEERING AND KNOWLEDGE MANAGEMENT, VOL 3 (KMIS), 2016, : 235 - 240
  • [12] Efficient Integration Method of Large-Scale Heterogeneous Security Logs Using NoSQL in Cloud Computing Environment
    Jeong, Huijin
    Piao, Xuefeng
    Choi, Junho
    Shin, Juhyun
    Kim, Pankoo
    JOURNAL OF INTERNET TECHNOLOGY, 2016, 17 (02): : 267 - 275
  • [13] An Efficient Agent Based Data Management Method of NoSQL Environments for Health Care Applications
    Kotsilieris, Theodore
    HEALTHCARE, 2021, 9 (03)
  • [14] The PACIFIC ontology for heterogeneous data management in cardiology
    Raboudi, Amel
    Herv, Pierre-Yves
    Allanic, Marianne
    Boutinaud, Philippe
    Christophe, Jean-Joseph
    Firat, Hueseyin
    Mousseaux, Elie
    Pernot, Mathieu
    Prot, Pierre
    Sartorius-Carvajal, Alfonso
    Chezalviel-Guilbert, Frederique
    Hulot, Jean-Sebastien
    JOURNAL OF BIOMEDICAL INFORMATICS, 2024, 149
  • [15] Efficient Data Management Tools for the Heterogeneous Big Data Warehouse
    Alekseev, A. A.
    Osipova, V. V.
    Ivanov, M. A.
    Klimentov, A.
    Grigorieva, N. V.
    Nalamwar, H. S.
    PHYSICS OF PARTICLES AND NUCLEI LETTERS, 2016, 13 (05) : 689 - 692
  • [16] An Approach to Evolution Management in Integrated Heterogeneous Data Sources
    Solodovnikova, Darja
    Niedrite, Laila
    Svilpe, Lauma
    ENTERPRISE INFORMATION SYSTEMS, ICEIS 2021, 2022, 455 : 47 - 70
  • [17] "Big" Data Management in Cloud Computing Environment
    Agarwal, Mohit
    Srivastava, Gur Mauj Saran
    HARMONY SEARCH AND NATURE INSPIRED OPTIMIZATION ALGORITHMS, 2019, 741 : 707 - 716
  • [18] Crop and Weed Segmentation and Fractal Dimension Estimation Using Small Training Data in Heterogeneous Data Environment
    Akram, Rehan
    Hong, Jin Seong
    Kim, Seung Gu
    Sultan, Haseeb
    Usman, Muhammad
    Gondal, Hafiz Ali Hamza
    Tariq, Muhammad Hamza
    Ullah, Nadeem
    Park, Kang Ryoung
    FRACTAL AND FRACTIONAL, 2024, 8 (05)
  • [19] A graph-based meta-model for heterogeneous data management
    Ernesto Damiani
    Barbara Oliboni
    Elisa Quintarelli
    Letizia Tanca
    Knowledge and Information Systems, 2019, 61 : 107 - 136
  • [20] A graph-based meta-model for heterogeneous data management
    Damiani, Ernesto
    Oliboni, Barbara
    Quintarelli, Elisa
    Tanca, Letizia
    KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 61 (01) : 107 - 136