Multidimensional architecture using a massive and heterogeneous data: Application to drought monitoring

被引:4
作者
Balti, Hanen [1 ,3 ]
Ben Abbes, Ali [1 ,2 ]
Mellouli, Nedra [3 ]
Farah, Imed Riadh [1 ,6 ]
Sang, Yanfang [4 ,5 ]
Lamolle, Myriam [3 ]
机构
[1] Ecole Natl Sci Informat, Lab RIADI, La Manouba 2010, Tunisia
[2] FRB CESAB, F-34000 Montpellier, France
[3] Univ Paris 08, Lab Intelligence Artificielle & Semant Donnees LIA, Paris, France
[4] Chinese Acad Sci, Inst Geog Sci & Nat Resources Res, Key Lab Water Cycle & Related Land Surface Proc, Beijing 100101, Peoples R China
[5] Minist Emergency Management China, Key Lab Cpd & Chained Nat Hazards, Beijing 100085, Peoples R China
[6] IMT Atlantique, Lab ITI Dept, F-29238 Brest, France
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2022年 / 136卷
基金
中国国家自然科学基金;
关键词
Big data; Data storage; Spatio-temporal querying; Decision-making; Earth observation; Disaster management; BIG DATA;
D O I
10.1016/j.future.2022.05.010
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The rapid increase in the number of Earth Observation (EO) systems generates a massive amount of heterogeneous data. It has raised big issues in collecting, preprocessing, storing, and the visualization these data. However, traditional techniques are facing serious challenges when dealing with big EO data dimensions (i.e., Volume, Veracity, Variety, and Velocity), especially in natural hazards management. Therefore, big data techniques and tools attract more attention. In this paper we propose a multidimensional model framework for Big EO data warehousing. This framework includes 3 parts: (1) Data collection and preprocessing, being responsible for collecting data and improving their quality; (2) Data loading and storage, performing the ingestion task which consists of transferring the data from external resources to the Big data platform for storage; and (3) Visualization and interpretation, aiming to provide spatio-temporal analysis. This framework could be useful for decision-makers in monitoring the effects of drought disasters and, consequently, planning the mitigation and remediation measures. Experiments are carried out on drought monitoring in China along the period 2000-2020. The input data include remote sensing data, biophysical data, and climatological data. The results reveal that the proposed framework has a higher retrieval speed and a greater elasticity with different kinds (i.e. spatial, temporal, or spatiotemporal) of requests compared to traditional frameworks, indicating its superiority.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 35 条
  • [1] Almansouri Hatim Talal, 2019, P 2019 IEEE WORLD C
  • [2] [Anonymous], 2009, Data Warehouse Design: Modern Principles and Methodologies
  • [3] [Anonymous], 2019, OGC STANDARDS SUPPOR
  • [4] [Anonymous], 2017, Moderate Resolution Imaging Spectroradiometer
  • [5] Apache Flume, US
  • [6] Apache HBase,", about us
  • [7] Apache Hive, about us
  • [8] Balti Hanen, 2019, Proceedings of the International Conferences. Big Data Analytics, Data Mining and Computational Intelligence 2019. Theory and Practice in Modern Computing 2019, P119
  • [9] Deep Semantic Feature Detection from Multispectral Satellite Images
    Balti, Hanen
    Mellouli, Nedra
    Chebbi, Imen
    Farah, Imed
    Lamolle, Myriam
    [J]. KDIR: PROCEEDINGS OF THE 11TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE DISCOVERY, KNOWLEDGE ENGINEERING AND KNOWLEDGE MANAGEMENT - VOL 1: KDIR, 2019, : 458 - 466
  • [10] A review of drought monitoring with big data: Issues, methods, challenges and research directions
    Balti, Hanen
    Ben Abbes, Ali
    Mellouli, Nedra
    Farah, Imed Riadh
    Sang, Yanfang
    Lamolle, Myriam
    [J]. ECOLOGICAL INFORMATICS, 2020, 60