BigDimETL: ETL for Multidimensional Big Data

被引:1
|
作者
Mallek, Hana [1 ,2 ]
Ghozzi, Faiza [1 ,2 ]
Teste, Olivier [1 ,2 ]
Gargouri, Faiez [1 ,2 ]
机构
[1] Univ Sfax, MIR CL Lab, BP 242, Sfax 3021, Tunisia
[2] Univ Toulouse, IRIT 5505, 118 Route Narbonne, F-31062 Toulouse, France
来源
INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS (ISDA 2016) | 2017年 / 557卷
关键词
ETL; Data warehouse; Bigdata; Twitter; MapReduce; Parallel processing; Multidimensional structure;
D O I
10.1007/978-3-319-53480-0_92
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the broad range of data available on the World Wide Web and the increasing use of social media such as Facebook, Twitter, YouTube, etc. a "Big Data" notion has emerged. This latter has become an important aspect in nowadays business since it is full of important knowledge that is crucial for effective decision making. However, this kind of data brings with it new problems and challenges for the Decision Support System (DSS) that must be addressed. In this paper, we propose a new approach called BigDimETL (Big Dimensional ETL) that deals with ETL (Extract-Transform-Load) development process. Our approach focuses on integrating Big Data taking into account the MultiDimensional Structure (MDS) through a MapReduce paradigm.
引用
收藏
页码:935 / 944
页数:10
相关论文
共 50 条
  • [1] A Big Data Perspective of Current ETL Techniques
    Phanikanth, K. V.
    Sudarsan, Sithu D.
    2016 THIRD INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND ENGINEERING (ICACCE 2016), 2016, : 330 - 334
  • [2] GENUS: an ETL tool treating the Big Data Variety
    Souissi, Salwa
    BenAyed, Mounir
    2016 IEEE/ACS 13TH INTERNATIONAL CONFERENCE OF COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2016,
  • [3] Generalized Big Data Test Framework for ETL Migration
    Sharma, Kunal
    Attar, Vahida
    2016 INTERNATIONAL CONFERENCE ON COMPUTING, ANALYTICS AND SECURITY TRENDS (CAST), 2016, : 528 - 532
  • [4] Multidimensional scaling for big data
    Delicado, Pedro
    Pachon-Garcia, Cristian
    ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2024,
  • [5] A Design of ETL for the Construction of Traffic Network Based on Big Data
    Liu, Qinan
    3RD INTERNATIONAL CONFERENCE ON APPLIED ENGINEERING, 2016, 51 : 451 - 456
  • [6] Feature Influence Based ETL for Efficient Big Data Management
    Vijayalakshmi, M.
    Minu, R., I
    JOURNAL OF SCIENTIFIC & INDUSTRIAL RESEARCH, 2022, 81 (12): : 1310 - 1316
  • [7] BIG DATA AND MULTIDIMENSIONAL ANALYSES WITH SPATIAL DATA
    Otrzasek, Jakub
    Mueller, Wojciech
    Koszela, Krzysztof
    Weres, Jerzy
    Przybyl, Jacek
    GEOCONFERENCE ON INFORMATICS, GEOINFORMATICS AND REMOTE SENSING, VOL I, 2014, : 65 - 71
  • [8] AScale: Big/Small Data ETL and Real-Time Data Freshness
    Martins, Pedro
    Abbasi, Maryam
    Furtado, Pedro
    BEYOND DATABASES, ARCHITECTURES AND STRUCTURES, BDAS 2016, 2016, 613 : 315 - 327
  • [9] A Systematic Literature Review on Big Data Extraction, Transformation and Loading (ETL)
    Nwokeji, Joshua C.
    Matovu, Richard
    INTELLIGENT COMPUTING, VOL 2, 2021, 284 : 308 - 324
  • [10] Distributed real-time ETL architecture for unstructured big data
    Erum Mehmood
    Tayyaba Anees
    Knowledge and Information Systems, 2022, 64 : 3419 - 3445