BigDimETL: ETL for Multidimensional Big Data

被引:1
|
作者
Mallek, Hana [1 ,2 ]
Ghozzi, Faiza [1 ,2 ]
Teste, Olivier [1 ,2 ]
Gargouri, Faiez [1 ,2 ]
机构
[1] Univ Sfax, MIR CL Lab, BP 242, Sfax 3021, Tunisia
[2] Univ Toulouse, IRIT 5505, 118 Route Narbonne, F-31062 Toulouse, France
来源
INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS (ISDA 2016) | 2017年 / 557卷
关键词
ETL; Data warehouse; Bigdata; Twitter; MapReduce; Parallel processing; Multidimensional structure;
D O I
10.1007/978-3-319-53480-0_92
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the broad range of data available on the World Wide Web and the increasing use of social media such as Facebook, Twitter, YouTube, etc. a "Big Data" notion has emerged. This latter has become an important aspect in nowadays business since it is full of important knowledge that is crucial for effective decision making. However, this kind of data brings with it new problems and challenges for the Decision Support System (DSS) that must be addressed. In this paper, we propose a new approach called BigDimETL (Big Dimensional ETL) that deals with ETL (Extract-Transform-Load) development process. Our approach focuses on integrating Big Data taking into account the MultiDimensional Structure (MDS) through a MapReduce paradigm.
引用
收藏
页码:935 / 944
页数:10
相关论文
共 50 条
  • [21] Big Data ETL Process and Its Impact on Text Mining Analysis for Employees' Reviews
    Tanasescu, Laura Gabriela
    Vines, Andreea
    Bologa, Ana Ramona
    Vaida, Claudia Antal
    APPLIED SCIENCES-BASEL, 2022, 12 (15):
  • [22] A MapReduce Based Approach of Scalable Multidimensional Anonymization for Big Data Privacy Preservation on Cloud
    Zhang, Xuyun
    Yang, Chi
    Nepal, Surya
    Liu, Chang
    Dou, Wanchun
    Chen, Jinjun
    2013 IEEE THIRD INTERNATIONAL CONFERENCE ON CLOUD AND GREEN COMPUTING (CGC 2013), 2013, : 105 - 112
  • [23] A New ETL Approach Based on Data Virtualization
    Guo, Shu-Sheng
    Yuan, Zi-Mu
    Sun, Ao-Bing
    Yue, Qiang
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2015, 30 (02) : 311 - 323
  • [24] A New ETL Approach Based on Data Virtualization
    Shu-Sheng Guo
    Zi-Mu Yuan
    Ao-Bing Sun
    Qiang Yue
    Journal of Computer Science and Technology, 2015, 30 : 311 - 323
  • [25] Design of Marine Data Warehouse ETL System
    Wen WeiJun
    MECHANICAL COMPONENTS AND CONTROL ENGINEERING III, 2014, 668-669 : 1374 - 1377
  • [26] ENHANCING THE ETL PROCESS IN DATA WAREHOUSE SYSTEMS
    Petre, Ruxandra
    PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON INFORMATICS IN ECONOMY (IE 2015): EDUCATION, RESEARCH & BUSINESS TECHNOLOGIES, 2015, : 392 - 397
  • [27] A Comparative Review Of Data Warehousing ETL Tools With New Trends And Industry Insight
    Mukherjee, Rajendrani
    Kar, Pragma
    2017 7TH IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC), 2017, : 943 - 948
  • [28] A Novel Multidimensional Approach to Integrate Big Data in Business Intelligence
    Mate, Alejandro
    Llorens, Hector
    de Gregorio, Elisa
    Tardo, Roberto
    Gil, David
    Munoz-Terol, Rafa
    Trujillo, Juan
    JOURNAL OF DATABASE MANAGEMENT, 2015, 26 (02) : 14 - 31
  • [29] Cluster-size optimization within a cloud-based ETL framework for Big Data
    Zdravevski, Eftim
    Lameski, Petre
    Dimitrievski, Ace
    Grzegorowski, Marek
    Apanowicz, Cas
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 3754 - 3763
  • [30] Big Data Augmentation with Data Warehouse: A Survey
    Aftab, Umar
    Siddiqui, Ghazanfar Farooq
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2785 - 2794