Managing Evolution of Heterogeneous Data Sources of a Data Warehouse

被引:0
|
作者
Solodovnikova, Darja [1 ]
Niedrite, Laila [1 ]
Svilpe, Lauma [1 ]
机构
[1] Univ Latvia, Fac Comp, Raina Blvd 19, Riga, Latvia
来源
PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS (ICEIS 2021), VOL 1 | 2021年
关键词
Data Warehouse; Evolution; Change Propagation; Metadata; Big Data;
D O I
10.5220/0010496601050117
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The evolution of heterogeneous integrated data sources has become a topical issue as data nowadays is very diverse and dynamic. For this reason, novel methods are necessary to collect, store and analyze data from various data sources as efficiently as possible, while also handling changes in data structures that have occurred as a result of evolution. In this paper, we propose a solution to problems caused by evolution of integrated data sources and information requirements for the data analysis system. Our solution incorporates an architecture that allows to perform OLAP operations and other kinds of analysis on integrated big data and a mechanism for detecting and automatically or semi-automatically propagating changes occured in heterogeneous data sources to a data warehouse.
引用
收藏
页码:105 / 117
页数:13
相关论文
共 50 条
  • [1] An Approach to Evolution Management in Integrated Heterogeneous Data Sources
    Solodovnikova, Darja
    Niedrite, Laila
    Svilpe, Lauma
    ENTERPRISE INFORMATION SYSTEMS, ICEIS 2021, 2022, 455 : 47 - 70
  • [2] On Metadata Support for Integrating Evolving Heterogeneous Data Sources
    Solodovnikova, Darja
    Niedrite, Laila
    Niedritis, Aivars
    NEW TRENDS IN DATABASES AND INFORMATION SYSTEMS, ADBIS 2019, 2019, 1064 : 378 - 390
  • [3] Metadata to Support Data Warehouse Evolution
    Solodovnikova, Darja
    INFORMATION SYSTEMS DEVELOPMENT: TOWARDS A SERVICE PROVISION SOCIETY, 2009, : 627 - 635
  • [4] Framework of Semantic Data Warehouse for Heterogeneous and Incomplete Data
    Nugraheni, Ekasari
    Akbar, Saiful
    Saptawati, G. Ayu Putri
    2016 IEEE REGION 10 SYMPOSIUM (TENSYMP), 2016, : 161 - 166
  • [5] Efficient Data Management Tools for the Heterogeneous Big Data Warehouse
    Alekseev, A. A.
    Osipova, V. V.
    Ivanov, M. A.
    Klimentov, A.
    Grigorieva, N. V.
    Nalamwar, H. S.
    PHYSICS OF PARTICLES AND NUCLEI LETTERS, 2016, 13 (05) : 689 - 692
  • [6] Data Warehouse Design for Soil Nutrients with IoT Based Data Sources
    Rahman, Abdul
    Ermatita
    Budianta, Dedik
    2019 INTERNATIONAL CONFERENCE ON INFORMATICS, MULTIMEDIA, CYBER AND INFORMATION SYSTEM (ICIMCIS), 2019, : 181 - 185
  • [7] Managing Data Quality of the Data Warehouse: A Chance-Constrained Programming Approach
    Qi Liu
    Gengzhong Feng
    Giri Kumar Tayi
    Jun Tian
    Information Systems Frontiers, 2021, 23 : 375 - 389
  • [8] Managing Data Quality of the Data Warehouse: A Chance-Constrained Programming Approach
    Liu, Qi
    Feng, Gengzhong
    Tayi, Giri Kumar
    Tian, Jun
    INFORMATION SYSTEMS FRONTIERS, 2021, 23 (02) : 375 - 389
  • [9] XML-Based Heterogeneous Database Integration For Data Warehouse Creation
    Tseng, Frank S. C.
    PACIFIC ASIA CONFERENCE ON INFORMATION SYSTEMS 2005, SECTIONS 1-8 AND POSTER SESSIONS 1-6, 2005, : 590 - 603
  • [10] On the Research of Data Warehouse in Big Data
    Qin, Hai-fei
    Qian, Zhi-ming
    Zhao, Yong-chao
    2015 INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC), 2015, : 354 - 357