Design of Marine Data Warehouse ETL System

被引:1
|
作者
Wen WeiJun [1 ]
机构
[1] Ocean Univ China, Dept Marine Technol, Qingdao 266100, Peoples R China
关键词
data warehouse; ETL; marine data; data cleaning; data extracting; data transformation;
D O I
10.4028/www.scientific.net/AMM.668-669.1374
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
ETL refers to the process of data extracting, transformation and loading and is deemed as a critical step in ensuring the quality, data specification and standardization of marine environmental data. Marine data, due to their complication, field diversity and huge volume, still remain decentralized, polyphyletic and isomerous with different semantics and hence far from being able to provide effective data sources for decision making. ETL enables the construction of marine environmental data warehouse in the form of cleaning, transformation, integration, loading and periodic updating of basic marine data warehouse. The paper presents a research on rules for cleaning, transformation and integration of marine data, based on which original ETL system of marine environmental data warehouse is so designed and developed. The system further guarantees data quality and correctness in analysis and decision-making based on marine environmental data in the future.
引用
收藏
页码:1374 / 1377
页数:4
相关论文
共 50 条
  • [1] Design and Implementation of ETL in Police Intelligence Data Warehouse System
    Shen Liangzhong
    Liu Shihua
    Chen Shengkai
    FRONTIERS OF MANUFACTURING AND DESIGN SCIENCE II, PTS 1-6, 2012, 121-126 : 3865 - +
  • [2] ETL of spatial data warehouse
    Research Center of Spatial Information and Digital Engineering, International Software Institute, Wuhan University, 129 Luoyu Road, Wuhan 430079, China
    Geomatics and Information Science of Wuhan University, 2007, 32 (04) : 362 - 365
  • [3] Two-ETL Phases for Data Warehouse Creation: Design and Implementation
    Nabli, Ahlem
    Bouaziz, Senda
    Yangui, Rania
    Gargouri, Faiez
    ADVANCES IN DATABASES AND INFORMATION SYSTEMS, ADBIS 2015, 2015, 9282 : 138 - 150
  • [4] Nuts and Bolts of ETL in Data Warehouse
    Sachin, Sharma
    Goyal, Sandip Kumar
    Avinash, Sharma
    Kamal, Kumar
    EMERGING TRENDS IN EXPERT APPLICATIONS AND SECURITY, 2019, 841 : 1 - 9
  • [5] Improving the ETL process of Higher Education Information System Data Warehouse
    Mekterovic, Igor
    Brkic, Ljiljana
    Baranovic, Mirta
    AIC '09: PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON APPLIED INFORMATICS AND COMMUNICATIONS: RECENT ADVANCES IN APPLIED INFORMAT AND COMMUNICATIONS, 2009, : 265 - +
  • [6] ETL Function Realization of Data Warehouse System Based on SSIS Platform
    Wu, Tong
    2010 2ND INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS PROCEEDINGS (DBTA), 2010,
  • [7] Applying DP to ETL of spatial data warehouse
    Chen, XQ
    Chi, ZX
    Cao, XK
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, : 1616 - 1619
  • [8] Interface Design and Development of ETL in the Telecommunications Business Data Warehouse Plat Form
    Gu He
    Zhao Yaohong
    APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 : 2236 - 2239
  • [9] A proposed model for data warehouse ETL processes
    El-Sappagh, Shaker H. Ali
    Hendawi, Abdeltawab M. Ahmed
    El Bastawissy, Ali Hamed
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2011, 23 (02) : 91 - 104
  • [10] ENHANCING THE ETL PROCESS IN DATA WAREHOUSE SYSTEMS
    Petre, Ruxandra
    PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON INFORMATICS IN ECONOMY (IE 2015): EDUCATION, RESEARCH & BUSINESS TECHNOLOGIES, 2015, : 392 - 397