Modification of the Algorithm for Dynamic Data Transformation Based on Blockchain Technology for Data Management Systems

被引:0
|
作者
Olimpiev, Nikita [1 ]
Vodyaho, Alexander [2 ]
Zhukova, Nataly [3 ]
机构
[1] ITMO Univ, Kronverksky Pr 49,Bldg A, St Petersburg 197101, Russia
[2] St Petersburg Electrotech Univ, Prof Popova St 5, St Petersburg 197022, Russia
[3] Russian Acad Sci, St Petersburg Fed Res Ctr, Lab Big Data Technol Sociocyberphys Syst, 14th Linia,6,39, St Petersburg 199178, Russia
关键词
Blockchain Technology; Master Data Management; Ethereum; Semantic Data Management; Data Transformation; Decentralized Systems; Data Quality; Data Security;
D O I
10.1007/978-3-031-37105-9_37
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rapid growth of data and increasing complexity in various domains necessitate advanced data management solutions that address data quality, security, and interoperability challenges. This paper presents a modified algorithm for dynamic data transformation based on blockchain technology for Master Data Management Systems (MDM), incorporating Ethereum, IPFS and semantic data. Based on the proposed algorithm, an architectural approach is also described that allows developing semantic data management systems. The algorithm assumes data validation, enrichment, and deduplication processes, while also ensuring consistency and trust among multiple participants through the decentralized nature of the blockchain. The semantic data management aspect of the system is achieved using Apache Jena and local ontology, which facilitate semantic interoperability and efficient data processing. The proposed approach addresses the challenge of applying blockchain technology to semantic MDM systems and demonstrates an approach to using the system in SemanticWeb, as well as in areas such as finance, healthcare, public administration, and logistics. We evaluated the algorithm using a customer information dataset from an e-commerce platform. The results confirmed the potential of blockchain technology in data management and showed improvements in data accuracy, consistency, completeness, but with some loss in storage efficiency due to the use of blockchain. This paper contributes to developing and evaluating a novel algorithm and architecture, combining blockchain technology, MDM principles, and semantic data management for improving data quality, security, and performance in decentralized systems. However, further research and assessment may be required for the full implementation and evaluation of the system.
引用
收藏
页码:555 / 571
页数:17
相关论文
共 50 条
  • [31] Battery Data Management and Analytics Platform Using Blockchain Technology
    Aenugu, Indrasena R.
    Bere, Gomanth
    Ochoa, Justin J.
    Kim, Taesic
    Lee, Chungu
    Park, Joung-hu
    2020 IEEE TRANSPORTATION ELECTRIFICATION CONFERENCE & EXPO (ITEC), 2020, : 153 - 157
  • [32] PHDMF: A Flexible and Scalable Personal Health Data Management Framework Based on Blockchain Technology
    Ma, Liangxiao
    Liao, Yongxiang
    Fan, Haiwei
    Zheng, Xianfeng
    Zhao, Jintao
    Xiao, Ziyi
    Zheng, Guangyong
    Xiong, Yun
    FRONTIERS IN GENETICS, 2022, 13
  • [33] Data quality and blockchain technology
    Bellini, Valentina
    Petroni, Alberto
    Palumbo, Giuseppina
    Bignami, Elena
    ANAESTHESIA CRITICAL CARE & PAIN MEDICINE, 2019, 38 (05) : 521 - 522
  • [34] Secure Big Data Model Based on Blockchain Technology
    Alshammari, Ahmad
    ADVANCES IN SCIENCE AND TECHNOLOGY-RESEARCH JOURNAL, 2024, 18 (04) : 163 - 176
  • [35] Transportation Data Sharing Model Based on Blockchain Technology
    Zhang, Li
    Duan, Chengmin
    Huang, Lili
    Liu, Na
    SIXTH INTERNATIONAL CONFERENCE ON ELECTROMECHANICAL CONTROL TECHNOLOGY AND TRANSPORTATION (ICECTT 2021), 2022, 12081
  • [36] Spatial Planning Data Structure Based on Blockchain Technology
    Tang, Minwen
    Dai, Wujiao
    Yin, Changlin
    Hu, Bing
    Chen, Jun
    Liu, Haoming
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2024, 13 (08)
  • [37] Research on data Traceability Method Based on blockchain Technology
    Li Wei
    Wang Dawei
    Wang Lixia
    2020 INTERNATIONAL CONFERENCE ON BIG DATA & ARTIFICIAL INTELLIGENCE & SOFTWARE ENGINEERING (ICBASE 2020), 2020, : 45 - 49
  • [38] SecureConsent: A Blockchain-based Dynamic and Secure Consent Management for Genomic Data Sharing
    Javed, Ibrahim Tariq
    Lemieux, Victoria
    Regier, Dean A.
    2024 INTERNATIONAL CONFERENCE ON SMART APPLICATIONS, COMMUNICATIONS AND NETWORKING, SMARTNETS-2024, 2024,
  • [39] Dynamic Data Transformation for Low Latency Querying in Big Data Systems
    Ordonez-Ante, Leandro
    Vanhove, Thomas
    Van Seghbroeck, Gregory
    Wauters, Tim
    Volckaert, Bruno
    De Turck, Filip
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 2480 - 2489
  • [40] Blockchain-based data sharing algorithm in distributed network data storage
    Cui, Shuguang
    Wang, Haixia
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2024, 24 (01) : 427 - 444